2019-12-09T09:12:47.741 INFO:root:teuthology version: 1.0.0-8b630f9 2019-12-09T09:12:47.741 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.XujpXK.tmp -- --verbose --lock --description rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} --name ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi --block --owner scheduled_ofriedma@teuthology --archive /home/teuthworker/archive/ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4584243 2019-12-09T09:12:47.787 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-09T09:12:47.843 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4584243 branch: wip-ofriedma-dynamic-disable description: rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} email: ofriedma@redhat.com first_in_suite: false job_id: '4584243' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos overrides: admin_socket: branch: wip-ofriedma-dynamic-disable ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw lc debug interval: 10 global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd fast shutdown: false osd objectstore: filestore osd shutdown pgref assert: true osd sloppy crc: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: 1351c819e1a9518cde4c8b12d645782009028360 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: flavor: notcmalloc sha1: 1351c819e1a9518cde4c8b12d645782009028360 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true rgw.client.1: ca: root client: client.1 embed-key: true root: client: client.0 cn: teuthology install: - client.0 - client.1 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 client.1: ssl certificate: rgw.client.1 compression type: random ec-data-pool: true frontend: beast storage classes: LUKEWARM, FROZEN s3tests: slow_backend: true workunit: branch: wip-ofriedma-dynamic-disable sha1: 1351c819e1a9518cde4c8b12d645782009028360 owner: scheduled_ofriedma@teuthology priority: 60 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 sha1: 1351c819e1a9518cde4c8b12d645782009028360 suite: rgw suite_branch: wip-ofriedma-dynamic-disable suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 1351c819e1a9518cde4c8b12d645782009028360 tasks: - install: flavor: notcmalloc - ceph: null - openssl_keys: null - rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - rgw/test_rgw_gc_log.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - s3tests-java: client.0: force-branch: master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: force-branch: ceph-master rgw_server: client.0 - swift: client.0: rgw_server: client.0 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.29534 2019-12-09T09:12:47.843 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa; will attempt to use it 2019-12-09T09:12:47.844 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa/tasks 2019-12-09T09:12:47.844 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-12-09T09:12:47.846 INFO:teuthology.task.internal:Checking packages... 2019-12-09T09:12:47.858 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'notcmalloc' and ceph hash '1351c819e1a9518cde4c8b12d645782009028360' 2019-12-09T09:12:47.859 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-09T09:12:47.859 INFO:teuthology.packaging:ref: None 2019-12-09T09:12:47.859 INFO:teuthology.packaging:tag: None 2019-12-09T09:12:47.859 INFO:teuthology.packaging:branch: wip-ofriedma-dynamic-disable 2019-12-09T09:12:47.859 INFO:teuthology.packaging:sha1: 1351c819e1a9518cde4c8b12d645782009028360 2019-12-09T09:12:47.860 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&ref=wip-ofriedma-dynamic-disable 2019-12-09T09:12:48.012 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-7900.g1351c81 2019-12-09T09:12:48.012 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-12-09T09:12:48.023 INFO:teuthology.task.internal:no buildpackages task found 2019-12-09T09:12:48.023 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-12-09T09:12:48.038 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-12-09T09:12:48.038 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-09T09:12:48.081 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:12:58.097 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:13:08.112 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:13:18.130 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:13:28.146 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:13:38.160 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:13:48.178 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:13:58.195 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:14:08.212 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:14:18.225 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:14:28.243 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:14:38.258 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:14:48.273 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:14:58.294 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:15:08.313 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:15:18.330 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:15:28.344 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:15:38.361 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:15:48.377 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:15:58.393 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:16:08.412 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:16:18.429 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:16:28.445 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:16:38.883 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:16:48.900 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:16:58.917 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-09T09:17:08.932 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:17:18.948 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:17:28.965 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:17:38.981 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:17:48.999 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:17:59.008 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:18:09.025 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:18:19.043 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:18:29.056 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:18:39.073 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:18:49.089 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:18:59.109 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:19:09.124 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:19:19.141 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:19:29.163 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:19:39.180 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:19:49.196 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:19:59.212 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:20:09.228 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:20:19.243 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:20:29.260 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:20:39.275 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:20:49.292 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:20:59.309 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:21:09.328 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:21:19.346 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:21:29.361 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:21:39.377 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:21:49.393 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-09T09:21:59.410 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_ofriedma@teuthology', 'description': '/home/teuthworker/archive/ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4584243', 'machine_type': 'smithi'} 2019-12-09T09:21:59.435 DEBUG:teuthology.lock.ops:locked ubuntu@smithi132.front.sepia.ceph.com, ubuntu@smithi121.front.sepia.ceph.com 2019-12-09T09:21:59.515 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-09T09:21:59.710 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 7.6 2019-12-09T09:21:59.717 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of centos 7.6 2019-12-09T09:21:59.998 INFO:teuthology.orchestra.console:Power off smithi121 2019-12-09T09:21:59.998 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-09T09:22:00.016 INFO:teuthology.orchestra.console:Power off smithi132 2019-12-09T09:22:00.017 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-09T09:22:00.029 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T09:22:00.039 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T09:22:00.154 INFO:teuthology.orchestra.console:Power off for smithi121 completed 2019-12-09T09:22:00.162 INFO:teuthology.orchestra.console:Power off for smithi132 completed 2019-12-09T09:22:00.255 INFO:teuthology.orchestra.console:Power on smithi121 2019-12-09T09:22:00.256 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-09T09:22:00.269 INFO:teuthology.orchestra.console:Power on smithi132 2019-12-09T09:22:00.269 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-09T09:22:00.285 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T09:22:00.296 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T09:22:04.320 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T09:22:04.329 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T09:22:04.540 INFO:teuthology.orchestra.console:Power on for smithi132 completed 2019-12-09T09:22:04.641 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2019-12-09T09:22:08.432 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-09T09:22:08.643 INFO:teuthology.orchestra.console:Power on for smithi121 completed 2019-12-09T09:22:08.744 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish 2019-12-09T09:24:35.592 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi132.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:24:44.689 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi132.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:24:53.777 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi132.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:24:54.775 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi121.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:25:02.866 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi132.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:25:03.853 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi121.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:25:11.953 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi132.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:25:12.910 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi121.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:25:21.035 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi132.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:25:21.965 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi121.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:25:30.093 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi132.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:25:31.018 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi121.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:25:40.077 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi121.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:25:49.134 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi121.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:25:58.189 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi121.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:26:07.245 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi121.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:26:36.114 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi132.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:26:36.335 INFO:teuthology.orchestra.run.smithi132:> hostname 2019-12-09T09:26:36.907 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2019-12-09T09:26:36.907 INFO:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2019-12-09T09:26:37.000 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2019-12-09T09:26:37.000 INFO:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2019-12-09T09:26:37.167 INFO:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2019-12-09T09:26:37.275 INFO:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2019-12-09T09:26:37.355 INFO:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2019-12-09T09:26:37.421 INFO:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2019-12-09T09:26:37.483 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2019-12-09T09:26:37.485 DEBUG:teuthology.parallel:result is None 2019-12-09T09:27:13.274 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi121.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:27:13.480 INFO:teuthology.orchestra.run.smithi121:> hostname 2019-12-09T09:27:14.071 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121 2019-12-09T09:27:14.072 INFO:teuthology.orchestra.run.smithi121:> grep smithi121 /etc/hosts 2019-12-09T09:27:14.153 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2019-12-09T09:27:14.154 INFO:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2019-12-09T09:27:14.293 INFO:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121/smithi121/g' /etc/hosts 2019-12-09T09:27:14.374 INFO:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts 2019-12-09T09:27:14.457 INFO:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121/smithi121/g' /etc/hostname 2019-12-09T09:27:14.538 INFO:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2019-12-09T09:27:14.609 INFO:teuthology.provision.fog.smithi121:Deploy complete! 2019-12-09T09:27:14.611 DEBUG:teuthology.parallel:result is None 2019-12-09T09:27:14.794 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com 2019-12-09T09:27:14.795 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-09T09:27:14.814 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2019-12-09T09:27:14.814 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-09T09:27:14.829 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server 2019-12-09T09:27:14.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T09:27:14.830 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi121.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:27:14.921 INFO:teuthology.orchestra.run.smithi121:> true 2019-12-09T09:27:15.302 INFO:teuthology.orchestra.run.smithi121:> uname -m 2019-12-09T09:27:15.375 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2019-12-09T09:27:15.375 INFO:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2019-12-09T09:27:15.440 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Linux" 2019-12-09T09:27:15.441 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="7 (Core)" 2019-12-09T09:27:15.441 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2019-12-09T09:27:15.441 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2019-12-09T09:27:15.441 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="7" 2019-12-09T09:27:15.441 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-09T09:27:15.441 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2019-12-09T09:27:15.442 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-09T09:27:15.442 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.centos.org/" 2019-12-09T09:27:15.442 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-09T09:27:15.442 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:27:15.442 INFO:teuthology.orchestra.run.smithi121.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-09T09:27:15.442 INFO:teuthology.orchestra.run.smithi121.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-09T09:27:15.442 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-09T09:27:15.443 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-09T09:27:15.443 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:27:15.444 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2019-12-09T09:27:15.456 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2019-12-09T09:27:15.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T09:27:15.457 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi132.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:27:15.554 INFO:teuthology.orchestra.run.smithi132:> true 2019-12-09T09:27:15.926 INFO:teuthology.orchestra.run.smithi132:> uname -m 2019-12-09T09:27:16.005 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2019-12-09T09:27:16.005 INFO:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2019-12-09T09:27:16.075 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Linux" 2019-12-09T09:27:16.075 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="7 (Core)" 2019-12-09T09:27:16.076 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2019-12-09T09:27:16.076 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2019-12-09T09:27:16.076 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="7" 2019-12-09T09:27:16.076 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-09T09:27:16.076 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2019-12-09T09:27:16.076 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-09T09:27:16.076 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.centos.org/" 2019-12-09T09:27:16.077 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-09T09:27:16.077 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:27:16.077 INFO:teuthology.orchestra.run.smithi132.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-09T09:27:16.077 INFO:teuthology.orchestra.run.smithi132.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-09T09:27:16.077 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-09T09:27:16.077 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-09T09:27:16.077 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:27:16.078 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2019-12-09T09:27:16.091 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2019-12-09T09:27:16.119 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi121.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9Q1nXH6WHjP9As7cMHu6H9iQSjfQw5lx28eYO82uOiyb9w+6wklzp9ymHNdB8jZjjWFGGYX6RtEEc6QpRf0VcP9hevwfgJuM/2Cg+yqjRFsqx1QBI5290FHY3K5WpNdFpDykse4WtDT0fqtk/SSEzY7vGRzbBRjT56Xsyyl5UA5WQTJW0KLv2shtEevg3Q/g2KU9WBmbE5vACKykuRd+/BwKlHwtIRDYRjMsgCdTa2/+KhajmjygkqZk/sk2Fxj8Qn6mA2vh6VBfuNE4hGrqOW884ZEcy4JIaGSQxjJWKIrq1NUoqup6GPmbwGH361zF2/R2wprPdPVqNZXVjhhwF smithi132.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDtI/Noh4STN/oCwCHowUPiNadUDdFWJ4GmFu4xB1whIpkd26MtDNkFbv6MYLrhbM9vW9eGw5FOVdDdTEJ5ckQhOMhj5A7Wa20OIfuNMeoKz1FbfE9av68rdYn8rzgD3kOwH24h6qbpWdGgTbb+8XGgFRlfGaV6360aJ20sR0E9nANLelP0kCfc/zgECuv0lYpwagrfPYdUBjISMgWNyuFCPlX3qvuLb5r6ZsPq8RyVF92hkSKSmmbKhFoqXNB3b32/0l/vE2Hyb1JW+lfsffIXSh5MKb2p/1nKQMFV0fWeTDrkbOtT4KOOvkG2yi9GrKXFa+Hv2TfA7Bn6YrIVgIgF 2019-12-09T09:27:16.120 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-09T09:27:16.164 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-12-09T09:27:16.167 INFO:teuthology.task.internal:Saving configuration 2019-12-09T09:27:16.188 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-12-09T09:27:16.193 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-12-09T09:27:16.208 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-09 09:21:59.417302', u'locked_by': u'scheduled_ofriedma@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi121.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDGE73mXNUVhjhgz+04jYMUj18sIbydLiN837JtrMYF7AW4yez8aL8A0Js90rhmxdETUhwQ+sbwkiNyF3BvqRXs=', u'description': u'/home/teuthworker/archive/ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4584243'} 2019-12-09T09:27:16.223 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-09 09:21:59.417321', u'locked_by': u'scheduled_ofriedma@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi132.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJB46gmt2wd361lqOWa9/xRJzoVGDAnv3db/6WgIU5s7T7aazsg0kvBvnjZqqapkuiwt3PV/vSR2R/P4cqNmEMY=', u'description': u'/home/teuthworker/archive/ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4584243'} 2019-12-09T09:27:16.223 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-12-09T09:27:16.229 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-12-09T09:27:16.229 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-12-09T09:27:16.230 INFO:teuthology.run_tasks:Running task console_log... 2019-12-09T09:27:16.325 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-09T09:27:16.325 INFO:teuthology.run_tasks:Running task internal.connect... 2019-12-09T09:27:16.335 INFO:teuthology.task.internal:Opening connections... 2019-12-09T09:27:16.336 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2019-12-09T09:27:16.337 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi121.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:27:16.438 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2019-12-09T09:27:16.438 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi132.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:27:16.536 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-12-09T09:27:16.542 INFO:teuthology.orchestra.run.smithi121:> uname -m 2019-12-09T09:27:16.734 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2019-12-09T09:27:16.734 INFO:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2019-12-09T09:27:16.784 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Linux" 2019-12-09T09:27:16.785 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="7 (Core)" 2019-12-09T09:27:16.785 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2019-12-09T09:27:16.785 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2019-12-09T09:27:16.785 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="7" 2019-12-09T09:27:16.785 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-09T09:27:16.785 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2019-12-09T09:27:16.786 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-09T09:27:16.786 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.centos.org/" 2019-12-09T09:27:16.786 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-09T09:27:16.786 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:27:16.786 INFO:teuthology.orchestra.run.smithi121.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-09T09:27:16.786 INFO:teuthology.orchestra.run.smithi121.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-09T09:27:16.787 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-09T09:27:16.787 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-09T09:27:16.787 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:27:16.787 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2019-12-09T09:27:16.822 INFO:teuthology.orchestra.run.smithi132:> uname -m 2019-12-09T09:27:16.938 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2019-12-09T09:27:16.939 INFO:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2019-12-09T09:27:17.010 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Linux" 2019-12-09T09:27:17.010 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="7 (Core)" 2019-12-09T09:27:17.010 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2019-12-09T09:27:17.010 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2019-12-09T09:27:17.010 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="7" 2019-12-09T09:27:17.010 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-09T09:27:17.011 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2019-12-09T09:27:17.011 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-09T09:27:17.011 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.centos.org/" 2019-12-09T09:27:17.011 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-09T09:27:17.011 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:27:17.011 INFO:teuthology.orchestra.run.smithi132.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-09T09:27:17.012 INFO:teuthology.orchestra.run.smithi132.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-09T09:27:17.012 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-09T09:27:17.012 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-09T09:27:17.012 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:27:17.012 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2019-12-09T09:27:17.041 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-12-09T09:27:17.154 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-12-09T09:27:17.198 INFO:teuthology.task.internal:Checking for old test directory... 2019-12-09T09:27:17.199 INFO:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2019-12-09T09:27:17.202 INFO:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2019-12-09T09:27:17.285 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-12-09T09:27:17.300 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-12-09T09:27:17.301 INFO:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2019-12-09T09:27:17.305 INFO:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2019-12-09T09:27:17.411 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-12-09T09:27:17.476 INFO:teuthology.run_tasks:Running task kernel... 2019-12-09T09:27:17.508 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2019-12-09T09:27:17.508 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-12-09T09:27:17.508 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi121.front.sepia.ceph.com 2019-12-09T09:27:17.509 INFO:teuthology.orchestra.run.smithi121:> sudo package-cleanup -y --oldkernels 2019-12-09T09:27:18.416 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:27:19.474 INFO:teuthology.orchestra.run.smithi121.stdout:http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T09:27:19.475 INFO:teuthology.orchestra.run.smithi121.stdout:Trying other mirror. 2019-12-09T09:27:19.475 INFO:teuthology.orchestra.run.smithi121.stdout:To address this issue please refer to the below wiki article 2019-12-09T09:27:19.475 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:27:19.475 INFO:teuthology.orchestra.run.smithi121.stdout:https://wiki.centos.org/yum-errors 2019-12-09T09:27:19.475 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:27:19.475 INFO:teuthology.orchestra.run.smithi121.stdout:If above article doesn't help to resolve this issue please use https://bugs.centos.org/. 2019-12-09T09:27:19.475 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:27:19.621 INFO:teuthology.orchestra.run.smithi121.stdout:http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T09:27:19.621 INFO:teuthology.orchestra.run.smithi121.stdout:Trying other mirror. 2019-12-09T09:27:19.714 INFO:teuthology.orchestra.run.smithi121.stdout:http://mirror.oss.ou.edu/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T09:27:19.715 INFO:teuthology.orchestra.run.smithi121.stdout:Trying other mirror. 2019-12-09T09:27:19.978 INFO:teuthology.orchestra.run.smithi121.stdout:http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T09:27:19.978 INFO:teuthology.orchestra.run.smithi121.stdout:Trying other mirror. 2019-12-09T09:27:20.130 INFO:teuthology.orchestra.run.smithi121.stdout:http://mirror.pnl.gov/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T09:27:20.131 INFO:teuthology.orchestra.run.smithi121.stdout:Trying other mirror. 2019-12-09T09:27:20.958 INFO:teuthology.orchestra.run.smithi121.stdout:No old kernels to remove 2019-12-09T09:27:20.972 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi132.front.sepia.ceph.com 2019-12-09T09:27:20.972 INFO:teuthology.orchestra.run.smithi132:> sudo package-cleanup -y --oldkernels 2019-12-09T09:27:21.915 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:27:22.758 INFO:teuthology.orchestra.run.smithi132.stdout:http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T09:27:22.758 INFO:teuthology.orchestra.run.smithi132.stdout:Trying other mirror. 2019-12-09T09:27:22.759 INFO:teuthology.orchestra.run.smithi132.stdout:To address this issue please refer to the below wiki article 2019-12-09T09:27:22.759 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:27:22.759 INFO:teuthology.orchestra.run.smithi132.stdout:https://wiki.centos.org/yum-errors 2019-12-09T09:27:22.759 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:27:22.759 INFO:teuthology.orchestra.run.smithi132.stdout:If above article doesn't help to resolve this issue please use https://bugs.centos.org/. 2019-12-09T09:27:22.759 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:27:22.906 INFO:teuthology.orchestra.run.smithi132.stdout:http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T09:27:22.906 INFO:teuthology.orchestra.run.smithi132.stdout:Trying other mirror. 2019-12-09T09:27:22.998 INFO:teuthology.orchestra.run.smithi132.stdout:http://mirror.oss.ou.edu/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T09:27:22.998 INFO:teuthology.orchestra.run.smithi132.stdout:Trying other mirror. 2019-12-09T09:27:23.141 INFO:teuthology.orchestra.run.smithi132.stdout:http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T09:27:23.141 INFO:teuthology.orchestra.run.smithi132.stdout:Trying other mirror. 2019-12-09T09:27:23.294 INFO:teuthology.orchestra.run.smithi132.stdout:http://mirror.pnl.gov/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-09T09:27:23.294 INFO:teuthology.orchestra.run.smithi132.stdout:Trying other mirror. 2019-12-09T09:27:23.841 INFO:teuthology.orchestra.run.smithi132.stdout:No old kernels to remove 2019-12-09T09:27:23.857 INFO:teuthology.orchestra.run.smithi121:> uname -r 2019-12-09T09:27:23.951 INFO:teuthology.orchestra.run.smithi121.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-09T09:27:23.951 INFO:teuthology.task.kernel:Running kernel on smithi121: 3.10.0-1062.4.1.el7.x86_64 2019-12-09T09:27:23.951 INFO:teuthology.orchestra.run.smithi121:> sudo yum install -y kernel 2019-12-09T09:27:24.160 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:27:24.195 INFO:teuthology.orchestra.run.smithi121.stdout:Determining fastest mirrors 2019-12-09T09:27:24.495 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:27:24.496 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T09:27:24.497 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:27:24.497 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:27:25.989 INFO:teuthology.orchestra.run.smithi121.stdout:Resolving Dependencies 2019-12-09T09:27:25.990 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:27:25.990 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-09T09:27:27.270 INFO:teuthology.orchestra.run.smithi121.stdout:--> Finished Dependency Resolution 2019-12-09T09:27:28.120 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:27:28.120 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies Resolved 2019-12-09T09:27:28.121 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:27:28.121 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:27:28.121 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2019-12-09T09:27:28.121 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:27:28.122 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2019-12-09T09:27:28.122 INFO:teuthology.orchestra.run.smithi121.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-09T09:27:28.122 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:27:28.122 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2019-12-09T09:27:28.122 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:27:28.122 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2019-12-09T09:27:28.122 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:27:28.122 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 50 M 2019-12-09T09:27:28.123 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 64 M 2019-12-09T09:27:28.123 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading packages: 2019-12-09T09:27:28.132 INFO:teuthology.orchestra.run.smithi121.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-09T09:27:29.101 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2019-12-09T09:27:29.291 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2019-12-09T09:27:30.207 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded 2019-12-09T09:27:30.208 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2019-12-09T09:28:05.019 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-09T09:28:05.566 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-09T09:28:05.566 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:28:05.567 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2019-12-09T09:28:05.567 INFO:teuthology.orchestra.run.smithi121.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-09T09:28:05.567 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:28:05.567 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2019-12-09T09:28:05.621 INFO:teuthology.orchestra.run.smithi121:> rpm -q kernel --last | head -n 1 2019-12-09T09:28:06.024 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Mon 09 Dec 2019 09:27:33 AM UTC 2019-12-09T09:28:06.028 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-09T09:28:06.029 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-09T09:28:06.029 INFO:teuthology.orchestra.run.smithi132:> uname -r 2019-12-09T09:28:06.129 INFO:teuthology.orchestra.run.smithi132.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-09T09:28:06.129 INFO:teuthology.task.kernel:Running kernel on smithi132: 3.10.0-1062.4.1.el7.x86_64 2019-12-09T09:28:06.129 INFO:teuthology.orchestra.run.smithi132:> sudo yum install -y kernel 2019-12-09T09:28:06.392 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:28:06.433 INFO:teuthology.orchestra.run.smithi132.stdout:Determining fastest mirrors 2019-12-09T09:28:06.565 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.fileplanet.com 2019-12-09T09:28:06.566 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: ftp.linux.ncsu.edu 2019-12-09T09:28:06.571 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:28:06.571 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:28:08.192 INFO:teuthology.orchestra.run.smithi132.stdout:Resolving Dependencies 2019-12-09T09:28:08.628 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:28:08.628 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-09T09:28:09.530 INFO:teuthology.orchestra.run.smithi132.stdout:--> Finished Dependency Resolution 2019-12-09T09:28:10.374 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:28:10.375 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies Resolved 2019-12-09T09:28:10.375 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:28:10.376 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:28:10.376 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2019-12-09T09:28:10.376 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:28:10.376 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2019-12-09T09:28:10.376 INFO:teuthology.orchestra.run.smithi132.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-09T09:28:10.376 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:28:10.377 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2019-12-09T09:28:10.377 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:28:10.377 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2019-12-09T09:28:10.377 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:28:10.378 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 50 M 2019-12-09T09:28:10.378 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 64 M 2019-12-09T09:28:10.378 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading packages: 2019-12-09T09:28:10.380 INFO:teuthology.orchestra.run.smithi132.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-09T09:28:11.362 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2019-12-09T09:28:11.573 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2019-12-09T09:28:12.442 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded 2019-12-09T09:28:12.443 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2019-12-09T09:28:47.342 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-09T09:28:47.851 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-09T09:28:47.851 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:28:47.851 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2019-12-09T09:28:47.851 INFO:teuthology.orchestra.run.smithi132.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-09T09:28:47.851 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:28:47.851 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2019-12-09T09:28:47.903 INFO:teuthology.orchestra.run.smithi132:> rpm -q kernel --last | head -n 1 2019-12-09T09:28:48.323 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Mon 09 Dec 2019 09:28:15 AM UTC 2019-12-09T09:28:48.327 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-09T09:28:48.327 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-09T09:28:48.327 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2019-12-09T09:28:48.328 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-09T09:28:48.328 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-09T09:28:48.328 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2019-12-09T09:28:48.328 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi121.front.sepia.ceph.com, path=None, version=distro) 2019-12-09T09:28:48.328 INFO:teuthology.orchestra.run.smithi121:> rpm -q kernel --last | head -n 1 2019-12-09T09:28:48.680 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Mon 09 Dec 2019 09:27:33 AM UTC 2019-12-09T09:28:48.682 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-09T09:28:48.682 INFO:teuthology.orchestra.run.smithi121:> sudo rpm -qi grub2 2019-12-09T09:28:48.828 INFO:teuthology.orchestra.run.smithi121.stdout:Name : grub2 2019-12-09T09:28:48.828 INFO:teuthology.orchestra.run.smithi121.stdout:Epoch : 1 2019-12-09T09:28:48.828 INFO:teuthology.orchestra.run.smithi121.stdout:Version : 2.02 2019-12-09T09:28:48.829 INFO:teuthology.orchestra.run.smithi121.stdout:Release : 0.76.el7.centos 2019-12-09T09:28:48.829 INFO:teuthology.orchestra.run.smithi121.stdout:Architecture: x86_64 2019-12-09T09:28:48.829 INFO:teuthology.orchestra.run.smithi121.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-12-09T09:28:48.829 INFO:teuthology.orchestra.run.smithi121.stdout:Group : System Environment/Base 2019-12-09T09:28:48.829 INFO:teuthology.orchestra.run.smithi121.stdout:Size : 0 2019-12-09T09:28:48.829 INFO:teuthology.orchestra.run.smithi121.stdout:License : GPLv3+ 2019-12-09T09:28:48.829 INFO:teuthology.orchestra.run.smithi121.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-09T09:28:48.830 INFO:teuthology.orchestra.run.smithi121.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-09T09:28:48.830 INFO:teuthology.orchestra.run.smithi121.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-09T09:28:48.830 INFO:teuthology.orchestra.run.smithi121.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-09T09:28:48.830 INFO:teuthology.orchestra.run.smithi121.stdout:Relocations : (not relocatable) 2019-12-09T09:28:48.830 INFO:teuthology.orchestra.run.smithi121.stdout:Packager : CentOS BuildSystem 2019-12-09T09:28:48.830 INFO:teuthology.orchestra.run.smithi121.stdout:Vendor : CentOS 2019-12-09T09:28:48.830 INFO:teuthology.orchestra.run.smithi121.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-09T09:28:48.831 INFO:teuthology.orchestra.run.smithi121.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-12-09T09:28:48.831 INFO:teuthology.orchestra.run.smithi121.stdout:Description : 2019-12-09T09:28:48.831 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:28:48.831 INFO:teuthology.orchestra.run.smithi121.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-09T09:28:48.831 INFO:teuthology.orchestra.run.smithi121.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-09T09:28:48.831 INFO:teuthology.orchestra.run.smithi121.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-09T09:28:48.831 INFO:teuthology.orchestra.run.smithi121.stdout:hardware devices. 2019-12-09T09:28:48.832 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-09T09:28:48.833 INFO:teuthology.task.kernel:Updating grub on smithi121 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-09T09:28:48.833 INFO:teuthology.orchestra.run.smithi121:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-09T09:28:49.420 INFO:teuthology.orchestra.run.smithi121.stderr:Generating grub configuration file ... 2019-12-09T09:28:49.557 INFO:teuthology.orchestra.run.smithi121.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-09T09:28:49.572 INFO:teuthology.orchestra.run.smithi121.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-09T09:28:49.861 INFO:teuthology.orchestra.run.smithi121.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-09T09:28:49.903 INFO:teuthology.orchestra.run.smithi121.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-09T09:28:49.950 INFO:teuthology.orchestra.run.smithi121.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-09T09:28:49.969 INFO:teuthology.orchestra.run.smithi121.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-09T09:28:50.003 INFO:teuthology.orchestra.run.smithi121.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-09T09:28:50.012 INFO:teuthology.orchestra.run.smithi121.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-09T09:28:51.224 INFO:teuthology.orchestra.run.smithi121.stderr:done 2019-12-09T09:28:51.225 INFO:teuthology.orchestra.run.smithi121:> mktemp 2019-12-09T09:28:51.279 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.nThxi123Sq 2019-12-09T09:28:51.280 INFO:teuthology.orchestra.run.smithi121:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nThxi123Sq 2019-12-09T09:28:51.344 INFO:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.nThxi123Sq 2019-12-09T09:28:51.475 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.nThxi123Sq is 6KB 2019-12-09T09:28:51.527 INFO:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.nThxi123Sq 2019-12-09T09:28:51.574 INFO:teuthology.orchestra.run.smithi121:> sudo grub2-set-default 0 2019-12-09T09:28:51.784 INFO:teuthology.orchestra.run.smithi121:> sudo shutdown -r now 2019-12-09T09:28:51.789 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2019-12-09T09:28:51.789 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi132.front.sepia.ceph.com, path=None, version=distro) 2019-12-09T09:28:51.789 INFO:teuthology.orchestra.run.smithi132:> rpm -q kernel --last | head -n 1 2019-12-09T09:28:52.157 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Mon 09 Dec 2019 09:28:15 AM UTC 2019-12-09T09:28:52.159 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-09T09:28:52.159 INFO:teuthology.orchestra.run.smithi132:> sudo rpm -qi grub2 2019-12-09T09:28:52.278 INFO:teuthology.orchestra.run.smithi132.stdout:Name : grub2 2019-12-09T09:28:52.278 INFO:teuthology.orchestra.run.smithi132.stdout:Epoch : 1 2019-12-09T09:28:52.278 INFO:teuthology.orchestra.run.smithi132.stdout:Version : 2.02 2019-12-09T09:28:52.278 INFO:teuthology.orchestra.run.smithi132.stdout:Release : 0.76.el7.centos 2019-12-09T09:28:52.278 INFO:teuthology.orchestra.run.smithi132.stdout:Architecture: x86_64 2019-12-09T09:28:52.279 INFO:teuthology.orchestra.run.smithi132.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-12-09T09:28:52.279 INFO:teuthology.orchestra.run.smithi132.stdout:Group : System Environment/Base 2019-12-09T09:28:52.279 INFO:teuthology.orchestra.run.smithi132.stdout:Size : 0 2019-12-09T09:28:52.279 INFO:teuthology.orchestra.run.smithi132.stdout:License : GPLv3+ 2019-12-09T09:28:52.279 INFO:teuthology.orchestra.run.smithi132.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-09T09:28:52.279 INFO:teuthology.orchestra.run.smithi132.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-09T09:28:52.279 INFO:teuthology.orchestra.run.smithi132.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-09T09:28:52.280 INFO:teuthology.orchestra.run.smithi132.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-09T09:28:52.280 INFO:teuthology.orchestra.run.smithi132.stdout:Relocations : (not relocatable) 2019-12-09T09:28:52.280 INFO:teuthology.orchestra.run.smithi132.stdout:Packager : CentOS BuildSystem 2019-12-09T09:28:52.280 INFO:teuthology.orchestra.run.smithi132.stdout:Vendor : CentOS 2019-12-09T09:28:52.280 INFO:teuthology.orchestra.run.smithi132.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-09T09:28:52.280 INFO:teuthology.orchestra.run.smithi132.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-12-09T09:28:52.280 INFO:teuthology.orchestra.run.smithi132.stdout:Description : 2019-12-09T09:28:52.281 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:28:52.281 INFO:teuthology.orchestra.run.smithi132.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-09T09:28:52.281 INFO:teuthology.orchestra.run.smithi132.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-09T09:28:52.281 INFO:teuthology.orchestra.run.smithi132.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-09T09:28:52.281 INFO:teuthology.orchestra.run.smithi132.stdout:hardware devices. 2019-12-09T09:28:52.282 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-09T09:28:52.282 INFO:teuthology.task.kernel:Updating grub on smithi132 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-09T09:28:52.282 INFO:teuthology.orchestra.run.smithi132:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-09T09:28:52.725 INFO:teuthology.orchestra.run.smithi132.stderr:Generating grub configuration file ... 2019-12-09T09:28:52.859 INFO:teuthology.orchestra.run.smithi132.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-09T09:28:52.875 INFO:teuthology.orchestra.run.smithi132.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-09T09:28:53.109 INFO:teuthology.orchestra.run.smithi132.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-09T09:28:53.128 INFO:teuthology.orchestra.run.smithi132.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-09T09:28:53.157 INFO:teuthology.orchestra.run.smithi132.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-09T09:28:53.176 INFO:teuthology.orchestra.run.smithi132.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-09T09:28:53.201 INFO:teuthology.orchestra.run.smithi132.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-09T09:28:53.210 INFO:teuthology.orchestra.run.smithi132.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-09T09:28:54.305 INFO:teuthology.orchestra.run.smithi132.stderr:done 2019-12-09T09:28:54.306 INFO:teuthology.orchestra.run.smithi132:> mktemp 2019-12-09T09:28:54.361 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.mgFFZeWY9B 2019-12-09T09:28:54.361 INFO:teuthology.orchestra.run.smithi132:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mgFFZeWY9B 2019-12-09T09:28:54.426 INFO:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.mgFFZeWY9B 2019-12-09T09:28:54.556 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.mgFFZeWY9B is 6KB 2019-12-09T09:28:54.608 INFO:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.mgFFZeWY9B 2019-12-09T09:28:54.652 INFO:teuthology.orchestra.run.smithi132:> sudo grub2-set-default 0 2019-12-09T09:28:54.897 INFO:teuthology.orchestra.run.smithi132:> sudo shutdown -r now 2019-12-09T09:28:54.901 INFO:teuthology.misc:Re-opening connections... 2019-12-09T09:28:54.902 INFO:teuthology.misc:trying to connect to ubuntu@smithi121.front.sepia.ceph.com 2019-12-09T09:28:54.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T09:28:54.903 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi121.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:29:54.905 DEBUG:teuthology.orchestra.remote:timed out 2019-12-09T09:29:54.905 INFO:teuthology.misc:trying to connect to ubuntu@smithi132.front.sepia.ceph.com 2019-12-09T09:29:54.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T09:29:54.906 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi132.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:30:54.908 DEBUG:teuthology.orchestra.remote:timed out 2019-12-09T09:30:54.908 DEBUG:teuthology.misc:waited 120.006798029 2019-12-09T09:30:55.909 INFO:teuthology.misc:trying to connect to ubuntu@smithi121.front.sepia.ceph.com 2019-12-09T09:30:55.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T09:30:55.910 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi121.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:30:56.002 INFO:teuthology.orchestra.run.smithi121:> true 2019-12-09T09:30:56.376 DEBUG:teuthology.misc:waited 121.474663973 2019-12-09T09:30:57.377 INFO:teuthology.misc:trying to connect to ubuntu@smithi132.front.sepia.ceph.com 2019-12-09T09:30:57.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T09:30:57.377 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi132.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:30:57.480 INFO:teuthology.orchestra.run.smithi132:> true 2019-12-09T09:30:57.922 DEBUG:teuthology.misc:waited 123.020277023 2019-12-09T09:30:58.923 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2019-12-09T09:30:58.923 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3.10.0-1062.9.1.el7.x86_64"... 2019-12-09T09:30:58.924 INFO:teuthology.orchestra.run.smithi121:> uname -r 2019-12-09T09:30:58.987 INFO:teuthology.orchestra.run.smithi121.stdout:3.10.0-1062.9.1.el7.x86_64 2019-12-09T09:30:58.988 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.9.1.el7.x86_64 2019-12-09T09:30:58.988 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-12-09T09:30:58.988 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-12-09T09:30:58.988 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3.10.0-1062.9.1.el7.x86_64"... 2019-12-09T09:30:58.988 INFO:teuthology.orchestra.run.smithi132:> uname -r 2019-12-09T09:30:59.349 INFO:teuthology.orchestra.run.smithi132.stdout:3.10.0-1062.9.1.el7.x86_64 2019-12-09T09:30:59.350 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.9.1.el7.x86_64 2019-12-09T09:30:59.350 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-12-09T09:31:00.351 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2019-12-09T09:31:00.351 INFO:teuthology.orchestra.run.smithi121:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-09T09:31:00.490 INFO:teuthology.orchestra.run.smithi121.stdout:ttyS1 2019-12-09T09:31:00.504 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2019-12-09T09:31:00.505 INFO:teuthology.orchestra.run.smithi132:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-09T09:31:00.670 INFO:teuthology.orchestra.run.smithi132.stdout:ttyS1 2019-12-09T09:31:00.683 INFO:teuthology.run_tasks:Running task internal.base... 2019-12-09T09:31:00.696 INFO:teuthology.task.internal:Creating test directory... 2019-12-09T09:31:00.696 INFO:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-09T09:31:00.700 INFO:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-09T09:31:00.790 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-12-09T09:31:00.812 INFO:teuthology.run_tasks:Running task internal.archive... 2019-12-09T09:31:00.843 INFO:teuthology.task.internal:Creating archive directory... 2019-12-09T09:31:00.844 INFO:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-09T09:31:00.848 INFO:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-09T09:31:00.956 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-12-09T09:31:00.983 INFO:teuthology.task.internal:Enabling coredump saving... 2019-12-09T09:31:00.984 INFO:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-09T09:31:00.991 INFO:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-09T09:31:01.101 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-09T09:31:01.113 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-09T09:31:01.115 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-12-09T09:31:01.134 INFO:teuthology.task.internal:Configuring sudo... 2019-12-09T09:31:01.135 INFO:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-09T09:31:01.139 INFO:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-09T09:31:01.253 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-12-09T09:31:01.275 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-12-09T09:31:01.275 INFO:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-09T09:31:01.279 INFO:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-09T09:31:01.368 INFO:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-09T09:31:01.456 INFO:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-09T09:31:01.586 INFO:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-09T09:31:01.688 INFO:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-09T09:31:01.800 INFO:teuthology.orchestra.run.smithi121:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-09T09:31:01.889 INFO:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-09T09:31:02.004 INFO:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-09T09:31:02.117 INFO:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-09T09:31:02.205 INFO:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-09T09:31:02.299 INFO:teuthology.orchestra.run.smithi132:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-09T09:31:02.382 INFO:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2019-12-09T09:31:02.386 INFO:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2019-12-09T09:31:02.519 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-12-09T09:31:02.530 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-12-09T09:31:02.588 INFO:teuthology.run_tasks:Running task internal.timer... 2019-12-09T09:31:02.608 INFO:teuthology.task.internal:Starting timer... 2019-12-09T09:31:02.608 INFO:teuthology.run_tasks:Running task pcp... 2019-12-09T09:31:02.721 INFO:teuthology.run_tasks:Running task selinux... 2019-12-09T09:31:02.737 INFO:teuthology.orchestra.run.smithi121:> sudo service auditd rotate 2019-12-09T09:31:02.901 INFO:teuthology.orchestra.run.smithi121.stdout:Rotating logs: [ OK ] 2019-12-09T09:31:02.903 INFO:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2019-12-09T09:31:03.078 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: [ OK ] 2019-12-09T09:31:03.080 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-12-09T09:31:03.080 INFO:teuthology.orchestra.run.smithi121:> /usr/sbin/getenforce 2019-12-09T09:31:03.177 INFO:teuthology.orchestra.run.smithi121.stdout:Permissive 2019-12-09T09:31:03.177 INFO:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2019-12-09T09:31:03.275 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2019-12-09T09:31:03.275 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi132.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi121.front.sepia.ceph.com': 'permissive'} 2019-12-09T09:31:03.276 INFO:teuthology.orchestra.run.smithi121:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-12-09T09:31:03.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-09T09:31:03.388 INFO:teuthology.orchestra.run.smithi132:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-12-09T09:31:03.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-09T09:31:03.507 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-12-09T09:31:03.508 INFO:teuthology.orchestra.run.smithi121:> sudo /usr/sbin/setenforce permissive 2019-12-09T09:31:03.630 INFO:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2019-12-09T09:31:03.758 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-12-09T09:31:03.786 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2019-12-09T09:31:03.814 INFO:teuthology.repo_utils:Fetching master from origin 2019-12-09T09:31:03.886 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2019-12-09T09:31:03.970 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-12-09T09:31:03.976 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi121.front.sepia.ceph.com,smithi132.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-12-09T09:31:04.566 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-12-09T09:31:06.467 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2019-12-09T09:31:09.351 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-12-09T09:31:09.391 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:09 +0000 (0:00:00.131) 0:00:00.131 ******* 2019-12-09T09:31:09.403 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:09 +0000 (0:00:00.011) 0:00:00.142 ******* 2019-12-09T09:31:12.742 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi132.front.sepia.ceph.com] 2019-12-09T09:31:12.833 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:12 +0000 (0:00:03.430) 0:00:03.573 ******* 2019-12-09T09:31:13.308 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-12-09T09:31:13.310 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-09T09:31:13.345 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:13 +0000 (0:00:00.511) 0:00:04.084 ******* 2019-12-09T09:31:13.751 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2019-12-09T09:31:13.753 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] 2019-12-09T09:31:13.869 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:13 +0000 (0:00:00.524) 0:00:04.609 ******* 2019-12-09T09:31:13.981 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-12-09T09:31:13.982 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-09T09:31:14.020 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:14 +0000 (0:00:00.151) 0:00:04.760 ******* 2019-12-09T09:31:14.067 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-12-09T09:31:14.069 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:31:14.111 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:14 +0000 (0:00:00.090) 0:00:04.851 ******* 2019-12-09T09:31:14.224 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-12-09T09:31:14.226 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-09T09:31:14.265 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:14 +0000 (0:00:00.154) 0:00:05.005 ******* 2019-12-09T09:31:14.618 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-12-09T09:31:14.619 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T09:31:14.668 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:14 +0000 (0:00:00.402) 0:00:05.407 ******* 2019-12-09T09:31:14.676 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-12-09T09:31:14.677 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-09T09:31:14.717 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:14 +0000 (0:00:00.048) 0:00:05.456 ******* 2019-12-09T09:31:14.743 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-12-09T09:31:14.745 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:31:14.792 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:14 +0000 (0:00:00.075) 0:00:05.531 ******* 2019-12-09T09:31:15.100 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi121.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T09:31:15.136 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:15 +0000 (0:00:00.343) 0:00:05.875 ******* 2019-12-09T09:31:16.277 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2019-12-09T09:31:16.278 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575883875.15-23971638857387/source", "state": "file", "uid": 0} 2019-12-09T09:31:16.315 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:16 +0000 (0:00:01.179) 0:00:07.054 ******* 2019-12-09T09:31:16.321 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575883874.68-205591198843809/source", "state": "file", "uid": 0} 2019-12-09T09:31:16.359 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:16 +0000 (0:00:00.044) 0:00:07.099 ******* 2019-12-09T09:31:16.880 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2019-12-09T09:31:16.881 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi132.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "change 2019-12-09T09:31:16.883 INFO:teuthology.task.ansible.out:d": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T09:31:17.212 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T09:31:17.234 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T09:31:17.523 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T09:31:17.555 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T09:31:17.871 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T09:31:17.884 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T09:31:18.199 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T09:31:18.241 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T09:31:18.540 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T09:31:18.572 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T09:31:18.875 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T09:31:18.917 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-09T09:31:19.041 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** 2019-12-09T09:31:19.043 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2019-12-09T09:31:19.047 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2019-12-09T09:31:19.237 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:19 +0000 (0:00:02.877) 0:00:09.977 ******* 2019-12-09T09:31:19.271 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:19 +0000 (0:00:00.033) 0:00:10.010 ******* 2019-12-09T09:31:20.126 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2019-12-09T09:31:20.128 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] 2019-12-09T09:31:20.214 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2019-12-09T09:31:20.216 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:20 +0000 (0:00:00.943) 0:00:10.954 ******* 2019-12-09T09:31:20.237 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] 2019-12-09T09:31:20.323 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:20 +0000 (0:00:00.108) 0:00:11.063 ******* 2019-12-09T09:31:20.753 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2019-12-09T09:31:20.754 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.266252", "end": "2019-12-09 09:31:20.732855", "rc": 0, "start": "2019-12-09 09:31:20.466603", "stderr": "", "stderr_lines": [], "stdout": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "stdout_lines": ["2c3c6d863a854d6a1e155fc475e8273d88b91491"]} 2019-12-09T09:31:20.756 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.246551", "end": "2019-12-09 09:31:20.736353", "rc": 0, "start": "2019-12-09 09:31:20.489802", "stderr": "", "stderr_lines": [], "stdout": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "stdout_lines": ["2c3c6d863a854d6a1e155fc475e8273d88b91491"]} 2019-12-09T09:31:20.793 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:20 +0000 (0:00:00.469) 0:00:11.533 ******* 2019-12-09T09:31:20.831 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:20 +0000 (0:00:00.037) 0:00:11.571 ******* 2019-12-09T09:31:21.126 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-12-09T09:31:21.127 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008927", "end": "2019-12-09 09:31:21.095522", "failed_when_result": false, "rc": 0, "start": "2019-12-09 09:31:21.086595", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-12-09T09:31:21.165 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:21 +0000 (0:00:00.334) 0:00:11.905 ******* 2019-12-09T09:31:21.172 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.009020", "end": "2019-12-09 09:31:21.133968", "failed_when_result": false, "rc": 0, "start": "2019-12-09 09:31:21.124948", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-12-09T09:31:21.217 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:21 +0000 (0:00:00.046) 0:00:11.951 ******* 2019-12-09T09:31:21.218 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:31:21.255 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:21 +0000 (0:00:00.044) 0:00:11.995 ******* 2019-12-09T09:31:21.262 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:31:21.301 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:21 +0000 (0:00:00.045) 0:00:12.041 ******* 2019-12-09T09:31:21.313 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-12-09T09:31:21.315 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:31:21.354 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:21 +0000 (0:00:00.052) 0:00:12.094 ******* 2019-12-09T09:31:21.360 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:31:21.401 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:21 +0000 (0:00:00.046) 0:00:12.140 ******* 2019-12-09T09:31:21.406 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-12-09T09:31:21.407 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:31:21.445 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:21 +0000 (0:00:00.044) 0:00:12.185 ******* 2019-12-09T09:31:21.452 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:31:21.492 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:21 +0000 (0:00:00.046) 0:00:12.231 ******* 2019-12-09T09:31:21.497 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-12-09T09:31:21.497 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:31:21.536 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:21 +0000 (0:00:00.044) 0:00:12.276 ******* 2019-12-09T09:31:21.544 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:31:21.583 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:21 +0000 (0:00:00.046) 0:00:12.323 ******* 2019-12-09T09:31:21.589 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-12-09T09:31:21.591 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:31:21.631 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:21 +0000 (0:00:00.048) 0:00:12.371 ******* 2019-12-09T09:31:21.638 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:31:21.678 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:21 +0000 (0:00:00.046) 0:00:12.418 ******* 2019-12-09T09:31:21.957 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2019-12-09T09:31:21.959 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T09:31:22.000 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:21 +0000 (0:00:00.322) 0:00:12.740 ******* 2019-12-09T09:31:22.008 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T09:31:22.063 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:22 +0000 (0:00:00.063) 0:00:12.803 ******* 2019-12-09T09:31:22.369 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-09T09:31:22.371 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-09T09:31:22.445 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-09T09:31:22.684 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-09T09:31:22.789 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-09T09:31:22.999 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-09T09:31:23.125 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-09T09:31:23.334 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-09T09:31:23.461 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-09T09:31:23.669 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-09T09:31:23.805 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-09T09:31:23.966 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-09T09:31:24.144 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-09T09:31:24.271 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-09T09:31:24.495 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-09T09:31:24.621 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-09T09:31:24.837 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-09T09:31:24.954 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-09T09:31:25.188 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-09T09:31:25.189 INFO:teuthology.task.ansible.out: 2019-12-09T09:31:25.284 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB6 2019-12-09T09:31:25.285 INFO:teuthology.task.ansible.out:0tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-09T09:31:25.487 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB6 2019-12-09T09:31:25.489 INFO:teuthology.task.ansible.out:0tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-09T09:31:25.627 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-09T09:31:25.795 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-09T09:31:25.954 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-09T09:31:26.114 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-09T09:31:26.274 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-09T09:31:26.450 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-09T09:31:26.556 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-09T09:31:26.795 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-09T09:31:26.850 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-09T09:31:27.124 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-09T09:31:27.147 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-09T09:31:27.453 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-09T09:31:27.466 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-09T09:31:27.750 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-09T09:31:27.794 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-09T09:31:27.797 INFO:teuthology.task.ansible.out: 2019-12-09T09:31:28.095 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-09T09:31:28.097 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-09T09:31:28.423 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-09T09:31:28.424 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-09T09:31:28.716 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-09T09:31:28.739 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-09T09:31:29.023 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-09T09:31:29.035 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-09T09:31:29.348 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-09T09:31:29.350 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-09T09:31:29.659 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-09T09:31:29.661 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-09T09:31:29.938 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-09T09:31:29.971 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-09T09:31:30.236 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-09T09:31:30.270 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-09T09:31:30.567 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-09T09:31:30.599 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-09T09:31:30.890 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-09T09:31:30.948 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-09T09:31:31.236 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-09T09:31:31.289 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-09T09:31:31.555 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-09T09:31:31.648 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-09T09:31:31.896 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-09T09:31:31.985 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-09T09:31:32.227 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-09T09:31:32.304 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-09T09:31:32.582 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-09T09:31:32.636 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-09T09:31:32.912 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-09T09:31:32.978 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-09T09:31:33.240 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-09T09:31:33.318 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-09T09:31:33.591 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-09T09:31:33.645 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-09T09:31:33.920 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-09T09:31:33.973 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-09T09:31:34.235 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-09T09:31:34.288 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-09T09:31:34.569 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-09T09:31:34.613 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-09T09:31:34.866 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-09T09:31:34.972 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-09T09:31:35.177 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-09T09:31:35.334 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-09T09:31:35.509 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-09T09:31:35.676 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-09T09:31:35.857 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-09T09:31:36.016 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-09T09:31:36.194 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-09T09:31:36.357 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-09T09:31:36.557 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-09T09:31:36.683 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-09T09:31:36.896 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-09T09:31:36.981 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-09T09:31:37.174 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-09T09:31:37.330 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-09T09:31:37.475 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-09T09:31:37.691 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-09T09:31:37.828 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-09T09:31:38.058 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-09T09:31:38.195 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-09T09:31:38.417 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-09T09:31:38.534 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-09T09:31:38.733 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-09T09:31:38.891 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-09T09:31:39.052 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-09T09:31:39.221 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-09T09:31:39.392 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-09T09:31:39.539 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-09T09:31:39.713 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-09T09:31:39.884 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-09T09:31:40.045 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-09T09:31:40.213 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-09T09:31:40.391 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-09T09:31:40.540 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-09T09:31:40.718 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-09T09:31:40.899 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-09T09:31:41.036 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-09T09:31:41.228 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-09T09:31:41.343 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-09T09:31:41.542 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-09T09:31:41.671 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-09T09:31:41.848 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-09T09:31:41.985 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-09T09:31:42.184 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-09T09:31:42.343 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-09T09:31:42.527 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-09T09:31:42.699 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-09T09:31:42.891 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-09T09:31:43.040 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-09T09:31:43.237 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-09T09:31:43.385 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-09T09:31:43.596 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-09T09:31:43.703 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-09T09:31:43.957 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-09T09:31:44.063 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-09T09:31:44.294 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-09T09:31:44.444 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-09T09:31:44.644 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-09T09:31:44.770 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-09T09:31:44.992 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-09T09:31:45.111 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-09T09:31:45.333 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-09T09:31:45.461 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-09T09:31:45.464 INFO:teuthology.task.ansible.out: 2019-12-09T09:31:45.678 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-09T09:31:45.804 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-09T09:31:46.014 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-09T09:31:46.174 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-09T09:31:46.378 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-09T09:31:46.525 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-09T09:31:46.737 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-09T09:31:46.854 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-09T09:31:47.069 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-09T09:31:47.187 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-09T09:31:47.389 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-09T09:31:47.556 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-09T09:31:47.734 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-09T09:31:47.911 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-09T09:31:48.069 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-09T09:31:48.251 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-09T09:31:48.441 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-09T09:31:48.569 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-09T09:31:48.571 INFO:teuthology.task.ansible.out: 2019-12-09T09:31:48.749 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-09T09:31:48.897 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-09T09:31:49.106 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-09T09:31:49.263 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-09T09:31:49.442 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-09T09:31:49.612 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-09T09:31:49.791 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-09T09:31:49.942 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-09T09:31:50.124 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-09T09:31:50.289 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-09T09:31:50.460 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-09T09:31:50.617 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-09T09:31:50.795 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-09T09:31:50.973 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-09T09:31:51.147 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-09T09:31:51.320 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-09T09:31:51.522 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-09T09:31:51.669 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-09T09:31:51.868 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-09T09:31:51.995 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-09T09:31:52.205 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-09T09:31:52.324 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-09T09:31:52.535 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-09T09:31:52.661 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-09T09:31:52.881 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-12-09T09:31:52.987 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-09T09:31:53.227 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-12-09T09:31:53.321 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-12-09T09:31:53.560 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-12-09T09:31:53.675 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-12-09T09:31:53.913 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-12-09T09:31:54.018 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-12-09T09:31:54.273 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-12-09T09:31:54.367 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-12-09T09:31:54.644 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-12-09T09:31:54.699 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-12-09T09:31:54.974 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-12-09T09:31:55.053 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-12-09T09:31:55.335 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-12-09T09:31:55.389 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-12-09T09:31:55.692 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-12-09T09:31:55.748 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-12-09T09:31:56.010 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-12-09T09:31:56.095 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-12-09T09:31:56.354 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-09T09:31:56.443 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-12-09T09:31:56.696 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-12-09T09:31:56.781 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-09T09:31:57.118 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-12-09T09:31:57.353 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-12-09T09:31:57.504 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:57 +0000 (0:00:35.440) 0:00:48.244 ******* 2019-12-09T09:31:57.532 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-09T09:31:57.568 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:57 +0000 (0:00:00.063) 0:00:48.307 ******* 2019-12-09T09:31:57.617 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-09T09:31:57.623 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-09T09:31:57.625 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-09T09:31:57.626 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-09T09:31:57.628 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-09T09:31:57.629 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJy 2019-12-09T09:31:57.631 INFO:teuthology.task.ansible.out:w 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 2019-12-09T09:31:57.632 INFO:teuthology.task.ansible.out: 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf853 2019-12-09T09:31:57.633 INFO:teuthology.task.ansible.out:2237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36b 2019-12-09T09:31:57.635 INFO:teuthology.task.ansible.out:deb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a28 2019-12-09T09:31:57.636 INFO:teuthology.task.ansible.out:73481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c 2019-12-09T09:31:57.638 INFO:teuthology.task.ansible.out:4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-12-09T09:31:57.679 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:57 +0000 (0:00:00.110) 0:00:48.418 ******* 2019-12-09T09:31:57.800 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-09T09:31:57.801 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-12-09T09:31:57.929 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:57 +0000 (0:00:00.250) 0:00:48.669 ******* 2019-12-09T09:31:57.955 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-09T09:31:57.991 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:57 +0000 (0:00:00.062) 0:00:48.731 ******* 2019-12-09T09:31:58.041 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-09T09:31:58.045 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-09T09:31:58.046 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-09T09:31:58.048 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-09T09:31:58.049 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-09T09:31:58.051 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e 2019-12-09T09:31:58.052 INFO:teuthology.task.ansible.out:66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa 2019-12-09T09:31:58.054 INFO:teuthology.task.ansible.out:8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 2019-12-09T09:31:58.055 INFO:teuthology.task.ansible.out:6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f8 2019-12-09T09:31:58.057 INFO:teuthology.task.ansible.out:48846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8a 2019-12-09T09:31:58.058 INFO:teuthology.task.ansible.out:a01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalho 2019-12-09T09:31:58.060 INFO:teuthology.task.ansible.out:jr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-12-09T09:31:58.097 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:58 +0000 (0:00:00.105) 0:00:48.836 ******* 2019-12-09T09:31:58.734 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-12-09T09:31:58.735 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com -> localhost] => {"after": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "attempts": 1, "before": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "changed": false, "remote_url_changed": false} 2019-12-09T09:31:58.785 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:58 +0000 (0:00:00.688) 0:00:49.524 ******* 2019-12-09T09:31:58.793 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com -> localhost] => {"after": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "attempts": 1, "before": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "changed": false, "remote_url_changed": false} 2019-12-09T09:31:58.837 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:31:58 +0000 (0:00:00.052) 0:00:49.577 ******* 2019-12-09T09:31:59.191 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-09T09:31:59.244 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-09T09:31:59.605 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-09T09:31:59.638 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-09T09:31:59.973 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-09T09:31:59.985 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-09T09:32:00.322 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-09T09:32:00.333 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-09T09:32:00.678 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-09T09:32:00.680 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-09T09:32:00.700 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-09T09:32:00.702 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-09T09:32:01.028 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-09T09:32:01.040 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-09T09:32:01.376 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-09T09:32:01.378 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-09T09:32:01.399 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-09T09:32:01.400 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-09T09:32:01.743 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-09T09:32:01.744 INFO:teuthology.task.ansible.out: 2019-12-09T09:32:01.765 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-09T09:32:02.096 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-09T09:32:02.104 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:02.116 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-09T09:32:02.128 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:02.456 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-09T09:32:02.457 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-12-09T09:32:02.467 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-09T09:32:02.469 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:02.479 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:02.490 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:02.492 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:02.502 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:02.514 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:02.849 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-09T09:32:02.861 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-09T09:32:03.212 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-09T09:32:03.213 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn 2019-12-09T09:32:03.215 INFO:teuthology.task.ansible.out:": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3L 2019-12-09T09:32:03.216 INFO:teuthology.task.ansible.out:byKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-09T09:32:03.549 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-09T09:32:03.561 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-09T09:32:03.857 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-09T09:32:03.923 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-09T09:32:04.155 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-09T09:32:04.250 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-09T09:32:04.504 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-09T09:32:04.590 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-09T09:32:04.870 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-09T09:32:04.944 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-09T09:32:05.237 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-09T09:32:05.302 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-09T09:32:05.589 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-09T09:32:05.591 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-09T09:32:05.643 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-09T09:32:05.645 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-09T09:32:05.941 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-09T09:32:05.943 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-09T09:32:05.996 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-09T09:32:05.997 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-09T09:32:06.271 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-09T09:32:06.315 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-09T09:32:06.612 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-09T09:32:06.666 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-09T09:32:06.938 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-09T09:32:06.940 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-09T09:32:07.025 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-09T09:32:07.027 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-09T09:32:07.284 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-09T09:32:07.368 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-09T09:32:07.650 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-09T09:32:07.714 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-09T09:32:07.989 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-09T09:32:08.074 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-09T09:32:08.360 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-09T09:32:08.405 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-09T09:32:08.702 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-09T09:32:08.757 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-09T09:32:09.087 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-09T09:32:09.088 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRv 2019-12-09T09:32:09.090 INFO:teuthology.task.ansible.out:St nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-09T09:32:09.437 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-09T09:32:09.439 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-09T09:32:09.789 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_c 2019-12-09T09:32:09.791 INFO:teuthology.task.ansible.out:erts": true} 2019-12-09T09:32:10.124 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-09T09:32:10.136 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-09T09:32:10.463 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-09T09:32:10.501 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": t 2019-12-09T09:32:10.502 INFO:teuthology.task.ansible.out:rue} 2019-12-09T09:32:10.785 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-09T09:32:10.839 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-09T09:32:11.115 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-09T09:32:11.169 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-09T09:32:11.424 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-09T09:32:11.511 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-09T09:32:11.764 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-09T09:32:11.878 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-09T09:32:12.112 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-09T09:32:12.213 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-09T09:32:12.213 INFO:teuthology.task.ansible.out: 2019-12-09T09:32:12.532 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-09T09:32:12.535 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-09T09:32:12.558 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-09T09:32:12.560 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-09T09:32:12.873 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-09T09:32:12.874 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-09T09:32:12.913 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-09T09:32:12.915 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-09T09:32:13.200 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-09T09:32:13.254 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-09T09:32:13.503 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-09T09:32:13.587 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-09T09:32:13.808 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-09T09:32:13.933 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-09T09:32:14.161 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-09T09:32:14.163 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-09T09:32:14.298 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-09T09:32:14.299 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-09T09:32:14.537 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-09T09:32:14.539 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-09T09:32:14.540 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-09T09:32:14.647 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-09T09:32:14.649 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-09T09:32:14.650 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-09T09:32:14.900 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-09T09:32:15.000 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-09T09:32:15.252 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-09T09:32:15.348 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-09T09:32:15.605 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-09T09:32:15.733 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-09T09:32:15.954 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-09T09:32:16.060 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-09T09:32:16.291 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-09T09:32:16.396 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-09T09:32:16.633 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-09T09:32:16.738 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-09T09:32:16.962 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-09T09:32:17.078 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-09T09:32:17.296 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-09T09:32:17.369 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-09T09:32:17.653 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-09T09:32:17.654 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-09T09:32:17.706 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-09T09:32:17.707 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-09T09:32:17.986 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-09T09:32:18.053 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-09T09:32:18.318 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-09T09:32:18.393 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-09T09:32:18.643 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-09T09:32:18.646 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-09T09:32:18.771 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-09T09:32:18.772 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-09T09:32:18.971 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-09T09:32:19.139 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-09T09:32:19.287 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-09T09:32:19.475 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-09T09:32:19.623 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-09T09:32:19.812 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-09T09:32:19.938 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-09T09:32:20.157 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-09T09:32:20.242 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-09T09:32:20.521 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-09T09:32:20.574 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-09T09:32:20.824 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-09T09:32:20.908 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-09T09:32:21.162 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-09T09:32:21.194 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-09T09:32:21.484 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-09T09:32:21.516 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-09T09:32:21.829 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-09T09:32:21.840 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-09T09:32:22.148 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-09T09:32:22.171 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-09T09:32:22.488 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-09T09:32:22.520 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-09T09:32:22.838 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-09T09:32:22.859 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-09T09:32:23.192 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-09T09:32:23.203 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-09T09:32:23.521 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-09T09:32:23.532 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-09T09:32:23.819 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-09T09:32:23.898 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-09T09:32:24.157 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-09T09:32:24.232 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-09T09:32:24.490 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-09T09:32:24.565 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-09T09:32:24.830 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-09T09:32:24.925 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-09T09:32:25.159 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-09T09:32:25.254 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-09T09:32:25.531 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-09T09:32:25.595 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-09T09:32:25.880 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-09T09:32:25.950 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-09T09:32:26.204 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-09T09:32:26.309 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-09T09:32:26.522 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-09T09:32:26.648 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-09T09:32:26.883 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-09T09:32:26.988 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-09T09:32:27.219 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-09T09:32:27.221 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-09T09:32:27.323 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-09T09:32:27.559 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-09T09:32:27.561 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-09T09:32:27.655 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-09T09:32:27.657 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-09T09:32:27.911 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-09T09:32:28.050 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-09T09:32:28.051 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-09T09:32:28.230 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-09T09:32:28.422 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-09T09:32:28.573 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-09T09:32:28.790 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-09T09:32:28.915 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-09T09:32:29.128 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-09T09:32:29.244 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-09T09:32:29.245 INFO:teuthology.task.ansible.out: 2019-12-09T09:32:29.466 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-09T09:32:29.592 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-09T09:32:29.808 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-09T09:32:29.919 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-09T09:32:30.172 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-09T09:32:30.244 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-09T09:32:30.506 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-09T09:32:30.560 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-09T09:32:30.864 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-09T09:32:30.905 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-09T09:32:31.201 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-09T09:32:31.276 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-09T09:32:31.555 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-09T09:32:31.609 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-09T09:32:31.901 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-09T09:32:31.937 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-09T09:32:32.270 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-09T09:32:32.303 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-09T09:32:32.604 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-12-09T09:32:32.606 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-09T09:32:32.933 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-09T09:32:32.944 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-09T09:32:33.289 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-09T09:32:33.290 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-12-09T09:32:33.291 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-09T09:32:33.400 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:33 +0000 (0:00:34.562) 0:01:24.139 ******* 2019-12-09T09:32:33.449 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-09T09:32:33.449 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:33.460 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:33.472 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:33.483 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:33.497 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:33.498 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:33.515 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:33.524 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:33.634 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-09T09:32:33.636 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-09T09:32:33.865 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-09T09:32:33.866 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-12-09T09:32:33.877 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:33.961 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-09T09:32:33.963 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-09T09:32:34.074 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:34 +0000 (0:00:00.673) 0:01:24.813 ******* 2019-12-09T09:32:34.132 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-09T09:32:34.134 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.144 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.155 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.167 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.169 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-09T09:32:34.171 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.183 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.194 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.206 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.217 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.509 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-09T09:32:34.542 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-12-09T09:32:34.554 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.856 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-09T09:32:34.867 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.880 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-09T09:32:34.891 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.903 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.925 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.938 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.949 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.951 INFO:teuthology.task.ansible.out: 2019-12-09T09:32:34.962 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.974 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.985 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:34.996 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.008 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.009 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.021 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.034 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.035 INFO:teuthology.task.ansible.out: 2019-12-09T09:32:35.038 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.047 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.049 INFO:teuthology.task.ansible.out: 2019-12-09T09:32:35.059 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.070 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.082 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.097 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.105 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.117 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.133 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.149 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.150 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.162 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.174 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.185 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.198 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.211 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.212 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.224 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca 2019-12-09T09:32:35.225 INFO:teuthology.task.ansible.out:7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-09T09:32:35.226 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.237 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.260 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.262 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.273 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.274 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.286 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.299 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.312 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.314 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.332 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.334 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.349 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.350 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.362 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.375 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.386 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.398 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.411 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.412 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.424 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.435 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.459 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.470 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.482 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.483 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.503 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.504 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.516 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.527 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.539 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.539 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.551 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.562 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.574 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.576 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-09T09:32:35.577 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.588 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.589 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.600 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.601 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.615 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.617 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.628 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.629 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.631 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.641 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.670 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.671 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.672 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.674 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.675 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.687 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.688 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.700 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.711 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.712 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.714 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.726 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.727 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.728 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.738 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.740 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.752 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.753 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.755 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.756 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.758 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.769 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.770 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.780 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.781 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.782 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.792 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.829 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.829 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.831 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.832 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.834 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.884 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:35 +0000 (0:00:01.810) 0:01:26.624 ******* 2019-12-09T09:32:35.892 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.893 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.894 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.896 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.908 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.910 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.953 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:35 +0000 (0:00:00.068) 0:01:26.692 ******* 2019-12-09T09:32:35.961 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.965 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.975 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:35.986 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.000 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.014 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.015 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.017 INFO:teuthology.task.ansible.out: 2019-12-09T09:32:36.028 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.030 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.040 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.051 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.063 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.063 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.074 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.091 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.117 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.118 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.119 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.137 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.143 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.154 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.155 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.166 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.177 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.189 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.200 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.201 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.218 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.219 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.230 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.242 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.243 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.256 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.268 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.269 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.281 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.292 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.293 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.316 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.317 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-09T09:32:36.319 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.332 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.351 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.358 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.359 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.372 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.383 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.384 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.395 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.407 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.427 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.429 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.430 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.443 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.453 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.463 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.518 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:36 +0000 (0:00:00.565) 0:01:27.258 ******* 2019-12-09T09:32:36.545 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-12-09T09:32:36.546 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:36.583 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:36 +0000 (0:00:00.064) 0:01:27.323 ******* 2019-12-09T09:32:36.651 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-09T09:32:36.652 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-09T09:32:36.923 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-09T09:32:36.945 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-09T09:32:37.209 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-09T09:32:37.296 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-09T09:32:37.508 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-09T09:32:37.610 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-09T09:32:37.834 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-12-09T09:32:37.920 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-09T09:32:38.133 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-09T09:32:38.223 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-09T09:32:38.485 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-09T09:32:38.572 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-12-09T09:32:38.831 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-09T09:32:38.920 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-09T09:32:39.154 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-09T09:32:39.248 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-09T09:32:39.477 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-09T09:32:39.582 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-09T09:32:39.811 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-09T09:32:39.899 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-09T09:32:40.160 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-09T09:32:40.239 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-09T09:32:40.473 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-09T09:32:40.579 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-09T09:32:40.782 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-09T09:32:40.929 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-09T09:32:41.116 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-09T09:32:41.252 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-09T09:32:41.423 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-09T09:32:41.615 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-09T09:32:41.762 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-09T09:32:41.927 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-09T09:32:42.092 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-09T09:32:42.271 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-09T09:32:42.427 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-09T09:32:42.618 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-09T09:32:42.734 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-09T09:32:42.920 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-09T09:32:43.234 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-09T09:32:43.340 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2019-12-09T09:32:43.564 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-09T09:32:43.876 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2019-12-09T09:32:44.128 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2019-12-09T09:32:44.394 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2019-12-09T09:32:44.672 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2019-12-09T09:32:44.924 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} 2019-12-09T09:32:45.233 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2019-12-09T09:32:45.523 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2019-12-09T09:32:45.796 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} 2019-12-09T09:32:46.035 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2019-12-09T09:32:46.338 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2019-12-09T09:32:46.535 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2019-12-09T09:32:46.852 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2019-12-09T09:32:47.072 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2019-12-09T09:32:47.430 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2019-12-09T09:32:47.653 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2019-12-09T09:32:47.991 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2019-12-09T09:32:48.181 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2019-12-09T09:32:48.521 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2019-12-09T09:32:48.763 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2019-12-09T09:32:49.083 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2019-12-09T09:32:49.315 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2019-12-09T09:32:49.655 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-09T09:32:49.710 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2019-12-09T09:32:49.974 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-09T09:32:50.266 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2019-12-09T09:32:51.022 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} ok: [smithi132.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} ok: [smithi121.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} ok: [smithi132.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} ok: [smithi121.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-09T09:32:51.252 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-09T09:32:51.295 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-09T09:32:51.588 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-09T09:32:51.610 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-09T09:32:51.612 INFO:teuthology.task.ansible.out: 2019-12-09T09:32:51.921 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-09T09:32:52.165 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2019-12-09T09:32:52.249 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:52 +0000 (0:00:15.665) 0:01:42.989 ******* 2019-12-09T09:32:52.256 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-09T09:32:52.563 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-09T09:32:53.103 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2019-12-09T09:32:53.182 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:53 +0000 (0:00:00.932) 0:01:43.922 ******* 2019-12-09T09:32:53.325 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-09T09:32:53.325 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "checksum": "8a303ebcf60c08d57f11c57c9682a02d84685d0b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "c2805c19b557daad4717860e2c7029bc", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575883972.27-146008584905139/source", "state": "file", "uid": 0} 2019-12-09T09:32:53.386 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:53 +0000 (0:00:00.203) 0:01:44.125 ******* 2019-12-09T09:32:53.424 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-12-09T09:32:53.425 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => { "msg": "Host smithi121.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-12-09T09:32:53.466 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:53 +0000 (0:00:00.080) 0:01:44.206 ******* 2019-12-09T09:32:53.502 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-09T09:32:53.504 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-09T09:32:53.544 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:53 +0000 (0:00:00.078) 0:01:44.284 ******* 2019-12-09T09:32:53.585 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:53.640 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:53 +0000 (0:00:00.095) 0:01:44.380 ******* 2019-12-09T09:32:53.642 INFO:teuthology.task.ansible.out: 2019-12-09T09:32:54.097 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-09T09:32:54.098 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.105779", "end": "2019-12-09 09:32:54.059139", "rc": 0, "start": "2019-12-09 09:32:53.953360", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-09T09:32:54.145 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:54 +0000 (0:00:00.504) 0:01:44.884 ******* 2019-12-09T09:32:54.172 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-09T09:32:54.174 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:54.212 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:54 +0000 (0:00:00.067) 0:01:44.952 ******* 2019-12-09T09:32:54.240 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-09T09:32:54.240 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "checksum": "8a303ebcf60c08d57f11c57c9682a02d84685d0b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "c2805c19b557daad4717860e2c7029bc", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575883973.21-174523722126125/source", "state": "file", "uid": 0} 2019-12-09T09:32:54.242 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:54.294 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:54 +0000 (0:00:00.081) 0:01:45.034 ******* 2019-12-09T09:32:54.328 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:54 +0000 (0:00:00.034) 0:01:45.068 ******* 2019-12-09T09:32:54.334 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-12-09T09:32:54.336 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:54.375 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:54 +0000 (0:00:00.046) 0:01:45.114 ******* 2019-12-09T09:32:54.381 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-12-09T09:32:54.382 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => { "msg": "Host smithi132.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-12-09T09:32:54.427 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:54 +0000 (0:00:00.049) 0:01:45.163 ******* 2019-12-09T09:32:54.429 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-12-09T09:32:54.430 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:54.470 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:54 +0000 (0:00:00.045) 0:01:45.209 ******* 2019-12-09T09:32:54.478 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-09T09:32:54.480 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-09T09:32:54.520 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:54 +0000 (0:00:00.049) 0:01:45.259 ******* 2019-12-09T09:32:54.526 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-09T09:32:54.528 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:54.579 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:54 +0000 (0:00:00.059) 0:01:45.318 ******* 2019-12-09T09:32:54.587 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-12-09T09:32:54.589 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:54.637 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:54 +0000 (0:00:00.058) 0:01:45.377 ******* 2019-12-09T09:32:54.646 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-12-09T09:32:54.648 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:54.686 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:54 +0000 (0:00:00.048) 0:01:45.425 ******* 2019-12-09T09:32:54.724 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-09T09:32:54.726 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi121.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T09:32:54.768 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:54 +0000 (0:00:00.082) 0:01:45.507 ******* 2019-12-09T09:32:54.797 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-12-09T09:32:54.799 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:54.837 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:54 +0000 (0:00:00.068) 0:01:45.576 ******* 2019-12-09T09:32:54.874 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-12-09T09:32:54.876 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:54.913 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:54 +0000 (0:00:00.075) 0:01:45.652 ******* 2019-12-09T09:32:54.940 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-12-09T09:32:54.941 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T09:32:54.981 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:54 +0000 (0:00:00.067) 0:01:45.720 ******* 2019-12-09T09:32:55.029 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-12-09T09:32:55.031 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:55.091 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.110) 0:01:45.831 ******* 2019-12-09T09:32:55.098 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-09T09:32:55.099 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.093691", "end": "2019-12-09 09:32:55.040748", "rc": 0, "start": "2019-12-09 09:32:54.947057", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-09T09:32:55.143 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.051) 0:01:45.883 ******* 2019-12-09T09:32:55.150 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-12-09T09:32:55.151 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T09:32:55.192 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.049) 0:01:45.932 ******* 2019-12-09T09:32:55.202 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-09T09:32:55.204 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:55.243 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.050) 0:01:45.982 ******* 2019-12-09T09:32:55.250 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-09T09:32:55.251 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:55.299 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.055) 0:01:46.038 ******* 2019-12-09T09:32:55.305 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-12-09T09:32:55.307 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:55.353 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.054) 0:01:46.093 ******* 2019-12-09T09:32:55.360 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-12-09T09:32:55.361 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:55.405 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.051) 0:01:46.145 ******* 2019-12-09T09:32:55.412 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-12-09T09:32:55.414 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:55.457 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.051) 0:01:46.197 ******* 2019-12-09T09:32:55.463 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-09T09:32:55.465 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:55.506 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.048) 0:01:46.245 ******* 2019-12-09T09:32:55.515 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-12-09T09:32:55.516 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:55.577 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.070) 0:01:46.316 ******* 2019-12-09T09:32:55.586 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-12-09T09:32:55.588 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:55.633 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.056) 0:01:46.373 ******* 2019-12-09T09:32:55.642 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-09T09:32:55.643 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:55.708 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.069) 0:01:46.442 ******* 2019-12-09T09:32:55.712 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-12-09T09:32:55.713 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T09:32:55.771 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.067) 0:01:46.510 ******* 2019-12-09T09:32:55.781 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-12-09T09:32:55.782 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:55.821 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.050) 0:01:46.560 ******* 2019-12-09T09:32:55.827 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-09T09:32:55.829 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:55.867 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.046) 0:01:46.607 ******* 2019-12-09T09:32:55.890 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-09T09:32:55.892 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi132.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T09:32:55.929 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.061) 0:01:46.668 ******* 2019-12-09T09:32:55.935 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-12-09T09:32:55.936 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:55.978 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:55 +0000 (0:00:00.049) 0:01:46.718 ******* 2019-12-09T09:32:55.985 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-12-09T09:32:55.987 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:56.032 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.053) 0:01:46.772 ******* 2019-12-09T09:32:56.040 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-12-09T09:32:56.041 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:56.083 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.050) 0:01:46.822 ******* 2019-12-09T09:32:56.092 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-12-09T09:32:56.093 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:56.143 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.059) 0:01:46.882 ******* 2019-12-09T09:32:56.149 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-12-09T09:32:56.150 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:56.195 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.052) 0:01:46.934 ******* 2019-12-09T09:32:56.202 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-12-09T09:32:56.204 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T09:32:56.247 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.051) 0:01:46.986 ******* 2019-12-09T09:32:56.255 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-12-09T09:32:56.257 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:56.292 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.045) 0:01:47.032 ******* 2019-12-09T09:32:56.298 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-12-09T09:32:56.300 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:56.347 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.054) 0:01:47.086 ******* 2019-12-09T09:32:56.352 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-12-09T09:32:56.354 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:56.400 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.053) 0:01:47.139 ******* 2019-12-09T09:32:56.408 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-12-09T09:32:56.410 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T09:32:56.448 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.048) 0:01:47.188 ******* 2019-12-09T09:32:56.454 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-12-09T09:32:56.455 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T09:32:56.500 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.052) 0:01:47.240 ******* 2019-12-09T09:32:56.509 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-09T09:32:56.511 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:56.547 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.046) 0:01:47.286 ******* 2019-12-09T09:32:56.552 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-09T09:32:56.591 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.043) 0:01:47.330 ******* 2019-12-09T09:32:56.596 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-12-09T09:32:56.598 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:56.639 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.048) 0:01:47.379 ******* 2019-12-09T09:32:56.645 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-09T09:32:56.646 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:56.694 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.054) 0:01:47.433 ******* 2019-12-09T09:32:56.700 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-09T09:32:56.701 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:56.746 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.051) 0:01:47.485 ******* 2019-12-09T09:32:56.793 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-12-09T09:32:56.795 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:56.835 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.088) 0:01:47.574 ******* 2019-12-09T09:32:56.868 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi132.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T09:32:56.900 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.065) 0:01:47.639 ******* 2019-12-09T09:32:56.937 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-09T09:32:56.938 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:56.977 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:56 +0000 (0:00:00.077) 0:01:47.717 ******* 2019-12-09T09:32:57.004 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-12-09T09:32:57.006 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:57.044 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:57 +0000 (0:00:00.066) 0:01:47.783 ******* 2019-12-09T09:32:57.049 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-12-09T09:32:57.050 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T09:32:57.090 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:57 +0000 (0:00:00.046) 0:01:47.830 ******* 2019-12-09T09:32:57.096 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-12-09T09:32:57.097 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:57.140 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:57 +0000 (0:00:00.050) 0:01:47.880 ******* 2019-12-09T09:32:57.177 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-12-09T09:32:57.179 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:57.216 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:57 +0000 (0:00:00.075) 0:01:47.956 ******* 2019-12-09T09:32:57.267 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-12-09T09:32:57.268 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:57.306 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:57 +0000 (0:00:00.090) 0:01:48.046 ******* 2019-12-09T09:32:57.344 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-12-09T09:32:57.345 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:57.382 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:57 +0000 (0:00:00.075) 0:01:48.122 ******* 2019-12-09T09:32:57.418 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-12-09T09:32:57.420 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-09T09:32:57.455 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:57 +0000 (0:00:00.073) 0:01:48.195 ******* 2019-12-09T09:32:57.482 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-09T09:32:57.521 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:57 +0000 (0:00:00.065) 0:01:48.261 ******* 2019-12-09T09:32:57.560 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-09T09:32:57.562 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:32:57.600 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:57 +0000 (0:00:00.078) 0:01:48.340 ******* 2019-12-09T09:32:57.959 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-12-09T09:32:57.961 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T09:32:58.012 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:58 +0000 (0:00:00.411) 0:01:48.751 ******* 2019-12-09T09:32:58.326 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-09T09:32:58.327 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-12-09T09:32:58.973 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-12-09T09:32:59.237 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-12-09T09:32:59.276 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:59 +0000 (0:00:01.264) 0:01:50.016 ******* 2019-12-09T09:32:59.925 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-12-09T09:32:59.968 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:32:59 +0000 (0:00:00.691) 0:01:50.707 ******* 2019-12-09T09:33:00.396 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-12-09T09:33:00.397 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575883979.31-179090865240220/source", "state": "file", "uid": 0} 2019-12-09T09:33:01.126 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575883980.01-143931086401481/source", "state": "file", "uid": 0} 2019-12-09T09:33:01.503 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575883980.41-8631504618069/source", "state": "file", "uid": 0} 2019-12-09T09:33:01.546 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:01 +0000 (0:00:01.577) 0:01:52.285 ******* 2019-12-09T09:33:02.167 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-09T09:33:02.168 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-12-09T09:33:02.316 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-12-09T09:33:02.318 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575883981.14-47850644573946/source", "state": "file", "uid": 0} 2019-12-09T09:33:02.364 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:02 +0000 (0:00:00.819) 0:01:53.104 ******* 2019-12-09T09:33:02.466 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-09T09:33:02.467 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-09T09:33:02.469 INFO:teuthology.task.ansible.out: [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2019-12-09T09:33:02.520 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:02 +0000 (0:00:00.155) 0:01:53.259 ******* 2019-12-09T09:33:02.723 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-12-09T09:33:03.029 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-09T09:33:03.079 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:03 +0000 (0:00:00.559) 0:01:53.819 ******* 2019-12-09T09:33:14.367 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-12-09T09:33:14.369 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:11.527608", "end": "2019-12-09 09:33:14.338477", "rc": 0, "start": "2019-12-09 09:33:02.810869", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.fileplanet.com\n * extras: mirrors.tripadvisor.com\n * updates: mirror.cogentco.com\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.fileplanet.com", " * extras: mirrors.tripadvisor.com", " * updates: mirror.cogentco.com", "Metadata Cache Created"]} 2019-12-09T09:33:14.410 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:14 +0000 (0:00:11.330) 0:02:05.150 ******* 2019-12-09T09:33:14.769 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-09T09:33:14.771 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-12-09T09:33:15.100 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-12-09T09:33:15.102 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:11.690982", "end": "2019-12-09 09:33:15.066962", "rc": 0, "start": "2019-12-09 09:33:03.375980", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.fileplanet.com\n * extras: mirrors.tripadvisor.com\n * updates: mirror.cogentco.com\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.fileplanet.com", " * extras: mirrors.tripadvisor.com", " * updates: mirror.cogentco.com", "Metadata Cache Created"]} 2019-12-09T09:33:15.103 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-09T09:33:15.105 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-09T09:33:15.178 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:15 +0000 (0:00:00.767) 0:02:05.917 ******* 2019-12-09T09:33:15.220 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:15 +0000 (0:00:00.042) 0:02:05.960 ******* 2019-12-09T09:33:15.226 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-09T09:33:15.228 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:15.272 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:15 +0000 (0:00:00.051) 0:02:06.012 ******* 2019-12-09T09:33:15.299 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-12-09T09:33:15.301 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:15.338 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:15 +0000 (0:00:00.065) 0:02:06.077 ******* 2019-12-09T09:33:15.364 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-12-09T09:33:15.366 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:15.401 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:15 +0000 (0:00:00.063) 0:02:06.140 ******* 2019-12-09T09:33:15.429 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-09T09:33:15.430 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:15.467 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:15 +0000 (0:00:00.065) 0:02:06.206 ******* 2019-12-09T09:33:15.495 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:15.537 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:15 +0000 (0:00:00.069) 0:02:06.276 ******* 2019-12-09T09:33:15.578 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-09T09:33:15.579 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-12-09T09:33:15.580 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:15.620 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:15 +0000 (0:00:00.083) 0:02:06.360 ******* 2019-12-09T09:33:15.649 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-12-09T09:33:15.650 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:15.695 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:15 +0000 (0:00:00.074) 0:02:06.435 ******* 2019-12-09T09:33:15.724 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-09T09:33:15.725 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:15.775 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:15 +0000 (0:00:00.080) 0:02:06.515 ******* 2019-12-09T09:33:15.910 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-09T09:33:15.911 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-09T09:33:15.971 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:15 +0000 (0:00:00.196) 0:02:06.711 ******* 2019-12-09T09:33:16.149 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-09T09:33:16.151 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:16.188 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:16 +0000 (0:00:00.216) 0:02:06.928 ******* 2019-12-09T09:33:16.215 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-12-09T09:33:16.217 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:16.266 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:16 +0000 (0:00:00.077) 0:02:07.005 ******* 2019-12-09T09:33:16.294 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-12-09T09:33:16.296 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:16.341 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:16 +0000 (0:00:00.075) 0:02:07.081 ******* 2019-12-09T09:33:16.369 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-09T09:33:16.370 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:16.406 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:16 +0000 (0:00:00.064) 0:02:07.146 ******* 2019-12-09T09:33:16.432 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-12-09T09:33:16.434 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:16.470 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:16 +0000 (0:00:00.064) 0:02:07.210 ******* 2019-12-09T09:33:16.507 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-12-09T09:33:16.509 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:16.546 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:16 +0000 (0:00:00.076) 0:02:07.286 ******* 2019-12-09T09:33:16.552 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-12-09T09:33:16.557 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.428882", "end": "2019-12-09 09:33:16.500499", "rc": 0, "start": "2019-12-09 09:33:16.071617", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:33:16.597 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:16 +0000 (0:00:00.050) 0:02:07.337 ******* 2019-12-09T09:33:16.604 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-12-09T09:33:16.606 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:16.659 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:16 +0000 (0:00:00.061) 0:02:07.398 ******* 2019-12-09T09:33:16.696 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-09T09:33:16.698 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:16.742 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:16 +0000 (0:00:00.083) 0:02:07.482 ******* 2019-12-09T09:33:18.323 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-12-09T09:33:18.323 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-12-09T09:33:18.391 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:18 +0000 (0:00:01.648) 0:02:09.131 ******* 2019-12-09T09:33:18.450 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-12-09T09:33:18.452 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:18.492 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:18 +0000 (0:00:00.100) 0:02:09.231 ******* 2019-12-09T09:33:18.520 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-12-09T09:33:18.522 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:18.561 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:18 +0000 (0:00:00.068) 0:02:09.300 ******* 2019-12-09T09:33:18.568 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-12-09T09:33:18.569 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.478292", "end": "2019-12-09 09:33:18.500462", "rc": 0, "start": "2019-12-09 09:33:17.022170", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:33:18.620 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:18 +0000 (0:00:00.059) 0:02:09.360 ******* 2019-12-09T09:33:18.629 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:18.673 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:18 +0000 (0:00:00.053) 0:02:09.413 ******* 2019-12-09T09:33:18.700 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-12-09T09:33:18.719 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:18.747 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:18 +0000 (0:00:00.073) 0:02:09.487 ******* 2019-12-09T09:33:19.126 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-12-09T09:33:19.127 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-12-09T09:33:19.178 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:19 +0000 (0:00:00.430) 0:02:09.917 ******* 2019-12-09T09:33:19.205 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-12-09T09:33:19.207 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:19.251 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:19 +0000 (0:00:00.072) 0:02:09.990 ******* 2019-12-09T09:33:19.437 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-12-09T09:33:19.438 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:19.632 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:19 +0000 (0:00:00.381) 0:02:10.372 ******* 2019-12-09T09:33:19.659 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-12-09T09:33:19.661 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:19.701 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:19 +0000 (0:00:00.068) 0:02:10.440 ******* 2019-12-09T09:33:19.717 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-12-09T09:33:19.718 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-12-09T09:33:19.769 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:19 +0000 (0:00:00.068) 0:02:10.509 ******* 2019-12-09T09:33:19.780 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-12-09T09:33:19.782 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:19.831 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:19 +0000 (0:00:00.059) 0:02:10.568 ******* 2019-12-09T09:33:20.754 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-12-09T09:33:20.755 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-12-09T09:33:20.803 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:20 +0000 (0:00:00.973) 0:02:11.542 ******* 2019-12-09T09:33:23.686 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-12-09T09:33:23.686 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-12-09T09:33:23.730 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:23 +0000 (0:00:02.927) 0:02:14.470 ******* 2019-12-09T09:33:24.730 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-09T09:33:24.731 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-12-09T09:33:24.769 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-12-09T09:33:24.771 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-12-09T09:33:24.829 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:24 +0000 (0:00:01.098) 0:02:15.569 ******* 2019-12-09T09:33:25.690 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-09T09:33:25.691 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-12-09T09:33:25.794 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-12-09T09:33:26.623 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-12-09T09:33:26.676 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:26 +0000 (0:00:01.846) 0:02:17.416 ******* 2019-12-09T09:33:26.716 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-12-09T09:33:26.977 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-12-09T09:33:26.979 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-09T09:33:27.042 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:27 +0000 (0:00:00.365) 0:02:17.781 ******* 2019-12-09T09:33:27.598 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-09T09:33:27.599 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-12-09T09:33:27.653 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:27 +0000 (0:00:00.610) 0:02:18.392 ******* 2019-12-09T09:33:27.948 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-09T09:33:27.959 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-12-09T09:33:27.985 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-12-09T09:33:27.986 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-09T09:33:28.052 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:28 +0000 (0:00:00.399) 0:02:18.792 ******* 2019-12-09T09:33:28.824 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-09T09:33:28.825 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-12-09T09:33:29.017 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-12-09T09:33:29.676 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-12-09T09:33:29.773 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:29 +0000 (0:00:01.720) 0:02:20.513 ******* 2019-12-09T09:33:29.814 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-12-09T09:33:29.817 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:29.886 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:29 +0000 (0:00:00.113) 0:02:20.626 ******* 2019-12-09T09:33:29.925 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-09T09:33:29.927 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-12-09T09:33:29.929 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi121.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-12-09T09:33:29.968 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:29 +0000 (0:00:00.081) 0:02:20.707 ******* 2019-12-09T09:33:30.307 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-12-09T09:33:30.309 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-09T09:33:30.351 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:30 +0000 (0:00:00.382) 0:02:21.090 ******* 2019-12-09T09:33:30.400 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-09T09:33:30.402 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-09T09:33:30.423 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-09T09:33:30.445 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-09T09:33:30.446 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-09T09:33:30.501 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:30 +0000 (0:00:00.150) 0:02:21.240 ******* 2019-12-09T09:33:30.812 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-09T09:33:30.813 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-12-09T09:33:30.864 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:30 +0000 (0:00:00.363) 0:02:21.604 ******* 2019-12-09T09:33:30.908 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:30.987 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:30 +0000 (0:00:00.110) 0:02:21.714 ******* 2019-12-09T09:33:31.099 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-12-09T09:33:31.149 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:31 +0000 (0:00:00.173) 0:02:21.888 ******* 2019-12-09T09:33:31.514 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-12-09T09:33:31.520 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-09T09:33:31.566 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:31 +0000 (0:00:00.417) 0:02:22.305 ******* 2019-12-09T09:33:31.625 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-09T09:33:31.627 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-09T09:33:31.648 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-09T09:33:31.671 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-09T09:33:31.682 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-09T09:33:31.736 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:31 +0000 (0:00:00.170) 0:02:22.476 ******* 2019-12-09T09:33:31.738 INFO:teuthology.task.ansible.out: 2019-12-09T09:33:33.843 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-09T09:33:33.845 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-12-09T09:33:33.890 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:33 +0000 (0:00:02.147) 0:02:24.624 ******* 2019-12-09T09:33:33.923 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-12-09T09:33:33.925 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:33.962 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:33 +0000 (0:00:00.077) 0:02:24.701 ******* 2019-12-09T09:33:34.911 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-12-09T09:33:34.912 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-12-09T09:33:34.976 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:34 +0000 (0:00:01.014) 0:02:25.716 ******* 2019-12-09T09:33:35.092 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-09T09:33:35.093 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-12-09T09:33:35.157 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:35 +0000 (0:00:00.181) 0:02:25.897 ******* 2019-12-09T09:33:35.208 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-12-09T09:33:35.209 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:35.247 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:35 +0000 (0:00:00.090) 0:02:25.987 ******* 2019-12-09T09:33:35.991 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-12-09T09:33:35.993 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-12-09T09:33:36.033 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:36 +0000 (0:00:00.784) 0:02:26.772 ******* 2019-12-09T09:33:36.073 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-12-09T09:33:36.075 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:36.118 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:36 +0000 (0:00:00.086) 0:02:26.858 ******* 2019-12-09T09:33:36.268 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-12-09T09:33:36.318 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:36 +0000 (0:00:00.199) 0:02:27.058 ******* 2019-12-09T09:33:36.464 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-12-09T09:33:36.466 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T09:33:36.509 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:36 +0000 (0:00:00.190) 0:02:27.249 ******* 2019-12-09T09:33:36.886 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-12-09T09:33:36.887 INFO:teuthology.task.ansible.out:fatal: [smithi121.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-12-09T09:33:36.936 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:36 +0000 (0:00:00.427) 0:02:27.676 ******* 2019-12-09T09:33:36.979 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-12-09T09:33:36.981 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:37.041 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:37 +0000 (0:00:00.103) 0:02:27.780 ******* 2019-12-09T09:33:37.276 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-12-09T09:33:37.277 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-12-09T09:33:37.316 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:37 +0000 (0:00:00.275) 0:02:28.056 ******* 2019-12-09T09:33:37.353 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-12-09T09:33:37.355 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:37.398 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:37 +0000 (0:00:00.081) 0:02:28.137 ******* 2019-12-09T09:33:37.721 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-12-09T09:33:37.723 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T09:33:37.777 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:37 +0000 (0:00:00.378) 0:02:28.516 ******* 2019-12-09T09:33:38.024 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-12-09T09:33:38.024 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-12-09T09:33:38.074 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:38 +0000 (0:00:00.297) 0:02:28.814 ******* 2019-12-09T09:33:38.170 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-12-09T09:33:38.171 INFO:teuthology.task.ansible.out:fatal: [smithi132.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-12-09T09:33:38.208 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:38 +0000 (0:00:00.133) 0:02:28.948 ******* 2019-12-09T09:33:38.246 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-12-09T09:33:38.248 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:33:38.290 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:38 +0000 (0:00:00.082) 0:02:29.030 ******* 2019-12-09T09:33:39.060 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-12-09T09:33:39.062 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-12-09 09:30:45 UTC", "ActiveEnterTimestampMonotonic": "20440970", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket system.slice nss-lookup.target local-fs.target basic.target network.target time-sync.target var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-12-09 09:30:45 UTC", "AssertTimestampMonotonic": "20440139", "Before": "multi-user.target xdm.service getty@tty1.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-12-09 09:30:45 UTC", "ConditionTimestampMonotonic": "20440139", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8959", "ExecMainStartTimestamp": "Mon 2019-12-09 09:30:45 UTC", "ExecMainStartTimestampMonotonic": "20440919", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-12-09T09:33:39.064 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Mon 2019-12-09 09:30:45 UTC] ; stop_time=[n/a] ; pid=8959 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2019-12-09 09:30:45 UTC", "InactiveExitTimestampMonotonic": "20440970", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127510", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127510", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8959", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "network-online.target basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-12-09T09:33:39.065 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Mon 2019-12-09 09:30:45 UTC", "WatchdogTimestampMonotonic": "20440951", "WatchdogUSec": "0"}} 2019-12-09T09:33:39.111 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:39 +0000 (0:00:00.820) 0:02:29.851 ******* 2019-12-09T09:33:39.246 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-12-09T09:33:39.247 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-12-09T09:33:39.286 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:39 +0000 (0:00:00.175) 0:02:30.026 ******* 2019-12-09T09:33:39.451 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-12-09T09:33:39.453 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004813", "end": "2019-12-09 09:33:39.415688", "rc": 0, "start": "2019-12-09 09:33:39.410875", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-12-09T09:33:39.493 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:39 +0000 (0:00:00.207) 0:02:30.233 ******* 2019-12-09T09:33:39.737 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-12-09T09:33:39.738 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-12-09 09:30:32 UTC", "ActiveEnterTimestampMonotonic": "19240220", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket basic.target time-sync.target nss-lookup.target local-fs.target network.target system.slice var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-12-09 09:30:32 UTC", "AssertTimestampMonotonic": "19239449", "Before": "shutdown.target getty@tty1.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-12-09 09:30:32 UTC", "ConditionTimestampMonotonic": "19239448", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8934", "ExecMainStartTimestamp": "Mon 2019-12-09 09:30:32 UTC", "ExecMainStartTimestampMonotonic": "19240166", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-12-09T09:33:39.740 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Mon 2019-12-09 09:30:32 UTC] ; stop_time=[n/a] ; pid=8934 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2019-12-09 09:30:32 UTC", "InactiveExitTimestampMonotonic": "19240220", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8934", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-12-09T09:33:39.741 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Mon 2019-12-09 09:30:32 UTC", "WatchdogTimestampMonotonic": "19240203", "WatchdogUSec": "0"}} 2019-12-09T09:33:39.790 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:39 +0000 (0:00:00.296) 0:02:30.529 ******* 2019-12-09T09:33:39.994 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-12-09T09:33:39.995 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-12-09T09:33:40.036 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:40 +0000 (0:00:00.245) 0:02:30.775 ******* 2019-12-09T09:33:40.112 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-12-09T09:33:40.113 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004483", "end": "2019-12-09 09:33:40.083937", "rc": 0, "start": "2019-12-09 09:33:40.079454", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-12-09T09:33:40.158 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:40 +0000 (0:00:00.122) 0:02:30.897 ******* 2019-12-09T09:33:40.642 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-12-09T09:33:40.644 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-12-09T09:33:40.681 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:33:40 +0000 (0:00:00.523) 0:02:31.420 ******* 2019-12-09T09:34:06.173 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-12-09T09:34:06.174 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from updates"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.fileplanet.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirrors.tripadvisor.com\n * updates: mirror.cogentco.com\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 updates 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 updates 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 2019-12-09T09:34:06.175 INFO:teuthology.task.ansible.out: 30 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-12-09T09:34:06.226 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:06 +0000 (0:00:25.544) 0:02:56.965 ******* 2019-12-09T09:34:06.939 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-12-09T09:34:07.003 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:06 +0000 (0:00:00.777) 0:02:57.742 ******* 2019-12-09T09:34:07.010 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-12-09T09:34:07.011 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from updates"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.fileplanet.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirrors.tripadvisor.com\n * updates: mirror.cogentco.com\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 updates 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 updates 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 2019-12-09T09:34:07.013 INFO:teuthology.task.ansible.out: 19 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-12-09T09:34:07.058 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:07 +0000 (0:00:00.055) 0:02:57.798 ******* 2019-12-09T09:34:07.607 INFO:teuthology.task.ansible.out: 2019-12-09T09:34:07.609 INFO:teuthology.task.ansible.out:TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-12-09T09:34:07.668 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:07 +0000 (0:00:00.609) 0:02:58.407 ******* 2019-12-09T09:34:15.060 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.714884", "end": "2019-12-09 09:34:15.017710", "failed_when_result": false, "rc": 0, "start": "2019-12-09 09:34:07.302826", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-12-09T09:34:15.124 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:15 +0000 (0:00:07.456) 0:03:05.863 ******* 2019-12-09T09:34:15.745 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.745967", "end": "2019-12-09 09:34:15.708392", "failed_when_result": false, "rc": 0, "start": "2019-12-09 09:34:07.962425", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-12-09T09:34:15.783 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:15 +0000 (0:00:00.659) 0:03:06.523 ******* 2019-12-09T09:34:16.103 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-12-09T09:34:16.105 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-12-09T09:34:16.147 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:16 +0000 (0:00:00.363) 0:03:06.887 ******* 2019-12-09T09:34:16.483 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-12-09T09:34:16.484 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.016173", "end": "2019-12-09 09:34:16.447753", "rc": 0, "start": "2019-12-09 09:34:16.431580", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-12-09T09:34:16.540 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:16 +0000 (0:00:00.392) 0:03:07.279 ******* 2019-12-09T09:34:16.729 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-12-09T09:34:16.731 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-12-09T09:34:16.769 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:16 +0000 (0:00:00.228) 0:03:07.508 ******* 2019-12-09T09:34:16.860 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-12-09T09:34:16.861 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.015431", "end": "2019-12-09 09:34:16.829120", "rc": 0, "start": "2019-12-09 09:34:16.813689", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:34:16.906 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:16 +0000 (0:00:00.137) 0:03:07.646 ******* 2019-12-09T09:34:17.111 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-12-09T09:34:17.112 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.016662", "end": "2019-12-09 09:34:17.077321", "rc": 0, "start": "2019-12-09 09:34:17.060659", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-12-09T09:34:17.152 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:17 +0000 (0:00:00.245) 0:03:07.892 ******* 2019-12-09T09:34:17.485 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-12-09T09:34:17.487 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.015478", "end": "2019-12-09 09:34:17.459832", "rc": 0, "start": "2019-12-09 09:34:17.444354", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:34:17.532 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:17 +0000 (0:00:00.379) 0:03:08.271 ******* 2019-12-09T09:34:25.004 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-09T09:34:25.005 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.743185", "end": "2019-12-09 09:34:24.964849", "rc": 0, "start": "2019-12-09 09:34:17.221664", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:34:25.049 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:25 +0000 (0:00:07.516) 0:03:15.788 ******* 2019-12-09T09:34:25.401 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-12-09T09:34:25.444 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:25 +0000 (0:00:00.395) 0:03:16.183 ******* 2019-12-09T09:34:25.481 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-12-09T09:34:25.482 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-12-09T09:34:25.530 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:25 +0000 (0:00:00.086) 0:03:16.270 ******* 2019-12-09T09:34:25.579 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-12-09T09:34:25.580 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-09T09:34:25.637 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:25 +0000 (0:00:00.106) 0:03:16.377 ******* 2019-12-09T09:34:25.643 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-09T09:34:25.644 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.724590", "end": "2019-12-09 09:34:25.570931", "rc": 0, "start": "2019-12-09 09:34:17.846341", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:34:25.686 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:25 +0000 (0:00:00.049) 0:03:16.426 ******* 2019-12-09T09:34:25.694 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-12-09T09:34:25.696 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-12-09T09:34:25.763 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:25 +0000 (0:00:00.076) 0:03:16.503 ******* 2019-12-09T09:34:25.813 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-12-09T09:34:25.815 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-09T09:34:25.864 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:25 +0000 (0:00:00.100) 0:03:16.603 ******* 2019-12-09T09:34:26.032 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-12-09T09:34:26.082 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:26 +0000 (0:00:00.218) 0:03:16.821 ******* 2019-12-09T09:34:26.123 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-12-09T09:34:26.124 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-12-09T09:34:26.185 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:26 +0000 (0:00:00.103) 0:03:16.925 ******* 2019-12-09T09:34:26.195 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-12-09T09:34:26.196 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-09T09:34:26.251 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:26 +0000 (0:00:00.064) 0:03:16.990 ******* 2019-12-09T09:34:26.257 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-12-09T09:34:26.259 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-09T09:34:26.307 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:26 +0000 (0:00:00.056) 0:03:17.046 ******* 2019-12-09T09:34:26.357 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-12-09T09:34:26.358 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-12-09T09:34:26.400 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:26 +0000 (0:00:00.093) 0:03:17.140 ******* 2019-12-09T09:34:26.447 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-12-09T09:34:26.449 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-09T09:34:26.492 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:26 +0000 (0:00:00.087) 0:03:17.227 ******* 2019-12-09T09:34:26.619 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-12-09T09:34:26.621 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-12-09T09:34:26.678 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:26 +0000 (0:00:00.190) 0:03:17.418 ******* 2019-12-09T09:34:26.706 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-09T09:34:26.708 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:34:26.758 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:26 +0000 (0:00:00.079) 0:03:17.498 ******* 2019-12-09T09:34:26.785 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-12-09T09:34:26.787 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:34:26.851 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:26 +0000 (0:00:00.092) 0:03:17.590 ******* 2019-12-09T09:34:26.857 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-12-09T09:34:26.858 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-09T09:34:26.917 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:26 +0000 (0:00:00.065) 0:03:17.656 ******* 2019-12-09T09:34:27.220 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi121.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-12-09T09:34:27.275 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:27 +0000 (0:00:00.358) 0:03:18.015 ******* 2019-12-09T09:34:27.283 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-12-09T09:34:27.284 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-12-09T09:34:27.327 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:27 +0000 (0:00:00.051) 0:03:18.067 ******* 2019-12-09T09:34:27.365 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-09T09:34:27.367 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:34:27.409 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:27 +0000 (0:00:00.081) 0:03:18.148 ******* 2019-12-09T09:34:27.448 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-12-09T09:34:27.457 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:34:27.495 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:27 +0000 (0:00:00.086) 0:03:18.235 ******* 2019-12-09T09:34:27.852 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi132.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-12-09T09:34:27.895 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:27 +0000 (0:00:00.399) 0:03:18.635 ******* 2019-12-09T09:34:28.387 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-12-09T09:34:28.388 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-12-09T09:34:28.431 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:28 +0000 (0:00:00.536) 0:03:19.171 ******* 2019-12-09T09:34:28.470 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-12-09T09:34:28.472 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi121"}, "changed": false} 2019-12-09T09:34:28.510 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:28 +0000 (0:00:00.079) 0:03:19.250 ******* 2019-12-09T09:34:28.978 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-12-09T09:34:28.979 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-12-09T09:34:29.044 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:29 +0000 (0:00:00.534) 0:03:19.784 ******* 2019-12-09T09:34:29.083 INFO:teuthology.task.ansible.out: 2019-12-09T09:34:29.084 INFO:teuthology.task.ansible.out:TASK [testnode : Set hostname var] ********************************************* ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi132"}, "changed": false} 2019-12-09T09:34:29.146 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:29 +0000 (0:00:00.100) 0:03:19.884 ******* 2019-12-09T09:34:29.585 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-12-09T09:34:29.587 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi121.front.sepia.ceph.com", "ansible_hostname": "smithi121", "ansible_nodename": "smithi121"}, "changed": true, "name": "smithi121"} 2019-12-09T09:34:29.644 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:29 +0000 (0:00:00.498) 0:03:20.383 ******* 2019-12-09T09:34:29.695 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi132.front.sepia.ceph.com", "ansible_hostname": "smithi132", "ansible_nodename": "smithi132"}, "changed": true, "name": "smithi132"} 2019-12-09T09:34:29.743 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:29 +0000 (0:00:00.099) 0:03:20.482 ******* 2019-12-09T09:34:30.552 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-12-09T09:34:30.553 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-12-09T09:34:30.604 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:30 +0000 (0:00:00.861) 0:03:21.344 ******* 2019-12-09T09:34:30.720 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-12-09T09:34:30.771 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:30 +0000 (0:00:00.166) 0:03:21.510 ******* 2019-12-09T09:34:31.628 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-12-09T09:34:31.628 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-12-09T09:34:31.666 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:31 +0000 (0:00:00.895) 0:03:22.406 ******* 2019-12-09T09:34:31.683 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-12-09T09:34:31.720 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:31 +0000 (0:00:00.054) 0:03:22.460 ******* 2019-12-09T09:34:32.636 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-12-09T09:34:32.637 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} changed: [smithi121.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-09T09:34:32.674 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:32 +0000 (0:00:00.953) 0:03:23.414 ******* 2019-12-09T09:34:32.710 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:32 +0000 (0:00:00.035) 0:03:23.449 ******* 2019-12-09T09:34:33.584 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-12-09T09:34:33.585 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-12-09T09:34:33.624 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:33 +0000 (0:00:00.913) 0:03:24.363 ******* 2019-12-09T09:34:33.644 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-12-09T09:34:33.684 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:33 +0000 (0:00:00.060) 0:03:24.424 ******* 2019-12-09T09:34:33.952 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-09T09:34:33.953 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-09T09:34:34.005 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:34 +0000 (0:00:00.320) 0:03:24.744 ******* 2019-12-09T09:34:34.012 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-09T09:34:34.052 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:34 +0000 (0:00:00.047) 0:03:24.792 ******* 2019-12-09T09:34:34.321 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-09T09:34:34.328 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-12-09T09:34:34.369 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:34 +0000 (0:00:00.316) 0:03:25.109 ******* 2019-12-09T09:34:34.396 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-12-09T09:34:34.435 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:34 +0000 (0:00:00.065) 0:03:25.175 ******* 2019-12-09T09:34:34.685 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi121.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-09T09:34:34.725 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:34 +0000 (0:00:00.290) 0:03:25.465 ******* 2019-12-09T09:34:34.798 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-09T09:34:34.838 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:34 +0000 (0:00:00.112) 0:03:25.577 ******* 2019-12-09T09:34:35.708 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-09T09:34:35.709 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-12-09T09:34:35.768 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:35 +0000 (0:00:00.930) 0:03:26.508 ******* 2019-12-09T09:34:35.839 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-12-09T09:34:35.881 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:35 +0000 (0:00:00.112) 0:03:26.621 ******* 2019-12-09T09:34:36.718 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-12-09T09:34:36.757 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:36 +0000 (0:00:00.875) 0:03:27.496 ******* 2019-12-09T09:34:36.880 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-12-09T09:34:36.929 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:36 +0000 (0:00:00.172) 0:03:27.669 ******* 2019-12-09T09:34:39.164 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-09T09:34:39.165 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.087472", "end": "2019-12-09 09:34:39.130985", "rc": 0, "start": "2019-12-09 09:34:37.043513", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:34:39.230 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:39 +0000 (0:00:02.300) 0:03:29.970 ******* 2019-12-09T09:34:39.272 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-09T09:34:39.273 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-09T09:34:39.274 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.011273", "end": "2019-12-09 09:34:39.242799", "rc": 0, "start": "2019-12-09 09:34:37.231526", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:34:39.318 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:39 +0000 (0:00:00.087) 0:03:30.057 ******* 2019-12-09T09:34:39.377 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:39 +0000 (0:00:00.059) 0:03:30.117 ******* 2019-12-09T09:34:39.407 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-09T09:34:39.445 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:39 +0000 (0:00:00.068) 0:03:30.185 ******* 2019-12-09T09:34:40.328 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-09T09:34:40.330 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-12-09T09:34:40.353 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-12-09T09:34:41.247 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-12-09T09:34:41.290 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:41 +0000 (0:00:01.844) 0:03:32.030 ******* 2019-12-09T09:34:41.299 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-12-09T09:34:41.352 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:41 +0000 (0:00:00.061) 0:03:32.092 ******* 2019-12-09T09:34:41.359 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-12-09T09:34:41.360 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:34:41.403 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:41 +0000 (0:00:00.051) 0:03:32.143 ******* 2019-12-09T09:34:41.410 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:34:41.455 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:41 +0000 (0:00:00.051) 0:03:32.195 ******* 2019-12-09T09:34:41.462 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-09T09:34:41.462 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-09T09:34:41.474 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-09T09:34:41.525 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:41 +0000 (0:00:00.070) 0:03:32.265 ******* 2019-12-09T09:34:41.532 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-09T09:34:41.533 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-09T09:34:41.576 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:41 +0000 (0:00:00.050) 0:03:32.315 ******* 2019-12-09T09:34:41.581 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-12-09T09:34:41.583 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:34:41.622 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:41 +0000 (0:00:00.046) 0:03:32.361 ******* 2019-12-09T09:34:41.631 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:34:41.675 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:41 +0000 (0:00:00.053) 0:03:32.414 ******* 2019-12-09T09:34:41.681 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-09T09:34:41.682 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-12-09T09:34:41.723 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:41 +0000 (0:00:00.046) 0:03:32.461 ******* 2019-12-09T09:34:41.729 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-12-09T09:34:41.769 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:41 +0000 (0:00:00.047) 0:03:32.509 ******* 2019-12-09T09:34:42.195 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-12-09T09:34:42.197 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-12-09T09:34:42.243 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:42 +0000 (0:00:00.474) 0:03:32.983 ******* 2019-12-09T09:34:42.249 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-12-09T09:34:42.289 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:42 +0000 (0:00:00.045) 0:03:33.028 ******* 2019-12-09T09:34:42.899 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-12-09T09:34:42.900 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.292209", "end": "2019-12-09 09:34:42.860974", "rc": 0, "start": "2019-12-09 09:34:42.568765", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.fileplanet.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirrors.tripadvisor.com\n * updates: mirror.cogentco.com\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.fileplanet.com", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirrors.tripadvisor.com", " * updates: mirror.cogentco.com", "No unfinished transactions left."]} 2019-12-09T09:34:42.954 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:42 +0000 (0:00:00.664) 0:03:33.693 ******* 2019-12-09T09:34:42.977 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.311875", "end": "2019-12-09 09:34:42.910251", "rc": 0, "start": "2019-12-09 09:34:42.598376", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.fileplanet.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirrors.tripadvisor.com\n * updates: mirror.cogentco.com\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.fileplanet.com", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirrors.tripadvisor.com", " * updates: mirror.cogentco.com", "No unfinished transactions left."]} 2019-12-09T09:34:43.047 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:43 +0000 (0:00:00.093) 0:03:33.787 ******* 2019-12-09T09:34:43.301 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-12-09T09:34:43.303 INFO:teuthology.task.ansible.out:fatal: [smithi132.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.036241", "end": "2019-12-09 09:34:43.280058", "msg": "non-zero return code", "rc": 1, "start": "2019-12-09 09:34:43.243817", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-12-09T09:34:43.342 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:43 +0000 (0:00:00.294) 0:03:34.081 ******* 2019-12-09T09:34:43.379 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-12-09T09:34:43.380 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:34:43.422 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:43 +0000 (0:00:00.080) 0:03:34.162 ******* 2019-12-09T09:34:43.429 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-12-09T09:34:43.431 INFO:teuthology.task.ansible.out:fatal: [smithi121.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.034702", "end": "2019-12-09 09:34:43.366258", "msg": "non-zero return code", "rc": 1, "start": "2019-12-09 09:34:43.331556", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} 2019-12-09T09:34:43.432 INFO:teuthology.task.ansible.out:...ignoring 2019-12-09T09:34:43.476 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:43 +0000 (0:00:00.053) 0:03:34.216 ******* 2019-12-09T09:34:43.506 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:34:43.544 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:43 +0000 (0:00:00.067) 0:03:34.284 ******* 2019-12-09T09:34:51.668 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-09T09:34:51.669 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-12-09T09:34:51.671 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-12-09T09:34:51.672 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-09T09:34:51.722 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:51 +0000 (0:00:08.177) 0:03:42.461 ******* 2019-12-09T09:34:51.731 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-12-09T09:34:51.732 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-12-09T09:34:51.734 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-09T09:34:51.772 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:51 +0000 (0:00:00.050) 0:03:42.512 ******* 2019-12-09T09:34:55.168 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-09T09:34:55.169 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-12-09T09:34:55.215 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:55 +0000 (0:00:03.442) 0:03:45.954 ******* 2019-12-09T09:34:55.364 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-12-09T09:34:55.401 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:34:55 +0000 (0:00:00.186) 0:03:46.141 ******* 2019-12-09T09:35:13.438 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-09T09:35:13.439 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-12-09T09:35:13.441 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-12-09T09:35:13.443 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.fileplanet.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirrors.tripadvisor.com\n * updates: mirror.cogentco.com\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Re 2019-12-09T09:35:13.444 INFO:teuthology.task.ansible.out:solved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 16 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 2019-12-09T09:35:13.446 INFO:teuthology.task.ansible.out: 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.el7 2019-12-09T09:35:13.447 INFO:teuthology.task.ansible.out:.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-09T09:35:13.496 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:13 +0000 (0:00:18.095) 0:04:04.236 ******* 2019-12-09T09:35:13.660 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-12-09T09:35:13.662 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-12-09T09:35:13.663 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.fileplanet.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirrors.tripadvisor.com\n * updates: mirror.cogentco.com\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Re 2019-12-09T09:35:13.665 INFO:teuthology.task.ansible.out:solved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 20 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 2019-12-09T09:35:13.666 INFO:teuthology.task.ansible.out: 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-09T09:35:13.707 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:13 +0000 (0:00:00.210) 0:04:04.446 ******* 2019-12-09T09:35:14.293 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-12-09T09:35:14.365 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:14 +0000 (0:00:00.652) 0:04:05.099 ******* 2019-12-09T09:35:14.504 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-12-09T09:35:14.557 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:14 +0000 (0:00:00.197) 0:04:05.296 ******* 2019-12-09T09:35:14.920 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-09T09:35:14.922 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-12-09T09:35:14.963 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:14 +0000 (0:00:00.405) 0:04:05.702 ******* 2019-12-09T09:35:15.001 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-09T09:35:15.003 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:15.046 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:15 +0000 (0:00:00.083) 0:04:05.785 ******* 2019-12-09T09:35:15.110 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-09T09:35:15.111 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-12-09T09:35:15.149 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:15 +0000 (0:00:00.103) 0:04:05.889 ******* 2019-12-09T09:35:15.187 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:15.242 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:15 +0000 (0:00:00.092) 0:04:05.981 ******* 2019-12-09T09:35:15.522 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-12-09T09:35:15.524 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice polkit.service basic.target dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ipset.service ebtables.service iptables.service shutdown.target ip6tables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-12-09T09:35:15.525 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-12-09T09:35:15.527 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "system.slice network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-09T09:35:15.565 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:15 +0000 (0:00:00.323) 0:04:06.305 ******* 2019-12-09T09:35:15.661 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service dbus.service system.slice basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "iptables.service ip6tables.service shutdown.target ipset.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-12-09T09:35:15.662 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127510", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127510", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-12-09T09:35:15.664 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-09T09:35:15.715 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:15 +0000 (0:00:00.148) 0:04:06.455 ******* 2019-12-09T09:35:16.016 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-12-09T09:35:16.017 INFO:teuthology.task.ansible.out:fatal: [smithi132.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-12-09T09:35:16.055 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:16 +0000 (0:00:00.340) 0:04:06.795 ******* 2019-12-09T09:35:16.139 INFO:teuthology.task.ansible.out:fatal: [smithi121.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-12-09T09:35:16.184 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:16 +0000 (0:00:00.128) 0:04:06.923 ******* 2019-12-09T09:35:16.948 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-12-09T09:35:16.949 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-12-09T09:35:16.984 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:16 +0000 (0:00:00.800) 0:04:07.724 ******* 2019-12-09T09:35:16.992 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-12-09T09:35:17.030 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.045) 0:04:07.769 ******* 2019-12-09T09:35:17.036 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-12-09T09:35:17.038 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:17.075 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.044) 0:04:07.814 ******* 2019-12-09T09:35:17.085 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:17.129 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.054) 0:04:07.869 ******* 2019-12-09T09:35:17.141 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-12-09T09:35:17.185 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.056) 0:04:07.925 ******* 2019-12-09T09:35:17.242 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.056) 0:04:07.982 ******* 2019-12-09T09:35:17.248 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-12-09T09:35:17.250 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:17.290 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.047) 0:04:08.030 ******* 2019-12-09T09:35:17.297 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:17.336 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.045) 0:04:08.075 ******* 2019-12-09T09:35:17.342 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:17.382 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.046) 0:04:08.121 ******* 2019-12-09T09:35:17.389 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:17.428 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.046) 0:04:08.168 ******* 2019-12-09T09:35:17.434 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-12-09T09:35:17.436 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi121.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:17.488 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.059) 0:04:08.227 ******* 2019-12-09T09:35:17.495 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:17.497 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:17.539 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.051) 0:04:08.278 ******* 2019-12-09T09:35:17.545 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-12-09T09:35:17.546 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:17.600 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.060) 0:04:08.339 ******* 2019-12-09T09:35:17.611 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:17.650 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.050) 0:04:08.390 ******* 2019-12-09T09:35:17.660 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-12-09T09:35:17.714 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.064) 0:04:08.454 ******* 2019-12-09T09:35:17.786 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.071) 0:04:08.525 ******* 2019-12-09T09:35:17.791 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-12-09T09:35:17.794 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:17.831 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.045) 0:04:08.571 ******* 2019-12-09T09:35:17.838 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:17.878 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.046) 0:04:08.617 ******* 2019-12-09T09:35:17.896 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:17.935 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.057) 0:04:08.675 ******* 2019-12-09T09:35:17.942 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:17.988 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:17 +0000 (0:00:00.052) 0:04:08.728 ******* 2019-12-09T09:35:17.994 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-12-09T09:35:17.997 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.034 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.045) 0:04:08.773 ******* 2019-12-09T09:35:18.041 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.083 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.047) 0:04:08.821 ******* 2019-12-09T09:35:18.087 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-09T09:35:18.092 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.130 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.048) 0:04:08.869 ******* 2019-12-09T09:35:18.139 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.180 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.050) 0:04:08.919 ******* 2019-12-09T09:35:18.186 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-12-09T09:35:18.188 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.228 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.048) 0:04:08.968 ******* 2019-12-09T09:35:18.236 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.284 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.055) 0:04:09.023 ******* 2019-12-09T09:35:18.293 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-09T09:35:18.294 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.333 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.049) 0:04:09.073 ******* 2019-12-09T09:35:18.339 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.380 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.046) 0:04:09.119 ******* 2019-12-09T09:35:18.393 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.435 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.055) 0:04:09.175 ******* 2019-12-09T09:35:18.442 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.483 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.047) 0:04:09.222 ******* 2019-12-09T09:35:18.492 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.531 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.048) 0:04:09.271 ******* 2019-12-09T09:35:18.539 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.609 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.077) 0:04:09.348 ******* 2019-12-09T09:35:18.615 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-12-09T09:35:18.617 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.664 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.055) 0:04:09.404 ******* 2019-12-09T09:35:18.676 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.722 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.058) 0:04:09.462 ******* 2019-12-09T09:35:18.728 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-12-09T09:35:18.729 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.776 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.047) 0:04:09.509 ******* 2019-12-09T09:35:18.779 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.816 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.045) 0:04:09.555 ******* 2019-12-09T09:35:18.822 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-12-09T09:35:18.824 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.865 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.049) 0:04:09.604 ******* 2019-12-09T09:35:18.872 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.910 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.044) 0:04:09.649 ******* 2019-12-09T09:35:18.919 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-12-09T09:35:18.920 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:18.962 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:18 +0000 (0:00:00.052) 0:04:09.702 ******* 2019-12-09T09:35:18.973 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.036 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.073) 0:04:09.776 ******* 2019-12-09T09:35:19.045 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-12-09T09:35:19.046 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.089 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.052) 0:04:09.828 ******* 2019-12-09T09:35:19.096 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.140 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.051) 0:04:09.880 ******* 2019-12-09T09:35:19.146 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-12-09T09:35:19.148 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.188 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.046) 0:04:09.926 ******* 2019-12-09T09:35:19.197 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.236 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.049) 0:04:09.975 ******* 2019-12-09T09:35:19.242 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.281 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.045) 0:04:10.021 ******* 2019-12-09T09:35:19.287 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.329 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.048) 0:04:10.069 ******* 2019-12-09T09:35:19.337 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-09T09:35:19.339 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.379 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.048) 0:04:10.117 ******* 2019-12-09T09:35:19.388 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.443 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.065) 0:04:10.182 ******* 2019-12-09T09:35:19.463 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-09T09:35:19.465 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.504 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.060) 0:04:10.243 ******* 2019-12-09T09:35:19.511 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.550 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.046) 0:04:10.289 ******* 2019-12-09T09:35:19.556 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-09T09:35:19.558 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.604 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.054) 0:04:10.344 ******* 2019-12-09T09:35:19.612 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.661 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.056) 0:04:10.400 ******* 2019-12-09T09:35:19.668 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-09T09:35:19.670 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.715 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.053) 0:04:10.454 ******* 2019-12-09T09:35:19.724 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.774 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.059) 0:04:10.514 ******* 2019-12-09T09:35:19.781 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-09T09:35:19.784 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.824 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.050) 0:04:10.564 ******* 2019-12-09T09:35:19.831 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.887 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.062) 0:04:10.627 ******* 2019-12-09T09:35:19.899 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-09T09:35:19.901 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:19.943 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.056) 0:04:10.683 ******* 2019-12-09T09:35:19.951 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:20.002 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:19 +0000 (0:00:00.058) 0:04:10.741 ******* 2019-12-09T09:35:20.008 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-09T09:35:20.009 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:20.053 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:20 +0000 (0:00:00.051) 0:04:10.793 ******* 2019-12-09T09:35:20.061 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:20.100 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:20 +0000 (0:00:00.046) 0:04:10.840 ******* 2019-12-09T09:35:20.108 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-09T09:35:20.110 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:20.156 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:20 +0000 (0:00:00.050) 0:04:10.890 ******* 2019-12-09T09:35:20.158 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:20.200 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:20 +0000 (0:00:00.049) 0:04:10.939 ******* 2019-12-09T09:35:20.205 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-09T09:35:20.207 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:20.248 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:20 +0000 (0:00:00.048) 0:04:10.988 ******* 2019-12-09T09:35:20.257 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:20.295 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:20 +0000 (0:00:00.046) 0:04:11.034 ******* 2019-12-09T09:35:20.300 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-09T09:35:20.302 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:20.341 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:20 +0000 (0:00:00.046) 0:04:11.080 ******* 2019-12-09T09:35:20.350 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:20.390 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:20 +0000 (0:00:00.047) 0:04:11.128 ******* 2019-12-09T09:35:20.394 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-09T09:35:20.394 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:20.435 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:20 +0000 (0:00:00.047) 0:04:11.175 ******* 2019-12-09T09:35:20.442 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:20.489 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:20 +0000 (0:00:00.049) 0:04:11.225 ******* 2019-12-09T09:35:20.792 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-09T09:35:20.792 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-12-09T09:35:20.832 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:20 +0000 (0:00:00.347) 0:04:11.572 ******* 2019-12-09T09:35:20.847 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-12-09T09:35:20.907 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:20 +0000 (0:00:00.074) 0:04:11.646 ******* 2019-12-09T09:35:21.245 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-09T09:35:21.245 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-09T09:35:21.298 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:21 +0000 (0:00:00.391) 0:04:12.038 ******* 2019-12-09T09:35:21.307 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-09T09:35:21.350 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:21 +0000 (0:00:00.051) 0:04:12.089 ******* 2019-12-09T09:35:21.639 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-09T09:35:21.641 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-12-09T09:35:21.685 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:21 +0000 (0:00:00.333) 0:04:12.423 ******* 2019-12-09T09:35:21.694 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-12-09T09:35:21.737 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:21 +0000 (0:00:00.052) 0:04:12.476 ******* 2019-12-09T09:35:21.743 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-09T09:35:21.744 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:21.800 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:21 +0000 (0:00:00.063) 0:04:12.540 ******* 2019-12-09T09:35:21.813 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:21.856 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:21 +0000 (0:00:00.055) 0:04:12.595 ******* 2019-12-09T09:35:21.861 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-09T09:35:21.861 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:21.901 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:21 +0000 (0:00:00.045) 0:04:12.641 ******* 2019-12-09T09:35:21.916 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:21.955 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:21 +0000 (0:00:00.053) 0:04:12.694 ******* 2019-12-09T09:35:21.960 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-09T09:35:21.962 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.007 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.052) 0:04:12.746 ******* 2019-12-09T09:35:22.234 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 09 December 2019 09:35:22 +0000 (0:00:00.048) 0:04:12.795 ******* TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 09 December 2019 09:35:22 +0000 (0:00:00.045) 0:04:12.840 ******* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 09 December 2019 09:35:22 +0000 (0:00:00.045) 0:04:12.885 ******* TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 09 December 2019 09:35:22 +0000 (0:00:00.045) 0:04:12.930 ******* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.236 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.044) 0:04:12.975 ******* 2019-12-09T09:35:22.241 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-09T09:35:22.243 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.281 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.044) 0:04:13.020 ******* 2019-12-09T09:35:22.288 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.326 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.045) 0:04:13.066 ******* 2019-12-09T09:35:22.332 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-09T09:35:22.334 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.376 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.044) 0:04:13.111 ******* 2019-12-09T09:35:22.380 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.417 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.046) 0:04:13.157 ******* 2019-12-09T09:35:22.424 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-09T09:35:22.424 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.477 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.059) 0:04:13.217 ******* 2019-12-09T09:35:22.484 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.523 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.045) 0:04:13.262 ******* 2019-12-09T09:35:22.529 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-09T09:35:22.530 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.573 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.050) 0:04:13.313 ******* 2019-12-09T09:35:22.580 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.619 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.045) 0:04:13.359 ******* 2019-12-09T09:35:22.627 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-12-09T09:35:22.629 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.669 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.050) 0:04:13.409 ******* 2019-12-09T09:35:22.676 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.714 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.044) 0:04:13.453 ******* 2019-12-09T09:35:22.719 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-12-09T09:35:22.720 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.758 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.044) 0:04:13.498 ******* 2019-12-09T09:35:22.764 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.804 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.045) 0:04:13.544 ******* 2019-12-09T09:35:22.810 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-09T09:35:22.812 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.850 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.046) 0:04:13.590 ******* 2019-12-09T09:35:22.859 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.894 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.044) 0:04:13.634 ******* 2019-12-09T09:35:22.900 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-09T09:35:22.901 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.939 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.044) 0:04:13.678 ******* 2019-12-09T09:35:22.947 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:22.984 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:22 +0000 (0:00:00.045) 0:04:13.724 ******* 2019-12-09T09:35:22.990 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-12-09T09:35:22.991 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:23.039 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:23 +0000 (0:00:00.054) 0:04:13.778 ******* 2019-12-09T09:35:23.045 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:23.087 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:23 +0000 (0:00:00.048) 0:04:13.827 ******* 2019-12-09T09:35:23.089 INFO:teuthology.task.ansible.out: 2019-12-09T09:35:23.093 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-12-09T09:35:23.095 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:23.132 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:23 +0000 (0:00:00.044) 0:04:13.871 ******* 2019-12-09T09:35:23.139 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:23.189 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:23 +0000 (0:00:00.057) 0:04:13.929 ******* 2019-12-09T09:35:23.197 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-12-09T09:35:23.198 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:23.236 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:23 +0000 (0:00:00.046) 0:04:13.975 ******* 2019-12-09T09:35:23.242 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:23.283 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:23 +0000 (0:00:00.047) 0:04:14.022 ******* 2019-12-09T09:35:23.288 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-12-09T09:35:23.289 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:23.333 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:23 +0000 (0:00:00.050) 0:04:14.072 ******* 2019-12-09T09:35:23.339 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:23.378 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:23 +0000 (0:00:00.045) 0:04:14.118 ******* 2019-12-09T09:35:23.387 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:23.651 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:23 +0000 (0:00:00.046) 0:04:14.164 ******* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 09 December 2019 09:35:23 +0000 (0:00:00.046) 0:04:14.211 ******* TASK [testnode : Stop collectl] ************************************************ skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 09 December 2019 09:35:23 +0000 (0:00:00.044) 0:04:14.256 ******* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 09 December 2019 09:35:23 +0000 (0:00:00.045) 0:04:14.302 ******* TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 09 December 2019 09:35:23 +0000 (0:00:00.047) 0:04:14.349 ******* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:23.659 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:23 +0000 (0:00:00.049) 0:04:14.399 ******* 2019-12-09T09:35:23.667 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:23.704 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:23 +0000 (0:00:00.045) 0:04:14.444 ******* 2019-12-09T09:35:23.711 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:23.752 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:23 +0000 (0:00:00.047) 0:04:14.491 ******* 2019-12-09T09:35:23.758 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-12-09T09:35:23.760 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:23.801 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:23 +0000 (0:00:00.049) 0:04:14.541 ******* 2019-12-09T09:35:23.808 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:23.850 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:23 +0000 (0:00:00.048) 0:04:14.589 ******* 2019-12-09T09:35:23.856 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-09T09:35:23.857 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-09T09:35:23.908 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:23 +0000 (0:00:00.057) 0:04:14.647 ******* 2019-12-09T09:35:23.918 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-09T09:35:23.996 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:23 +0000 (0:00:00.088) 0:04:14.735 ******* 2019-12-09T09:35:24.003 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-12-09T09:35:24.005 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.007 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-09T09:35:24.008 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi121.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.010 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi121.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.011 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.068 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:24 +0000 (0:00:00.072) 0:04:14.807 ******* 2019-12-09T09:35:24.075 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.077 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-09T09:35:24.078 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.089 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.100 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.112 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.155 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:24 +0000 (0:00:00.086) 0:04:14.894 ******* 2019-12-09T09:35:24.232 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi121.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004350", "end": "2019-12-09 09:35:24.211052", "rc": 0, "start": "2019-12-09 09:35:24.206702", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-09T09:35:24.272 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:24 +0000 (0:00:00.117) 0:04:15.012 ******* 2019-12-09T09:35:24.310 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-12-09T09:35:24.312 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.360 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:24 +0000 (0:00:00.087) 0:04:15.099 ******* 2019-12-09T09:35:24.367 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-12-09T09:35:24.368 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004948", "end": "2019-12-09 09:35:24.302632", "rc": 0, "start": "2019-12-09 09:35:24.297684", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-09T09:35:24.414 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:24 +0000 (0:00:00.054) 0:04:15.154 ******* 2019-12-09T09:35:24.420 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-12-09T09:35:24.421 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.476 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:24 +0000 (0:00:00.060) 0:04:15.214 ******* 2019-12-09T09:35:24.481 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-12-09T09:35:24.483 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.528 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:24 +0000 (0:00:00.052) 0:04:15.267 ******* 2019-12-09T09:35:24.533 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-12-09T09:35:24.534 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.573 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:24 +0000 (0:00:00.045) 0:04:15.313 ******* 2019-12-09T09:35:24.579 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-12-09T09:35:24.580 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.643 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:24 +0000 (0:00:00.069) 0:04:15.383 ******* 2019-12-09T09:35:24.650 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-12-09T09:35:24.651 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.713 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:24 +0000 (0:00:00.070) 0:04:15.453 ******* 2019-12-09T09:35:24.722 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-12-09T09:35:24.723 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.774 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:24 +0000 (0:00:00.060) 0:04:15.513 ******* 2019-12-09T09:35:24.776 INFO:teuthology.task.ansible.out: 2019-12-09T09:35:24.808 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:24.849 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:24 +0000 (0:00:00.074) 0:04:15.589 ******* 2019-12-09T09:35:25.193 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-12-09T09:35:25.194 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-12-09T09:35:25.240 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:25 +0000 (0:00:00.390) 0:04:15.979 ******* 2019-12-09T09:35:25.292 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi121.front.sepia.ceph.com] => (item={u'block_used': 13040432, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284052, u'size_available': 930955476992, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966954, u'device': u'/dev/sda1', u'inode_used': 88022, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284052, "block_size": 4096, "block_total": 240324484, "block_used": 13040432, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966954, "inode_total": 61054976, "inode_used": 88022, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955476992, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-12-09T09:35:25.335 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:25 +0000 (0:00:00.094) 0:04:16.074 ******* 2019-12-09T09:35:25.336 INFO:teuthology.task.ansible.out: 2019-12-09T09:35:25.342 INFO:teuthology.task.ansible.out: 2019-12-09T09:35:25.344 INFO:teuthology.task.ansible.out:TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-12-09T09:35:25.404 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:25 +0000 (0:00:00.068) 0:04:16.143 ******* 2019-12-09T09:35:25.463 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-09T09:35:25.463 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={u'block_used': 13040430, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284054, u'size_available': 930955485184, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966954, u'device': u'/dev/sda1', u'inode_used': 88022, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284054, "block_size": 4096, "block_total": 240324484, "block_used": 13040430, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966954, "inode_total": 61054976, "inode_used": 88022, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955485184, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-12-09T09:35:25.532 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:25 +0000 (0:00:00.128) 0:04:16.272 ******* 2019-12-09T09:35:25.724 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-12-09T09:35:25.725 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.012137", "end": "2019-12-09 09:35:25.691212", "rc": 0, "start": "2019-12-09 09:35:25.679075", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:25.767 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:25 +0000 (0:00:00.234) 0:04:16.507 ******* 2019-12-09T09:35:25.824 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi121.front.sepia.ceph.com] => (item={u'block_used': 13040432, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284052, u'size_available': 930955476992, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966954, u'device': u'/dev/sda1', u'inode_used': 88022, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284052, "block_size": 4096, "block_total": 240324484, "block_used": 13040432, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966954, "inode_total": 61054976, "inode_used": 88022, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955476992, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:25.868 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:25 +0000 (0:00:00.100) 0:04:16.607 ******* 2019-12-09T09:35:25.880 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-12-09T09:35:25.881 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.014098", "end": "2019-12-09 09:35:25.834879", "rc": 0, "start": "2019-12-09 09:35:25.820781", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:25.947 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:25 +0000 (0:00:00.077) 0:04:16.684 ******* 2019-12-09T09:35:25.951 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-09T09:35:26.001 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:25 +0000 (0:00:00.055) 0:04:16.740 ******* 2019-12-09T09:35:26.008 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-12-09T09:35:26.009 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'block_used': 13040430, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284054, u'size_available': 930955485184, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966954, u'device': u'/dev/sda1', u'inode_used': 88022, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284054, "block_size": 4096, "block_total": 240324484, "block_used": 13040430, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966954, "inode_total": 61054976, "inode_used": 88022, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955485184, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:26.056 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:26 +0000 (0:00:00.052) 0:04:16.792 ******* 2019-12-09T09:35:26.071 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-09T09:35:26.073 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QGN9', u'wwn-0x5000c50091dfb8e9'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QGN9', u'wwn': u'0x5000c50091dfb8e9', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QGN9-part1', u'wwn-0x5000c50091dfb8e9-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QGN9", "wwn-0x5000c50091dfb8e9"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QGN9-part1", "wwn-0x5000c50091dfb8e9-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QGN9", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-09T09:35:26.075 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50091dfb8e9"}}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:26.089 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-09T09:35:26.136 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:26 +0000 (0:00:00.083) 0:04:16.876 ******* 2019-12-09T09:35:26.186 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-09T09:35:26.188 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XM6D', u'wwn-0x5000c500929332c1'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XM6D', u'wwn': u'0x5000c500929332c1', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XM6D-part1', u'wwn-0x5000c500929332c1-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XM6D", "wwn-0x5000c500929332c1"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XM6D-part1", "wwn-0x5000c500929332c1-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XM6D", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-09T09:35:26.189 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c500929332c1"}}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:27.910 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-WbGY0n-UU4J-rw0r-49N9-zohR-FE6C-7PReCZ', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400ZF400BGN', u'nvme-nvme.8086-504846543632303430305a4634303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'PHFT620400ZF400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.537644", "end": "2019-12-09 09:35:27.856294", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-WbGY0n-UU4J-rw0r-49N9-zohR-FE6C-7PReCZ", "nvme-INTEL_SSDPEDMD400G4_PHFT620400ZF400BGN", "nvme-nvme.8086-504846543632303430305a4634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "PHFT620400ZF400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:26.318 2019-12-09T09:35:27.911 INFO:teuthology.task.ansible.out:650", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T09:35:28.109 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-ugr5y6-8jbj-d24o-l28L-9rY2-bCzA-Gw3j6N', u'nvme-INTEL_SSDPEDMD400G4_CVFT6232000B400BGN', u'nvme-nvme.8086-43564654363233323030304234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'CVFT6232000B400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.554975", "end": "2019-12-09 09:35:28.065885", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-ugr5y6-8jbj-d24o-l28L-9rY2-bCzA-Gw3j6N", "nvme-INTEL_SSDPEDMD400G4_CVFT6232000B400BGN", "nvme-nvme.8086-43564654363233323030304234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "CVFT6232000B400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:26.510 2019-12-09T09:35:28.111 INFO:teuthology.task.ansible.out:910", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T09:35:29.323 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGIyJJpjclfp6Au1G5AJegTCP1MlQ0giUw'], u'uuids': [u'e42309c1-7a5e-47fa-b237-8b3ca5610718']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620400ZF400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.070149", "end": "2019-12-09 09:35:29.275189", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGIyJJpjclfp6Au1G5AJegTCP1MlQ0giUw"], "labels": [], "masters": [], "uuids": ["e42309c1-7a5e-47fa-b237-8b3ca5610718"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620400ZF400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:28.205040", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T09:35:29.515 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbdGyU2jAW2ZGvtnLSo3msUra8LIx7gjW2M'], u'uuids': [u'055032d5-0816-4af3-8810-4041eba5bc6b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6232000B400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.067321", "end": "2019-12-09 09:35:29.469390", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbdGyU2jAW2ZGvtnLSo3msUra8LIx7gjW2M"], "labels": [], "masters": [], "uuids": ["055032d5-0816-4af3-8810-4041eba5bc6b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT6232000B400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:28.402069", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T09:35:30.668 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGizgYDeV4bcnL9SouBOuuP3baXd5vrQqZ'], u'uuids': [u'e15abda0-22c8-4e13-b66d-fad138cb325c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620400ZF400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.056043", "end": "2019-12-09 09:35:30.631893", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGizgYDeV4bcnL9SouBOuuP3baXd5vrQqZ"], "labels": [], "masters": [], "uuids": ["e15abda0-22c8-4e13-b66d-fad138cb325c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620400ZF400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:29.575850", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T09:35:30.908 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbd76SCzo8NkfdSZycQ6925ePiuvSbgvmdV'], u'uuids': [u'ae037a95-034f-43cd-840a-e4b94904eddd']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6232000B400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.070612", "end": "2019-12-09 09:35:30.868813", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbd76SCzo8NkfdSZycQ6925ePiuvSbgvmdV"], "labels": [], "masters": [], "uuids": ["ae037a95-034f-43cd-840a-e4b94904eddd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT6232000B400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:29.798201", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T09:35:32.058 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGk4cJWKxwa1CeVqp0Deu8e67BspDZSZNh'], u'uuids': [u'e327b318-7594-4ee9-a1ef-9a218a244522']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620400ZF400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.061952", "end": "2019-12-09 09:35:32.007716", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGk4cJWKxwa1CeVqp0Deu8e67BspDZSZNh"], "labels": [], "masters": [], "uuids": ["e327b318-7594-4ee9-a1ef-9a218a244522"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620400ZF400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:30.945764", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T09:35:32.296 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbdUz3aA2tp5AngPk4re3eLN9gBtIjvlEsq'], u'uuids': [u'f1889885-9f16-428a-8f89-a1dd1a28c3c2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6232000B400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.066742", "end": "2019-12-09 09:35:32.254663", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbdUz3aA2tp5AngPk4re3eLN9gBtIjvlEsq"], "labels": [], "masters": [], "uuids": ["f1889885-9f16-428a-8f89-a1dd1a28c3c2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT6232000B400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:31.187921", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T09:35:33.438 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGpGk2CMUkfJSnGC9v0veoQy1qoGi95p7S'], u'uuids': [u'b3232340-9042-4fba-a78d-928d56e225b5']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620400ZF400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.065071", "end": "2019-12-09 09:35:33.400465", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGpGk2CMUkfJSnGC9v0veoQy1qoGi95p7S"], "labels": [], "masters": [], "uuids": ["b3232340-9042-4fba-a78d-928d56e225b5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "PHFT620400ZF400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:32.335394", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T09:35:33.729 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbdWHZx4ZxDYjDq51kGuR5dZBT8Kw7sje8F'], u'uuids': [u'649c6d24-5e5f-4597-81cd-bd421f17eade']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6232000B400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.092741", "end": "2019-12-09 09:35:33.687384", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbdWHZx4ZxDYjDq51kGuR5dZBT8Kw7sje8F"], "labels": [], "masters": [], "uuids": ["649c6d24-5e5f-4597-81cd-bd421f17eade"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVFT6232000B400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:32.594643", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T09:35:34.797 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGhcZ2n0s27iXTWRzMU10JbGJbBJK33emi'], u'uuids': [u'2a25a42f-296a-49aa-851c-dff4adcd4925']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620400ZF400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.047490", "end": "2019-12-09 09:35:34.757877", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGhcZ2n0s27iXTWRzMU10JbGJbBJK33emi"], "labels": [], "masters": [], "uuids": ["2a25a42f-296a-49aa-851c-dff4adcd4925"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620400ZF400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:33.710387", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T09:35:34.847 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:34 +0000 (0:00:08.710) 0:04:25.587 ******* 2019-12-09T09:35:34.901 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-09T09:35:34.903 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QGN9', u'wwn-0x5000c50091dfb8e9'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QGN9', u'wwn': u'0x5000c50091dfb8e9', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QGN9-part1', u'wwn-0x5000c50091dfb8e9-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QGN9", "wwn-0x5000c50091dfb8e9"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QGN9-part1", "wwn-0x5000c50091dfb8e9-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QGN9", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-09T09:35:34.904 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50091dfb8e9"}}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:35.119 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-09T09:35:35.120 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbdvQJNaMCWomug52DkHEeXLII79qKhrfdT'], u'uuids': [u'8900cc2f-a2e9-468b-a37b-759c9cdda72d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6232000B400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.056844", "end": "2019-12-09 09:35:35.086295", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbdvQJNaMCWomug52DkHEeXLII79qKhrfdT"], "labels": [], "masters": [], "uuids": ["8900cc2f-a2e9-468b-a37b-759c9cdda72d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT6232000B400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:34.029451", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-09T09:35:35.195 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:35 +0000 (0:00:00.347) 0:04:25.934 ******* 2019-12-09T09:35:35.232 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-09T09:35:35.234 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XM6D', u'wwn-0x5000c500929332c1'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XM6D', u'wwn': u'0x5000c500929332c1', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XM6D-part1', u'wwn-0x5000c500929332c1-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XM6D", "wwn-0x5000c500929332c1"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XM6D-part1", "wwn-0x5000c500929332c1-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XM6D", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-09T09:35:35.236 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c500929332c1"}}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:35.265 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-WbGY0n-UU4J-rw0r-49N9-zohR-FE6C-7PReCZ', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400ZF400BGN', u'nvme-nvme.8086-504846543632303430305a4634303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'PHFT620400ZF400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.055523", "end": "2019-12-09 09:35:35.232837", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-WbGY0n-UU4J-rw0r-49N9-zohR-FE6C-7PReCZ", "nvme-INTEL_SSDPEDMD400G4_PHFT620400ZF400BGN", "nvme-nvme.8086-504846543632303430305a4634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "PHFT620400ZF400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:35.177314", "stderr": 2019-12-09T09:35:35.266 INFO:teuthology.task.ansible.out: "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0496571 s, 2.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0496571 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:35.629 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-ugr5y6-8jbj-d24o-l28L-9rY2-bCzA-Gw3j6N', u'nvme-INTEL_SSDPEDMD400G4_CVFT6232000B400BGN', u'nvme-nvme.8086-43564654363233323030304234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'CVFT6232000B400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.085806", "end": "2019-12-09 09:35:35.592719", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-ugr5y6-8jbj-d24o-l28L-9rY2-bCzA-Gw3j6N", "nvme-INTEL_SSDPEDMD400G4_CVFT6232000B400BGN", "nvme-nvme.8086-43564654363233323030304234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "CVFT6232000B400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:35.506913", "stderr": 2019-12-09T09:35:35.631 INFO:teuthology.task.ansible.out: "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0792746 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0792746 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:35.694 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGIyJJpjclfp6Au1G5AJegTCP1MlQ0giUw'], u'uuids': [u'e42309c1-7a5e-47fa-b237-8b3ca5610718']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620400ZF400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.191908", "end": "2019-12-09 09:35:35.657598", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGIyJJpjclfp6Au1G5AJegTCP1MlQ0giUw"], "labels": [], "masters": [], "uuids": ["e42309c1-7a5e-47fa-b237-8b3ca5610718"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620400ZF400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:35.465690", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.186056 s, 620 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.186056 s, 620 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:36.092 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbdGyU2jAW2ZGvtnLSo3msUra8LIx7gjW2M'], u'uuids': [u'055032d5-0816-4af3-8810-4041eba5bc6b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6232000B400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.197646", "end": "2019-12-09 09:35:36.063528", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbdGyU2jAW2ZGvtnLSo3msUra8LIx7gjW2M"], "labels": [], "masters": [], "uuids": ["055032d5-0816-4af3-8810-4041eba5bc6b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT6232000B400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:35.865882", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.19127 s, 603 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.19127 s, 603 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:36.148 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGizgYDeV4bcnL9SouBOuuP3baXd5vrQqZ'], u'uuids': [u'e15abda0-22c8-4e13-b66d-fad138cb325c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620400ZF400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.169529", "end": "2019-12-09 09:35:36.115245", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGizgYDeV4bcnL9SouBOuuP3baXd5vrQqZ"], "labels": [], "masters": [], "uuids": ["e15abda0-22c8-4e13-b66d-fad138cb325c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620400ZF400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:35.945716", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.16415 s, 703 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.16415 s, 703 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:36.585 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbd76SCzo8NkfdSZycQ6925ePiuvSbgvmdV'], u'uuids': [u'ae037a95-034f-43cd-840a-e4b94904eddd']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6232000B400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.177346", "end": "2019-12-09 09:35:36.549624", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbd76SCzo8NkfdSZycQ6925ePiuvSbgvmdV"], "labels": [], "masters": [], "uuids": ["ae037a95-034f-43cd-840a-e4b94904eddd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT6232000B400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:36.372278", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.171726 s, 672 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.171726 s, 672 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:36.607 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGk4cJWKxwa1CeVqp0Deu8e67BspDZSZNh'], u'uuids': [u'e327b318-7594-4ee9-a1ef-9a218a244522']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620400ZF400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.174795", "end": "2019-12-09 09:35:36.567312", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGk4cJWKxwa1CeVqp0Deu8e67BspDZSZNh"], "labels": [], "masters": [], "uuids": ["e327b318-7594-4ee9-a1ef-9a218a244522"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620400ZF400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:36.392517", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.169243 s, 682 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.169243 s, 682 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:37.059 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbdUz3aA2tp5AngPk4re3eLN9gBtIjvlEsq'], u'uuids': [u'f1889885-9f16-428a-8f89-a1dd1a28c3c2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6232000B400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.166265", "end": "2019-12-09 09:35:37.018153", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbdUz3aA2tp5AngPk4re3eLN9gBtIjvlEsq"], "labels": [], "masters": [], "uuids": ["f1889885-9f16-428a-8f89-a1dd1a28c3c2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT6232000B400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:36.851888", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.160242 s, 720 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.160242 s, 720 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:37.112 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGpGk2CMUkfJSnGC9v0veoQy1qoGi95p7S'], u'uuids': [u'b3232340-9042-4fba-a78d-928d56e225b5']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620400ZF400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.198971", "end": "2019-12-09 09:35:37.076949", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGpGk2CMUkfJSnGC9v0veoQy1qoGi95p7S"], "labels": [], "masters": [], "uuids": ["b3232340-9042-4fba-a78d-928d56e225b5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "PHFT620400ZF400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:36.877978", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.19228 s, 600 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.19228 s, 600 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:37.540 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbdWHZx4ZxDYjDq51kGuR5dZBT8Kw7sje8F'], u'uuids': [u'649c6d24-5e5f-4597-81cd-bd421f17eade']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6232000B400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.178911", "end": "2019-12-09 09:35:37.499406", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbdWHZx4ZxDYjDq51kGuR5dZBT8Kw7sje8F"], "labels": [], "masters": [], "uuids": ["649c6d24-5e5f-4597-81cd-bd421f17eade"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVFT6232000B400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:37.320495", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.173028 s, 667 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.173028 s, 667 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:37.656 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGhcZ2n0s27iXTWRzMU10JbGJbBJK33emi'], u'uuids': [u'2a25a42f-296a-49aa-851c-dff4adcd4925']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT620400ZF400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.218121", "end": "2019-12-09 09:35:37.611881", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-oPxcEbbLhverxAYeUJCiSgvhJmhJyIoGhcZ2n0s27iXTWRzMU10JbGJbBJK33emi"], "labels": [], "masters": [], "uuids": ["2a25a42f-296a-49aa-851c-dff4adcd4925"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT620400ZF400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:37.393760", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.211494 s, 545 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.211494 s, 545 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:37.711 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:37 +0000 (0:00:02.516) 0:04:28.451 ******* 2019-12-09T09:35:38.069 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbdvQJNaMCWomug52DkHEeXLII79qKhrfdT'], u'uuids': [u'8900cc2f-a2e9-468b-a37b-759c9cdda72d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVFT6232000B400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.199714", "end": "2019-12-09 09:35:38.028513", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-HGHKIqls3hE4MqGl7ypqgw2zV1GDHjbdvQJNaMCWomug52DkHEeXLII79qKhrfdT"], "labels": [], "masters": [], "uuids": ["8900cc2f-a2e9-468b-a37b-759c9cdda72d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVFT6232000B400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-09 09:35:37.828799", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.193198 s, 597 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.193198 s, 597 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:38.115 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:38 +0000 (0:00:00.404) 0:04:28.855 ******* 2019-12-09T09:35:38.121 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi121.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.096736", "end": "2019-12-09 09:35:38.079854", "rc": 0, "start": "2019-12-09 09:35:37.983118", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:38.168 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:38 +0000 (0:00:00.045) 0:04:28.901 ******* 2019-12-09T09:35:38.490 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-12-09T09:35:38.492 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.048178", "end": "2019-12-09 09:35:38.462738", "rc": 0, "start": "2019-12-09 09:35:38.414560", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:38.529 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:38 +0000 (0:00:00.367) 0:04:29.268 ******* 2019-12-09T09:35:38.535 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-12-09T09:35:38.536 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.092328", "end": "2019-12-09 09:35:38.491469", "rc": 0, "start": "2019-12-09 09:35:38.399141", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:38.574 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:38 +0000 (0:00:00.045) 0:04:29.314 ******* 2019-12-09T09:35:38.581 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-09T09:35:38.624 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:38 +0000 (0:00:00.049) 0:04:29.363 ******* 2019-12-09T09:35:38.662 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-12-09T09:35:38.663 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:38.703 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:38 +0000 (0:00:00.079) 0:04:29.442 ******* 2019-12-09T09:35:38.736 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:38.771 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:38 +0000 (0:00:00.068) 0:04:29.511 ******* 2019-12-09T09:35:38.818 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-09T09:35:38.821 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:38.858 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:38 +0000 (0:00:00.086) 0:04:29.597 ******* 2019-12-09T09:35:38.912 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-12-09T09:35:38.914 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:38.952 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:38 +0000 (0:00:00.093) 0:04:29.691 ******* 2019-12-09T09:35:38.971 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-12-09T09:35:38.971 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.067878", "end": "2019-12-09 09:35:38.933960", "rc": 0, "start": "2019-12-09 09:35:38.866082", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:39.020 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:39 +0000 (0:00:00.068) 0:04:29.760 ******* 2019-12-09T09:35:39.048 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-09T09:35:39.103 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:39 +0000 (0:00:00.082) 0:04:29.842 ******* 2019-12-09T09:35:39.142 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-12-09T09:35:39.144 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:39.196 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:39 +0000 (0:00:00.093) 0:04:29.936 ******* 2019-12-09T09:35:39.248 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-12-09T09:35:39.249 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:39.300 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:39 +0000 (0:00:00.099) 0:04:30.036 ******* 2019-12-09T09:35:39.304 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-09T09:35:39.306 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T09:35:39.360 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:39 +0000 (0:00:00.063) 0:04:30.099 ******* 2019-12-09T09:35:39.370 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-09T09:35:39.371 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:39.433 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:39 +0000 (0:00:00.065) 0:04:30.165 ******* TASK [testnode : Set root disk] ************************************************ 2019-12-09T09:35:39.434 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={u'block_used': 13040432, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284052, u'size_available': 930955476992, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966954, u'device': u'/dev/sda1', u'inode_used': 88022, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284052, "block_size": 4096, "block_total": 240324484, "block_used": 13040432, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966954, "inode_total": 61054976, "inode_used": 88022, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955476992, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:39.479 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:39 +0000 (0:00:00.053) 0:04:30.219 ******* 2019-12-09T09:35:39.487 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-12-09T09:35:39.489 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:39.530 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:39 +0000 (0:00:00.050) 0:04:30.269 ******* 2019-12-09T09:35:39.536 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-12-09T09:35:39.537 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:39.580 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:39 +0000 (0:00:00.050) 0:04:30.320 ******* 2019-12-09T09:35:39.619 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-09T09:35:39.620 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:39.657 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:39 +0000 (0:00:00.076) 0:04:30.396 ******* 2019-12-09T09:35:39.694 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-09T09:35:39.695 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:39.735 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:39 +0000 (0:00:00.078) 0:04:30.474 ******* 2019-12-09T09:35:39.761 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-12-09T09:35:39.764 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:39.803 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:39 +0000 (0:00:00.068) 0:04:30.543 ******* 2019-12-09T09:35:39.852 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-12-09T09:35:39.854 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:39.918 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:39 +0000 (0:00:00.114) 0:04:30.657 ******* 2019-12-09T09:35:39.924 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-09T09:35:39.926 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-09T09:35:39.969 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:39 +0000 (0:00:00.051) 0:04:30.708 ******* 2019-12-09T09:35:39.985 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-09T09:35:39.986 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:40.037 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:40 +0000 (0:00:00.067) 0:04:30.776 ******* 2019-12-09T09:35:40.044 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-09T09:35:40.045 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={u'block_used': 13040430, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284054, u'size_available': 930955485184, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966954, u'device': u'/dev/sda1', u'inode_used': 88022, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284054, "block_size": 4096, "block_total": 240324484, "block_used": 13040430, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966954, "inode_total": 61054976, "inode_used": 88022, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955485184, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:40.085 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:40 +0000 (0:00:00.048) 0:04:30.824 ******* 2019-12-09T09:35:40.122 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-12-09T09:35:40.124 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:40.163 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:40 +0000 (0:00:00.077) 0:04:30.902 ******* 2019-12-09T09:35:40.200 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-09T09:35:40.202 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:40.239 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:40 +0000 (0:00:00.077) 0:04:30.979 ******* 2019-12-09T09:35:40.277 INFO:teuthology.task.ansible.out: 2019-12-09T09:35:40.284 INFO:teuthology.task.ansible.out:TASK [testnode : set_fact] ***************************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:40.317 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:40 +0000 (0:00:00.077) 0:04:31.057 ******* 2019-12-09T09:35:40.355 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-12-09T09:35:40.357 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:40.405 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:40 +0000 (0:00:00.079) 0:04:31.136 ******* 2019-12-09T09:35:40.446 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-12-09T09:35:40.447 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:40.490 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:40 +0000 (0:00:00.092) 0:04:31.229 ******* 2019-12-09T09:35:40.533 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-09T09:35:40.535 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:40.581 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:40 +0000 (0:00:00.091) 0:04:31.321 ******* 2019-12-09T09:35:40.884 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-09T09:35:40.927 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:40 +0000 (0:00:00.345) 0:04:31.666 ******* 2019-12-09T09:35:41.099 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-09T09:35:41.170 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:41 +0000 (0:00:00.243) 0:04:31.910 ******* 2019-12-09T09:35:41.768 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T09:35:41.776 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T09:35:42.208 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T09:35:42.280 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T09:35:42.680 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T09:35:42.769 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T09:35:43.174 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T09:35:43.282 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T09:35:43.627 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T09:35:43.681 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:43 +0000 (0:00:02.510) 0:04:34.420 ******* 2019-12-09T09:35:43.750 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-09T09:35:43.791 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:43 +0000 (0:00:00.110) 0:04:34.531 ******* 2019-12-09T09:35:43.999 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-09T09:35:44.001 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-09T09:35:44.039 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:44 +0000 (0:00:00.247) 0:04:34.778 ******* 2019-12-09T09:35:44.087 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-09T09:35:44.089 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:44.131 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-09T09:35:44.133 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-09T09:35:44.182 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:44 +0000 (0:00:00.142) 0:04:34.921 ******* 2019-12-09T09:35:44.246 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-09T09:35:44.247 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:44.401 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-09T09:35:44.578 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-09T09:35:44.749 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-09T09:35:44.887 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-09T09:35:45.072 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-09T09:35:45.209 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-09T09:35:45.405 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-09T09:35:45.448 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:45 +0000 (0:00:01.266) 0:04:36.187 ******* 2019-12-09T09:35:45.515 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-09T09:35:45.558 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:45 +0000 (0:00:00.110) 0:04:36.297 ******* 2019-12-09T09:35:45.760 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-12-09T09:35:45.762 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-09T09:35:45.844 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:45 +0000 (0:00:00.285) 0:04:36.583 ******* 2019-12-09T09:35:45.905 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-12-09T09:35:45.906 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-09T09:35:45.971 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:45 +0000 (0:00:00.127) 0:04:36.710 ******* 2019-12-09T09:35:45.979 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-12-09T09:35:45.981 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-09T09:35:46.042 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:46 +0000 (0:00:00.071) 0:04:36.782 ******* 2019-12-09T09:35:46.108 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi121.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-09T09:35:46.535 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:46 +0000 (0:00:00.108) 0:04:36.890 ******* 2019-12-09T09:35:46.702 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-12-09T09:35:46.705 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true} 2019-12-09T09:35:46.775 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:46 +0000 (0:00:00.624) 0:04:37.514 ******* 2019-12-09T09:35:46.785 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true} 2019-12-09T09:35:46.850 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:46 +0000 (0:00:00.075) 0:04:37.590 ******* 2019-12-09T09:35:47.567 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-12-09T09:35:47.568 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-09T09:35:47.616 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:47 +0000 (0:00:00.765) 0:04:38.356 ******* 2019-12-09T09:35:47.645 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-12-09T09:35:47.647 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:47.691 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:47 +0000 (0:00:00.073) 0:04:38.430 ******* 2019-12-09T09:35:47.717 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-12-09T09:35:47.719 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:47.768 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:47 +0000 (0:00:00.078) 0:04:38.508 ******* 2019-12-09T09:35:47.806 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-12-09T09:35:47.808 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:47.844 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:47 +0000 (0:00:00.075) 0:04:38.584 ******* 2019-12-09T09:35:47.871 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-12-09T09:35:47.873 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:47.910 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:47 +0000 (0:00:00.065) 0:04:38.650 ******* 2019-12-09T09:35:47.936 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-12-09T09:35:47.938 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:47.975 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:47 +0000 (0:00:00.064) 0:04:38.714 ******* 2019-12-09T09:35:48.012 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-12-09T09:35:48.013 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:48.051 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:48 +0000 (0:00:00.075) 0:04:38.790 ******* 2019-12-09T09:35:48.077 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-12-09T09:35:48.079 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:48.116 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:48 +0000 (0:00:00.065) 0:04:38.856 ******* 2019-12-09T09:35:48.568 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-12-09T09:35:48.570 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-09T09:35:48.609 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:48 +0000 (0:00:00.492) 0:04:39.349 ******* 2019-12-09T09:35:48.616 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-12-09T09:35:48.617 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-12-09T09:35:48.656 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:48 +0000 (0:00:00.047) 0:04:39.396 ******* 2019-12-09T09:35:48.662 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-12-09T09:35:48.663 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:48.703 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:48 +0000 (0:00:00.046) 0:04:39.442 ******* 2019-12-09T09:35:48.709 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-12-09T09:35:48.713 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:48.757 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:48 +0000 (0:00:00.054) 0:04:39.497 ******* 2019-12-09T09:35:48.763 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-12-09T09:35:48.765 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:48.803 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:48 +0000 (0:00:00.045) 0:04:39.542 ******* 2019-12-09T09:35:48.808 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-12-09T09:35:48.810 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:48.850 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:48 +0000 (0:00:00.044) 0:04:39.586 ******* 2019-12-09T09:35:48.852 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-12-09T09:35:48.853 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:48.891 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:48 +0000 (0:00:00.044) 0:04:39.631 ******* 2019-12-09T09:35:48.927 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-12-09T09:35:48.929 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:48.964 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:48 +0000 (0:00:00.073) 0:04:39.704 ******* 2019-12-09T09:35:49.001 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-12-09T09:35:49.010 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:49.048 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:49 +0000 (0:00:00.083) 0:04:39.788 ******* 2019-12-09T09:35:49.085 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-12-09T09:35:49.087 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:49.124 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:49 +0000 (0:00:00.075) 0:04:39.863 ******* 2019-12-09T09:35:49.150 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-12-09T09:35:49.152 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:49.189 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:49 +0000 (0:00:00.064) 0:04:39.928 ******* 2019-12-09T09:35:49.692 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-12-09T09:35:49.694 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-12-09T09:35:49.741 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:49 +0000 (0:00:00.552) 0:04:40.481 ******* 2019-12-09T09:35:49.772 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-12-09T09:35:49.774 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:49.819 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:49 +0000 (0:00:00.077) 0:04:40.558 ******* 2019-12-09T09:35:49.829 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-12-09T09:35:49.830 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-12-09T09:35:49.890 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:49 +0000 (0:00:00.071) 0:04:40.629 ******* 2019-12-09T09:35:49.895 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-12-09T09:35:49.897 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:49.936 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:49 +0000 (0:00:00.046) 0:04:40.676 ******* 2019-12-09T09:35:49.942 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-12-09T09:35:49.944 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:49.984 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:49 +0000 (0:00:00.047) 0:04:40.723 ******* 2019-12-09T09:35:50.467 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-12-09T09:35:50.470 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "syslog.target tmp.mount system.slice -.mount systemd-journald.socket sntp.service basic.target ntpdate.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "multi-user.target chronyd.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-12-09T09:35:50.471 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127510", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127510", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-12-09T09:35:50.473 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-09T09:35:50.524 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:50 +0000 (0:00:00.539) 0:04:41.263 ******* 2019-12-09T09:35:50.931 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-12-09T09:35:50.933 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-12-09T09:35:50.971 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:50 +0000 (0:00:00.446) 0:04:41.710 ******* 2019-12-09T09:35:50.998 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-12-09T09:35:51.000 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:51.038 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:51 +0000 (0:00:00.067) 0:04:41.778 ******* 2019-12-09T09:35:51.465 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-12-09T09:35:51.467 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-12-09T09:35:51.513 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:51 +0000 (0:00:00.474) 0:04:42.252 ******* 2019-12-09T09:35:51.541 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-12-09T09:35:51.543 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:51.578 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:51 +0000 (0:00:00.065) 0:04:42.318 ******* 2019-12-09T09:35:51.606 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2019-12-09T09:35:51.608 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:51.644 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:51 +0000 (0:00:00.065) 0:04:42.384 ******* 2019-12-09T09:35:51.980 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-12-09T09:35:51.982 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-12-09T09:35:52.017 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:52 +0000 (0:00:00.372) 0:04:42.756 ******* 2019-12-09T09:35:52.522 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-12-09T09:35:52.524 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "syslog.target ntpdate.service systemd-journald.socket basic.target sntp.service tmp.mount system.slice -.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target multi-user.target chronyd.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-12-09T09:35:52.526 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-12-09T09:35:52.527 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-09T09:35:52.596 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:52 +0000 (0:00:00.579) 0:04:43.335 ******* 2019-12-09T09:35:52.995 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-12-09T09:35:52.997 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-12-09T09:35:53.036 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:53 +0000 (0:00:00.440) 0:04:43.776 ******* 2019-12-09T09:35:53.555 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-12-09T09:35:53.604 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:53 +0000 (0:00:00.559) 0:04:44.335 ******* 2019-12-09T09:35:53.624 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-12-09T09:35:53.625 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:53.662 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:53 +0000 (0:00:00.066) 0:04:44.402 ******* 2019-12-09T09:35:53.691 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2019-12-09T09:35:53.693 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:53.758 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:53 +0000 (0:00:00.095) 0:04:44.498 ******* 2019-12-09T09:35:54.085 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-12-09T09:35:54.086 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-12-09T09:35:54.125 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:54 +0000 (0:00:00.366) 0:04:44.864 ******* 2019-12-09T09:35:54.898 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-12-09T09:35:54.899 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-09T09:35:54.938 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:54 +0000 (0:00:00.812) 0:04:45.677 ******* 2019-12-09T09:35:54.965 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-12-09T09:35:54.966 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:55.006 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:55 +0000 (0:00:00.068) 0:04:45.746 ******* 2019-12-09T09:35:55.050 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-12-09T09:35:55.051 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-12-09T09:35:55.104 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:55 +0000 (0:00:00.095) 0:04:45.841 ******* 2019-12-09T09:35:55.109 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-12-09T09:35:55.110 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-12-09T09:35:55.150 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:55 +0000 (0:00:00.048) 0:04:45.890 ******* 2019-12-09T09:35:55.400 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-12-09T09:35:55.402 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-12-09T09:35:55.444 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:55 +0000 (0:00:00.294) 0:04:46.184 ******* 2019-12-09T09:35:55.491 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-12-09T09:35:55.493 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:55.536 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:55 +0000 (0:00:00.092) 0:04:46.276 ******* 2019-12-09T09:35:55.566 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-12-09T09:35:55.568 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-09T09:35:55.605 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:55 +0000 (0:00:00.068) 0:04:46.344 ******* 2019-12-09T09:35:55.639 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:55.686 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:55 +0000 (0:00:00.081) 0:04:46.426 ******* 2019-12-09T09:35:56.016 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-12-09T09:35:56.018 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-09T09:35:56.056 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:56 +0000 (0:00:00.370) 0:04:46.796 ******* 2019-12-09T09:35:56.399 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi121.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-09T09:35:56.441 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:56 +0000 (0:00:00.384) 0:04:47.181 ******* 2019-12-09T09:35:56.470 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-12-09T09:35:56.471 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:56.514 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:56 +0000 (0:00:00.072) 0:04:47.253 ******* 2019-12-09T09:35:56.552 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-12-09T09:35:56.553 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:56.565 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:56.567 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:56.568 INFO:teuthology.task.ansible.out: 2019-12-09T09:35:56.585 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:56.586 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:56.636 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:56 +0000 (0:00:00.122) 0:04:47.376 ******* 2019-12-09T09:35:56.649 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-12-09T09:35:56.650 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-09T09:35:56.698 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:56 +0000 (0:00:00.061) 0:04:47.437 ******* 2019-12-09T09:35:56.707 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-12-09T09:35:56.708 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:56.710 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:56.711 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:56.713 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi121.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:56.759 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:56 +0000 (0:00:00.061) 0:04:47.499 ******* 2019-12-09T09:35:56.765 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:56.803 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:56 +0000 (0:00:00.043) 0:04:47.542 ******* 2019-12-09T09:35:56.807 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-09T09:35:56.808 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:56.866 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:56 +0000 (0:00:00.062) 0:04:47.605 ******* 2019-12-09T09:35:56.872 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-12-09T09:35:56.874 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-12-09T09:35:56.913 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:56 +0000 (0:00:00.047) 0:04:47.653 ******* 2019-12-09T09:35:56.920 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-12-09T09:35:56.922 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:56.960 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:56 +0000 (0:00:00.046) 0:04:47.700 ******* 2019-12-09T09:35:56.988 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-12-09T09:35:56.990 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:57.051 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:57 +0000 (0:00:00.090) 0:04:47.791 ******* 2019-12-09T09:35:57.078 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-12-09T09:35:57.080 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:57.117 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:57 +0000 (0:00:00.066) 0:04:47.857 ******* 2019-12-09T09:35:57.144 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-12-09T09:35:57.157 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:57.184 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:57 +0000 (0:00:00.066) 0:04:47.923 ******* 2019-12-09T09:35:57.222 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-09T09:35:57.223 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:57.260 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:57 +0000 (0:00:00.076) 0:04:48.000 ******* 2019-12-09T09:35:57.266 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-12-09T09:35:57.268 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-12-09T09:35:57.311 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:57 +0000 (0:00:00.050) 0:04:48.050 ******* 2019-12-09T09:35:57.318 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-12-09T09:35:57.319 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:57.362 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:57 +0000 (0:00:00.051) 0:04:48.101 ******* 2019-12-09T09:35:57.371 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-12-09T09:35:57.372 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:57.418 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:57 +0000 (0:00:00.056) 0:04:48.157 ******* 2019-12-09T09:35:57.427 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-09T09:35:57.429 INFO:teuthology.task.ansible.out:skipping: [smithi121.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:57.482 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:57 +0000 (0:00:00.063) 0:04:48.222 ******* 2019-12-09T09:35:57.489 INFO:teuthology.task.ansible.out: 2019-12-09T09:35:57.491 INFO:teuthology.task.ansible.out:TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-09T09:35:57.540 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:57 +0000 (0:00:00.058) 0:04:48.280 ******* 2019-12-09T09:35:57.572 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:57.607 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:57 +0000 (0:00:00.066) 0:04:48.346 ******* 2019-12-09T09:35:57.828 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi121.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.012269", "end": "2019-12-09 09:35:57.780914", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-09 09:35:57.768645", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:57.942 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-12-09T09:35:57.944 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-09T09:35:57.997 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:57 +0000 (0:00:00.390) 0:04:48.737 ******* 2019-12-09T09:35:58.164 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-09T09:35:58.166 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006941", "end": "2019-12-09 09:35:58.101711", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-09 09:35:58.094770", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:58.306 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-12-09T09:35:58.308 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-09T09:35:58.351 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:58 +0000 (0:00:00.353) 0:04:49.091 ******* 2019-12-09T09:35:58.380 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:58.428 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:58 +0000 (0:00:00.077) 0:04:49.168 ******* 2019-12-09T09:35:58.466 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-12-09T09:35:58.468 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:58.479 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:58.479 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:58.492 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-12-09T09:35:58.494 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-09T09:35:58.495 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.006589", "end": "2019-12-09 09:35:58.437639", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-09 09:35:58.431050", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:58.539 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:58 +0000 (0:00:00.110) 0:04:49.279 ******* 2019-12-09T09:35:58.585 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-12-09T09:35:58.586 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:58.607 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:58.621 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:58.622 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:58.624 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:58.690 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:58 +0000 (0:00:00.150) 0:04:49.430 ******* 2019-12-09T09:35:58.717 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-09T09:35:58.719 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:58.766 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:58 +0000 (0:00:00.075) 0:04:49.505 ******* 2019-12-09T09:35:58.796 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-12-09T09:35:58.797 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:58.842 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:58 +0000 (0:00:00.076) 0:04:49.581 ******* 2019-12-09T09:35:58.870 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-12-09T09:35:58.872 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:58.926 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:58 +0000 (0:00:00.081) 0:04:49.663 ******* 2019-12-09T09:35:58.966 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-12-09T09:35:58.967 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:59.006 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:59 +0000 (0:00:00.083) 0:04:49.746 ******* 2019-12-09T09:35:59.044 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-12-09T09:35:59.046 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:59.084 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:59 +0000 (0:00:00.077) 0:04:49.824 ******* 2019-12-09T09:35:59.111 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-09T09:35:59.113 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:59.152 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:59 +0000 (0:00:00.067) 0:04:49.892 ******* 2019-12-09T09:35:59.179 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-12-09T09:35:59.181 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:59.220 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:59 +0000 (0:00:00.068) 0:04:49.960 ******* 2019-12-09T09:35:59.247 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-09T09:35:59.249 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-09T09:35:59.297 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:59 +0000 (0:00:00.076) 0:04:50.036 ******* 2019-12-09T09:35:59.631 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-09T09:35:59.632 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.012667", "end": "2019-12-09 09:35:59.590394", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-09 09:35:59.577727", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:59.833 INFO:teuthology.task.ansible.out:ok: [smithi121.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:01.009415", "end": "2019-12-09 09:35:59.763206", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-09 09:35:58.753791", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:35:59.874 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:59 +0000 (0:00:00.577) 0:04:50.614 ******* 2019-12-09T09:35:59.902 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-09T09:35:59.946 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:35:59 +0000 (0:00:00.066) 0:04:50.680 ******* 2019-12-09T09:35:59.968 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-09T09:35:59.970 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.008395", "end": "2019-12-09 09:35:59.928346", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-09 09:35:59.919951", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:36:00.255 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-12-09T09:36:00.257 INFO:teuthology.task.ansible.out:changed: [smithi121.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-09T09:36:00.309 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-09T09:36:00.319 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.007637", "end": "2019-12-09 09:36:00.254996", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-09 09:36:00.247359", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-09T09:36:00.568 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.006953", "end": "2019-12-09 09:36:00.529608", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-09 09:36:00.522655", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-09T09:36:00.620 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:36:00 +0000 (0:00:00.679) 0:04:51.359 ******* 2019-12-09T09:36:00.648 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-09T09:36:00.687 INFO:teuthology.task.ansible.out:Monday 09 December 2019 09:36:00 +0000 (0:00:00.066) 0:04:51.426 ******* 2019-12-09T09:36:01.005 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-12-09T09:36:01.006 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-09T09:36:01.114 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2019-12-09T09:36:01.118 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** 2019-12-09T09:36:01.120 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2019-12-09T09:36:01.121 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2019-12-09T09:36:01.123 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi121.front.sepia.ceph.com : ok=121 changed=41 unreachable=0 failed=0 skipped=160 rescued=0 ignored=3 smithi132.front.sepia.ceph.com : ok=121 changed=41 unreachable=0 failed=0 skipped=160 rescued=0 ignored=3 Monday 09 December 2019 09:36:01 +0000 (0:00:00.434) 0:04:51.861 ******* =============================================================================== 2019-12-09T09:36:01.129 INFO:teuthology.task.ansible.out:users : Create all admin users with sudo access. ----------------------- 35.44s 2019-12-09T09:36:01.131 INFO:teuthology.task.ansible.out:users : Update authorized_keys using the keys repo --------------------- 34.56s common : nrpe - Ensure SELinux policy is up to date -------------------- 25.54s testnode : Install packages -------------------------------------------- 18.10s users : Remove revoked users ------------------------------------------- 15.67s common : Update yum cache ---------------------------------------------- 11.33s testnode : Zap all non-root disks --------------------------------------- 8.71s testnode : Ensure ceph packages are not present. ------------------------ 8.18s common : nrpe - Load SELinux policy package ----------------------------- 7.52s common : nrpe - Remove SELinux policy package --------------------------- 7.46s testnode : Ensure ceph dependency packages are not present. ------------- 3.44s Gathering Facts --------------------------------------------------------- 3.43s common : Make sure smartmontools is installed --------------------------- 2.93s ansible-managed : Add authorized keys for the ansible user. ------------- 2.88s testnode : Blow away lingering OSD data and FSIDs ----------------------- 2.52s testnode : Create logical volume(s) ------------------------------------- 2.51s testnode : Rebuild rpmdb ------------------------------------------------ 2.30s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 2.15s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.85s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 1.84s 2019-12-09T09:36:01.444 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi121.front.sepia.ceph.com'), Remote(name='ubuntu@smithi132.front.sepia.ceph.com')] 2019-12-09T09:36:01.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T09:36:01.447 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi121.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:36:01.544 INFO:teuthology.orchestra.run.smithi121:> true 2019-12-09T09:36:01.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-09T09:36:01.931 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi132.front.sepia.ceph.com', 'timeout': 60} 2019-12-09T09:36:02.027 INFO:teuthology.orchestra.run.smithi132:> true 2019-12-09T09:36:02.383 INFO:teuthology.run_tasks:Running task clock... 2019-12-09T09:36:02.521 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-12-09T09:36:02.521 INFO:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-09T09:36:02.663 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-12-09T09:36:12.754 INFO:teuthology.orchestra.run.smithi121.stdout:ntpd: time slew +0.002161s 2019-12-09T09:36:12.795 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntp.service: Unit not found. 2019-12-09T09:36:12.874 INFO:teuthology.orchestra.run.smithi121.stdout: remote refid st t when poll reach delay offset jitter 2019-12-09T09:36:12.874 INFO:teuthology.orchestra.run.smithi121.stdout:============================================================================== 2019-12-09T09:36:12.874 INFO:teuthology.orchestra.run.smithi121.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-09T09:36:12.875 INFO:teuthology.orchestra.run.smithi121.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-09T09:36:12.875 INFO:teuthology.orchestra.run.smithi121.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-09T09:36:12.875 INFO:teuthology.orchestra.run.smithi121.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-09T09:36:12.875 INFO:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-09T09:36:13.016 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-12-09T09:36:23.099 INFO:teuthology.orchestra.run.smithi132.stdout:ntpd: time slew +0.000782s 2019-12-09T09:36:23.136 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntp.service: Unit not found. 2019-12-09T09:36:23.278 INFO:teuthology.orchestra.run.smithi132.stdout: remote refid st t when poll reach delay offset jitter 2019-12-09T09:36:23.278 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================== 2019-12-09T09:36:23.279 INFO:teuthology.orchestra.run.smithi132.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-09T09:36:23.279 INFO:teuthology.orchestra.run.smithi132.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-09T09:36:23.279 INFO:teuthology.orchestra.run.smithi132.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-09T09:36:23.279 INFO:teuthology.orchestra.run.smithi132.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-09T09:36:23.280 INFO:teuthology.run_tasks:Running task install... 2019-12-09T09:36:23.290 DEBUG:teuthology.task.install:project ceph 2019-12-09T09:36:23.291 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'notcmalloc', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360'}} 2019-12-09T09:36:23.291 DEBUG:teuthology.task.install:config {'flavor': 'notcmalloc', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360'} 2019-12-09T09:36:23.291 INFO:teuthology.task.install:Using flavor: notcmalloc 2019-12-09T09:36:23.296 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-daemon', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-daemon', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2019-12-09T09:36:23.305 INFO:teuthology.task.install:extra packages: [] 2019-12-09T09:36:23.305 INFO:teuthology.orchestra.run.smithi121:> sudo lsb_release -is 2019-12-09T09:36:23.473 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS 2019-12-09T09:36:23.475 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-09T09:36:23.475 INFO:teuthology.orchestra.run.smithi132:> sudo lsb_release -is 2019-12-09T09:36:23.476 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '1351c819e1a9518cde4c8b12d645782009028360', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-12-09T09:36:23.476 INFO:teuthology.orchestra.run.smithi121:> sudo lsb_release -is 2019-12-09T09:36:23.612 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS 2019-12-09T09:36:23.614 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-09T09:36:23.614 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=1351c819e1a9518cde4c8b12d645782009028360 2019-12-09T09:36:23.633 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS 2019-12-09T09:36:23.635 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-09T09:36:23.635 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '1351c819e1a9518cde4c8b12d645782009028360', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-12-09T09:36:23.635 INFO:teuthology.orchestra.run.smithi132:> sudo lsb_release -is 2019-12-09T09:36:23.762 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS 2019-12-09T09:36:23.764 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-09T09:36:23.765 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=1351c819e1a9518cde4c8b12d645782009028360 2019-12-09T09:36:23.778 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-ofriedma-dynamic-disable/1351c819e1a9518cde4c8b12d645782009028360/centos/7/flavors/notcmalloc/ 2019-12-09T09:36:23.778 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7900.g1351c81 2019-12-09T09:36:23.900 INFO:teuthology.orchestra.run.smithi121:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-12-09T09:36:23.924 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-ofriedma-dynamic-disable/1351c819e1a9518cde4c8b12d645782009028360/centos/7/flavors/notcmalloc/ 2019-12-09T09:36:23.924 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7900.g1351c81 2019-12-09T09:36:24.020 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-12-09T09:36:24.020 INFO:teuthology.orchestra.run.smithi121:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1351c819e1a9518cde4c8b12d645782009028360/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-12-09T09:36:24.043 INFO:teuthology.orchestra.run.smithi132:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-12-09T09:36:24.124 INFO:teuthology.orchestra.run.smithi121:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-12-09T09:36:24.162 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-12-09T09:36:24.162 INFO:teuthology.orchestra.run.smithi132:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1351c819e1a9518cde4c8b12d645782009028360/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-12-09T09:36:24.216 INFO:teuthology.orchestra.run.smithi121:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-12-09T09:36:24.271 INFO:teuthology.orchestra.run.smithi132:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-12-09T09:36:24.299 INFO:teuthology.orchestra.run.smithi121.stdout:check_obsoletes = 1 2019-12-09T09:36:24.301 INFO:teuthology.orchestra.run.smithi121:> sudo yum clean all 2019-12-09T09:36:24.355 INFO:teuthology.orchestra.run.smithi132:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-12-09T09:36:24.429 INFO:teuthology.orchestra.run.smithi132.stdout:check_obsoletes = 1 2019-12-09T09:36:24.431 INFO:teuthology.orchestra.run.smithi132:> sudo yum clean all 2019-12-09T09:36:24.471 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:36:24.509 INFO:teuthology.orchestra.run.smithi121.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-12-09T09:36:24.509 INFO:teuthology.orchestra.run.smithi121.stdout: : lab-extras updates 2019-12-09T09:36:24.555 INFO:teuthology.orchestra.run.smithi121.stdout:Cleaning up list of fastest mirrors 2019-12-09T09:36:24.556 INFO:teuthology.orchestra.run.smithi121.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-12-09T09:36:24.569 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-radosgw 2019-12-09T09:36:24.645 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:36:24.685 INFO:teuthology.orchestra.run.smithi132.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-12-09T09:36:24.686 INFO:teuthology.orchestra.run.smithi132.stdout: : lab-extras updates 2019-12-09T09:36:24.732 INFO:teuthology.orchestra.run.smithi132.stdout:Cleaning up list of fastest mirrors 2019-12-09T09:36:24.732 INFO:teuthology.orchestra.run.smithi132.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-12-09T09:36:24.745 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-radosgw 2019-12-09T09:36:24.812 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:36:24.853 INFO:teuthology.orchestra.run.smithi121.stdout:Determining fastest mirrors 2019-12-09T09:36:24.904 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:36:24.942 INFO:teuthology.orchestra.run.smithi132.stdout:Determining fastest mirrors 2019-12-09T09:36:25.152 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:36:25.153 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:36:25.154 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:36:25.154 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:36:25.240 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:36:25.241 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:36:25.241 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:36:25.242 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:36:32.636 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:36:32.820 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:36:32.989 INFO:teuthology.orchestra.run.smithi121.stdout:Resolving Dependencies 2019-12-09T09:36:32.989 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:36:32.989 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.002 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.108 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.109 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.110 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.112 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.112 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.114 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.114 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.116 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.118 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:36:33.118 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-base.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.125 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.126 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.127 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.129 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.130 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.130 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.133 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-12-09T09:36:33.134 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-12-09T09:36:33.134 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-12-09T09:36:33.134 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package librados2.x86_64 2:15.0.0-7900.g1351c81.el7 will be an update 2019-12-09T09:36:33.136 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-12-09T09:36:33.137 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package librgw2.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.138 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:36:33.138 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.143 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.144 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.145 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.146 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.146 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.147 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.149 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.149 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.150 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.150 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.151 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.151 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-12-09T09:36:33.152 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.152 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-12-09T09:36:33.152 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package librbd1.x86_64 2:15.0.0-7900.g1351c81.el7 will be an update 2019-12-09T09:36:33.153 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-12-09T09:36:33.153 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-09T09:36:33.155 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-09T09:36:33.155 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:36:33.155 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-12-09T09:36:33.158 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.158 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.158 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.158 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.159 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-12-09T09:36:33.159 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-rados.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.160 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-rbd.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.160 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-rgw.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.160 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-12-09T09:36:33.175 INFO:teuthology.orchestra.run.smithi132.stdout:Resolving Dependencies 2019-12-09T09:36:33.175 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:36:33.175 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.189 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.295 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.301 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.301 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.302 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.302 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.302 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.302 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.305 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.306 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:36:33.306 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-base.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.313 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.314 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.315 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.317 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.317 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.318 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.329 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-12-09T09:36:33.330 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-12-09T09:36:33.330 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-12-09T09:36:33.330 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package librados2.x86_64 2:15.0.0-7900.g1351c81.el7 will be an update 2019-12-09T09:36:33.330 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-12-09T09:36:33.330 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package librgw2.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.330 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:36:33.330 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.331 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.332 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.333 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.333 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.337 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.337 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.337 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.338 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.339 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.339 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.340 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:36:33.340 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-12-09T09:36:33.340 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.341 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-12-09T09:36:33.341 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package librbd1.x86_64 2:15.0.0-7900.g1351c81.el7 will be an update 2019-12-09T09:36:33.342 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-12-09T09:36:33.342 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-09T09:36:33.343 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-09T09:36:33.343 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:36:33.343 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-12-09T09:36:33.344 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.345 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.345 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.346 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.347 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-12-09T09:36:33.347 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-rados.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.347 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-rbd.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.348 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-rgw.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:36:33.348 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-12-09T09:36:34.015 INFO:teuthology.orchestra.run.smithi121.stdout:--> Finished Dependency Resolution 2019-12-09T09:36:34.101 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:36:34.101 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies Resolved 2019-12-09T09:36:34.104 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:36:34.104 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:36:34.104 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository 2019-12-09T09:36:34.105 INFO:teuthology.orchestra.run.smithi121.stdout: Size 2019-12-09T09:36:34.105 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:36:34.105 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2019-12-09T09:36:34.105 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw x86_64 2:15.0.0-7900.g1351c81.el7 ceph 6.2 M 2019-12-09T09:36:34.105 INFO:teuthology.orchestra.run.smithi121.stdout:Installing for dependencies: 2019-12-09T09:36:34.105 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base x86_64 2:15.0.0-7900.g1351c81.el7 ceph 5.6 M 2019-12-09T09:36:34.105 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common x86_64 2:15.0.0-7900.g1351c81.el7 ceph 20 M 2019-12-09T09:36:34.106 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux x86_64 2:15.0.0-7900.g1351c81.el7 ceph 20 k 2019-12-09T09:36:34.106 INFO:teuthology.orchestra.run.smithi121.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-12-09T09:36:34.106 INFO:teuthology.orchestra.run.smithi121.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-12-09T09:36:34.106 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 489 k 2019-12-09T09:36:34.106 INFO:teuthology.orchestra.run.smithi121.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-12-09T09:36:34.106 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-12-09T09:36:34.106 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 374 k 2019-12-09T09:36:34.107 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-12-09T09:36:34.107 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 5.4 M 2019-12-09T09:36:34.107 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-12-09T09:36:34.107 INFO:teuthology.orchestra.run.smithi121.stdout: python-ceph-argparse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 35 k 2019-12-09T09:36:34.107 INFO:teuthology.orchestra.run.smithi121.stdout: python-ceph-common x86_64 2:15.0.0-7900.g1351c81.el7 ceph 42 k 2019-12-09T09:36:34.107 INFO:teuthology.orchestra.run.smithi121.stdout: python-cephfs x86_64 2:15.0.0-7900.g1351c81.el7 ceph 102 k 2019-12-09T09:36:34.107 INFO:teuthology.orchestra.run.smithi121.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-12-09T09:36:34.108 INFO:teuthology.orchestra.run.smithi121.stdout: python-rados x86_64 2:15.0.0-7900.g1351c81.el7 ceph 209 k 2019-12-09T09:36:34.108 INFO:teuthology.orchestra.run.smithi121.stdout: python-rbd x86_64 2:15.0.0-7900.g1351c81.el7 ceph 199 k 2019-12-09T09:36:34.108 INFO:teuthology.orchestra.run.smithi121.stdout: python-rgw x86_64 2:15.0.0-7900.g1351c81.el7 ceph 77 k 2019-12-09T09:36:34.108 INFO:teuthology.orchestra.run.smithi121.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-12-09T09:36:34.108 INFO:teuthology.orchestra.run.smithi121.stdout:Updating for dependencies: 2019-12-09T09:36:34.108 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 3.5 M 2019-12-09T09:36:34.108 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.8 M 2019-12-09T09:36:34.109 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:36:34.109 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2019-12-09T09:36:34.109 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:36:34.109 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package (+20 Dependent packages) 2019-12-09T09:36:34.109 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade ( 2 Dependent packages) 2019-12-09T09:36:34.109 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:36:34.109 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 45 M 2019-12-09T09:36:34.109 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading packages: 2019-12-09T09:36:34.110 INFO:teuthology.orchestra.run.smithi121.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-09T09:36:34.215 INFO:teuthology.orchestra.run.smithi132.stdout:--> Finished Dependency Resolution 2019-12-09T09:36:34.302 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:36:34.302 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies Resolved 2019-12-09T09:36:34.305 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:36:34.305 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:36:34.305 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository 2019-12-09T09:36:34.305 INFO:teuthology.orchestra.run.smithi132.stdout: Size 2019-12-09T09:36:34.306 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:36:34.306 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2019-12-09T09:36:34.306 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw x86_64 2:15.0.0-7900.g1351c81.el7 ceph 6.2 M 2019-12-09T09:36:34.306 INFO:teuthology.orchestra.run.smithi132.stdout:Installing for dependencies: 2019-12-09T09:36:34.306 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base x86_64 2:15.0.0-7900.g1351c81.el7 ceph 5.6 M 2019-12-09T09:36:34.306 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common x86_64 2:15.0.0-7900.g1351c81.el7 ceph 20 M 2019-12-09T09:36:34.306 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux x86_64 2:15.0.0-7900.g1351c81.el7 ceph 20 k 2019-12-09T09:36:34.307 INFO:teuthology.orchestra.run.smithi132.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-12-09T09:36:34.307 INFO:teuthology.orchestra.run.smithi132.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-12-09T09:36:34.307 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 489 k 2019-12-09T09:36:34.307 INFO:teuthology.orchestra.run.smithi132.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-12-09T09:36:34.307 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-12-09T09:36:34.307 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 374 k 2019-12-09T09:36:34.308 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-12-09T09:36:34.308 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 5.4 M 2019-12-09T09:36:34.308 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-12-09T09:36:34.308 INFO:teuthology.orchestra.run.smithi132.stdout: python-ceph-argparse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 35 k 2019-12-09T09:36:34.308 INFO:teuthology.orchestra.run.smithi132.stdout: python-ceph-common x86_64 2:15.0.0-7900.g1351c81.el7 ceph 42 k 2019-12-09T09:36:34.308 INFO:teuthology.orchestra.run.smithi132.stdout: python-cephfs x86_64 2:15.0.0-7900.g1351c81.el7 ceph 102 k 2019-12-09T09:36:34.308 INFO:teuthology.orchestra.run.smithi132.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-12-09T09:36:34.309 INFO:teuthology.orchestra.run.smithi132.stdout: python-rados x86_64 2:15.0.0-7900.g1351c81.el7 ceph 209 k 2019-12-09T09:36:34.309 INFO:teuthology.orchestra.run.smithi132.stdout: python-rbd x86_64 2:15.0.0-7900.g1351c81.el7 ceph 199 k 2019-12-09T09:36:34.309 INFO:teuthology.orchestra.run.smithi132.stdout: python-rgw x86_64 2:15.0.0-7900.g1351c81.el7 ceph 77 k 2019-12-09T09:36:34.309 INFO:teuthology.orchestra.run.smithi132.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-12-09T09:36:34.309 INFO:teuthology.orchestra.run.smithi132.stdout:Updating for dependencies: 2019-12-09T09:36:34.309 INFO:teuthology.orchestra.run.smithi132.stdout: librados2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 3.5 M 2019-12-09T09:36:34.309 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.8 M 2019-12-09T09:36:34.309 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:36:34.310 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2019-12-09T09:36:34.310 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:36:34.310 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package (+20 Dependent packages) 2019-12-09T09:36:34.310 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade ( 2 Dependent packages) 2019-12-09T09:36:34.310 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:36:34.310 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 45 M 2019-12-09T09:36:34.311 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading packages: 2019-12-09T09:36:34.311 INFO:teuthology.orchestra.run.smithi132.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-09T09:36:36.776 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:36:36.776 INFO:teuthology.orchestra.run.smithi121.stdout:Total 17 MB/s | 45 MB 00:02 2019-12-09T09:36:36.792 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2019-12-09T09:36:36.861 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2019-12-09T09:36:37.131 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded 2019-12-09T09:36:37.132 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2019-12-09T09:36:37.717 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-12-09T09:36:38.090 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-12-09T09:36:38.401 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-12-09T09:36:38.688 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-09T09:36:38.945 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:python-ceph-argparse-15.0.0-7900.g1351c81.el7.x86_64 5/25 2019-12-09T09:36:39.282 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:36:39.282 INFO:teuthology.orchestra.run.smithi132.stdout:Total 9.0 MB/s | 45 MB 00:04 2019-12-09T09:36:39.299 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2019-12-09T09:36:39.328 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-12-09T09:36:39.368 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2019-12-09T09:36:39.581 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded 2019-12-09T09:36:39.581 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2019-12-09T09:36:40.116 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 7/25 2019-12-09T09:36:40.254 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-12-09T09:36:40.467 INFO:teuthology.orchestra.run.smithi121.stdout: Updating : 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 8/25 2019-12-09T09:36:40.603 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-12-09T09:36:40.948 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-12-09T09:36:41.235 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-09T09:36:41.298 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:python-rados-15.0.0-7900.g1351c81.el7.x86_64 9/25 2019-12-09T09:36:41.476 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:python-ceph-argparse-15.0.0-7900.g1351c81.el7.x86_64 5/25 2019-12-09T09:36:41.649 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:librgw2-15.0.0-7900.g1351c81.el7.x86_64 10/25 2019-12-09T09:36:41.836 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-12-09T09:36:42.224 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 11/25 2019-12-09T09:36:42.552 INFO:teuthology.orchestra.run.smithi121.stdout: Updating : 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 12/25 2019-12-09T09:36:42.660 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 7/25 2019-12-09T09:36:42.841 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:python-rbd-15.0.0-7900.g1351c81.el7.x86_64 13/25 2019-12-09T09:36:43.008 INFO:teuthology.orchestra.run.smithi132.stdout: Updating : 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 8/25 2019-12-09T09:36:43.075 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:python-cephfs-15.0.0-7900.g1351c81.el7.x86_64 14/25 2019-12-09T09:36:43.363 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:python-rgw-15.0.0-7900.g1351c81.el7.x86_64 15/25 2019-12-09T09:36:43.647 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:libradosstriper1-15.0.0-7900.g1351c81.el7.x86_64 16/25 2019-12-09T09:36:43.887 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:python-rados-15.0.0-7900.g1351c81.el7.x86_64 9/25 2019-12-09T09:36:43.957 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-12-09T09:36:44.231 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:librgw2-15.0.0-7900.g1351c81.el7.x86_64 10/25 2019-12-09T09:36:44.304 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 18/25 2019-12-09T09:36:44.787 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 11/25 2019-12-09T09:36:45.084 INFO:teuthology.orchestra.run.smithi132.stdout: Updating : 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 12/25 2019-12-09T09:36:45.331 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:python-rbd-15.0.0-7900.g1351c81.el7.x86_64 13/25 2019-12-09T09:36:45.572 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:python-cephfs-15.0.0-7900.g1351c81.el7.x86_64 14/25 2019-12-09T09:36:45.920 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:python-rgw-15.0.0-7900.g1351c81.el7.x86_64 15/25 2019-12-09T09:36:46.172 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:libradosstriper1-15.0.0-7900.g1351c81.el7.x86_64 16/25 2019-12-09T09:36:46.437 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-12-09T09:36:46.673 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:python-ceph-common-15.0.0-7900.g1351c81.el7.x86_64 19/25 2019-12-09T09:36:46.767 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 18/25 2019-12-09T09:36:47.815 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 20/25 2019-12-09T09:36:48.371 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 21/25 2019-12-09T09:36:49.145 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:python-ceph-common-15.0.0-7900.g1351c81.el7.x86_64 19/25 2019-12-09T09:36:50.294 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 20/25 2019-12-09T09:36:50.860 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 21/25 2019-12-09T09:36:57.685 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-selinux-15.0.0-7900.g1351c81.el7.x86_64 22/25 2019-12-09T09:36:58.066 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 23/25 2019-12-09T09:36:58.304 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-09T09:36:58.574 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-09T09:36:58.689 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7900.g1351c81.el7.x86_64 1/25 2019-12-09T09:36:58.790 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 2/25 2019-12-09T09:36:58.924 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:libradosstriper1-15.0.0-7900.g1351c81.el7.x86_64 3/25 2019-12-09T09:36:59.056 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-09T09:36:59.175 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 5/25 2019-12-09T09:36:59.300 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:python-ceph-common-15.0.0-7900.g1351c81.el7.x86_64 6/25 2019-12-09T09:36:59.401 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:librgw2-15.0.0-7900.g1351c81.el7.x86_64 7/25 2019-12-09T09:36:59.526 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 8/25 2019-12-09T09:36:59.635 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 9/25 2019-12-09T09:36:59.719 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 10/25 2019-12-09T09:36:59.828 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 11/25 2019-12-09T09:36:59.937 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:python-rgw-15.0.0-7900.g1351c81.el7.x86_64 12/25 2019-12-09T09:37:00.056 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-selinux-15.0.0-7900.g1351c81.el7.x86_64 22/25 2019-12-09T09:37:00.062 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 13/25 2019-12-09T09:37:00.146 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 14/25 2019-12-09T09:37:00.238 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-selinux-15.0.0-7900.g1351c81.el7.x86_64 15/25 2019-12-09T09:37:00.347 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 16/25 2019-12-09T09:37:00.506 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 17/25 2019-12-09T09:37:00.606 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:python-rbd-15.0.0-7900.g1351c81.el7.x86_64 18/25 2019-12-09T09:37:00.665 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 23/25 2019-12-09T09:37:00.707 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 19/25 2019-12-09T09:37:00.816 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 20/25 2019-12-09T09:37:00.923 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-09T09:37:01.469 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 21/25 2019-12-09T09:37:01.470 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:python-rados-15.0.0-7900.g1351c81.el7.x86_64 22/25 2019-12-09T09:37:01.470 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:python-cephfs-15.0.0-7900.g1351c81.el7.x86_64 23/25 2019-12-09T09:37:01.470 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-09T09:37:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-09T09:37:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7900.g1351c81.el7.x86_64 1/25 2019-12-09T09:37:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 2/25 2019-12-09T09:37:01.546 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:libradosstriper1-15.0.0-7900.g1351c81.el7.x86_64 3/25 2019-12-09T09:37:01.548 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-09T09:37:01.548 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:01.548 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2019-12-09T09:37:01.548 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:01.549 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:01.549 INFO:teuthology.orchestra.run.smithi121.stdout:Dependency Installed: 2019-12-09T09:37:01.549 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:01.549 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:01.549 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:01.549 INFO:teuthology.orchestra.run.smithi121.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-12-09T09:37:01.549 INFO:teuthology.orchestra.run.smithi121.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-12-09T09:37:01.550 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:01.550 INFO:teuthology.orchestra.run.smithi121.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-12-09T09:37:01.550 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-12-09T09:37:01.550 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:01.550 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-12-09T09:37:01.550 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:01.550 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-12-09T09:37:01.551 INFO:teuthology.orchestra.run.smithi121.stdout: python-ceph-argparse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:01.551 INFO:teuthology.orchestra.run.smithi121.stdout: python-ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:01.551 INFO:teuthology.orchestra.run.smithi121.stdout: python-cephfs.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:01.551 INFO:teuthology.orchestra.run.smithi121.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-12-09T09:37:01.551 INFO:teuthology.orchestra.run.smithi121.stdout: python-rados.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:01.551 INFO:teuthology.orchestra.run.smithi121.stdout: python-rbd.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:01.551 INFO:teuthology.orchestra.run.smithi121.stdout: python-rgw.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:01.552 INFO:teuthology.orchestra.run.smithi121.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-12-09T09:37:01.552 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:01.552 INFO:teuthology.orchestra.run.smithi121.stdout:Dependency Updated: 2019-12-09T09:37:01.552 INFO:teuthology.orchestra.run.smithi121.stdout: librados2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:01.552 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:01.552 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:01.552 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2019-12-09T09:37:01.638 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-09T09:37:01.669 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-test 2019-12-09T09:37:01.747 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 5/25 2019-12-09T09:37:01.881 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:python-ceph-common-15.0.0-7900.g1351c81.el7.x86_64 6/25 2019-12-09T09:37:01.935 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:37:01.973 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:37:01.974 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:37:01.974 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:37:01.975 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:37:01.975 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:37:01.990 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:librgw2-15.0.0-7900.g1351c81.el7.x86_64 7/25 2019-12-09T09:37:02.124 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 8/25 2019-12-09T09:37:02.232 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 9/25 2019-12-09T09:37:02.350 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 10/25 2019-12-09T09:37:02.517 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 11/25 2019-12-09T09:37:02.619 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:37:02.659 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:python-rgw-15.0.0-7900.g1351c81.el7.x86_64 12/25 2019-12-09T09:37:02.776 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 13/25 2019-12-09T09:37:02.894 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 14/25 2019-12-09T09:37:02.942 INFO:teuthology.orchestra.run.smithi121.stdout:Resolving Dependencies 2019-12-09T09:37:02.943 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:02.943 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-test.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:02.961 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-selinux-15.0.0-7900.g1351c81.el7.x86_64 15/25 2019-12-09T09:37:02.989 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:02.990 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:02.991 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:02.992 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-12-09T09:37:02.992 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-12-09T09:37:02.993 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-12-09T09:37:02.995 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-12-09T09:37:03.006 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:03.006 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-12-09T09:37:03.070 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 16/25 2019-12-09T09:37:03.187 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 17/25 2019-12-09T09:37:03.287 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:python-rbd-15.0.0-7900.g1351c81.el7.x86_64 18/25 2019-12-09T09:37:03.356 INFO:teuthology.orchestra.run.smithi121.stdout:--> Finished Dependency Resolution 2019-12-09T09:37:03.379 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 19/25 2019-12-09T09:37:03.480 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 20/25 2019-12-09T09:37:03.573 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:03.573 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies Resolved 2019-12-09T09:37:03.574 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:03.574 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:03.574 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository 2019-12-09T09:37:03.575 INFO:teuthology.orchestra.run.smithi121.stdout: Size 2019-12-09T09:37:03.575 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:03.575 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2019-12-09T09:37:03.575 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test x86_64 2:15.0.0-7900.g1351c81.el7 ceph 38 M 2019-12-09T09:37:03.575 INFO:teuthology.orchestra.run.smithi121.stdout:Installing for dependencies: 2019-12-09T09:37:03.575 INFO:teuthology.orchestra.run.smithi121.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-12-09T09:37:03.575 INFO:teuthology.orchestra.run.smithi121.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-12-09T09:37:03.576 INFO:teuthology.orchestra.run.smithi121.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-12-09T09:37:03.576 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-12-09T09:37:03.576 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:03.576 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2019-12-09T09:37:03.576 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:03.576 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package (+4 Dependent packages) 2019-12-09T09:37:03.577 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:03.577 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 38 M 2019-12-09T09:37:03.577 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 134 M 2019-12-09T09:37:03.577 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading packages: 2019-12-09T09:37:03.597 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 21/25 2019-12-09T09:37:03.732 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:python-rados-15.0.0-7900.g1351c81.el7.x86_64 22/25 2019-12-09T09:37:03.865 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:python-cephfs-15.0.0-7900.g1351c81.el7.x86_64 23/25 2019-12-09T09:37:03.866 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-09T09:37:04.263 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-09T09:37:04.263 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:04.263 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2019-12-09T09:37:04.264 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:04.264 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:04.264 INFO:teuthology.orchestra.run.smithi132.stdout:Dependency Installed: 2019-12-09T09:37:04.264 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:04.265 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:04.265 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:04.265 INFO:teuthology.orchestra.run.smithi132.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-12-09T09:37:04.265 INFO:teuthology.orchestra.run.smithi132.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-12-09T09:37:04.266 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:04.266 INFO:teuthology.orchestra.run.smithi132.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-12-09T09:37:04.266 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-12-09T09:37:04.266 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:04.267 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-12-09T09:37:04.268 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:04.268 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-12-09T09:37:04.268 INFO:teuthology.orchestra.run.smithi132.stdout: python-ceph-argparse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:04.268 INFO:teuthology.orchestra.run.smithi132.stdout: python-ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:04.268 INFO:teuthology.orchestra.run.smithi132.stdout: python-cephfs.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:04.268 INFO:teuthology.orchestra.run.smithi132.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-12-09T09:37:04.268 INFO:teuthology.orchestra.run.smithi132.stdout: python-rados.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:04.269 INFO:teuthology.orchestra.run.smithi132.stdout: python-rbd.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:04.269 INFO:teuthology.orchestra.run.smithi132.stdout: python-rgw.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:04.269 INFO:teuthology.orchestra.run.smithi132.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-12-09T09:37:04.269 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:04.269 INFO:teuthology.orchestra.run.smithi132.stdout:Dependency Updated: 2019-12-09T09:37:04.269 INFO:teuthology.orchestra.run.smithi132.stdout: librados2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:04.269 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:04.270 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:04.270 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2019-12-09T09:37:04.377 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-test 2019-12-09T09:37:04.666 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:37:04.708 INFO:teuthology.orchestra.run.smithi132.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:37:04.709 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:37:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:37:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:37:04.710 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:37:05.353 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:37:05.441 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:37:05.441 INFO:teuthology.orchestra.run.smithi121.stdout:Total 21 MB/s | 38 MB 00:01 2019-12-09T09:37:05.444 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2019-12-09T09:37:05.465 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2019-12-09T09:37:05.551 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded 2019-12-09T09:37:05.551 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2019-12-09T09:37:05.684 INFO:teuthology.orchestra.run.smithi132.stdout:Resolving Dependencies 2019-12-09T09:37:05.685 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:05.685 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-test.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:05.702 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:05.732 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:05.733 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:05.734 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:05.734 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-12-09T09:37:05.735 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-12-09T09:37:05.736 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-12-09T09:37:05.737 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-12-09T09:37:05.740 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:05.740 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-12-09T09:37:06.099 INFO:teuthology.orchestra.run.smithi132.stdout:--> Finished Dependency Resolution 2019-12-09T09:37:06.177 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-12-09T09:37:06.320 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:06.320 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies Resolved 2019-12-09T09:37:06.321 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:06.321 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:06.321 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository 2019-12-09T09:37:06.321 INFO:teuthology.orchestra.run.smithi132.stdout: Size 2019-12-09T09:37:06.322 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:06.322 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2019-12-09T09:37:06.322 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test x86_64 2:15.0.0-7900.g1351c81.el7 ceph 38 M 2019-12-09T09:37:06.322 INFO:teuthology.orchestra.run.smithi132.stdout:Installing for dependencies: 2019-12-09T09:37:06.322 INFO:teuthology.orchestra.run.smithi132.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-12-09T09:37:06.322 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-12-09T09:37:06.322 INFO:teuthology.orchestra.run.smithi132.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-12-09T09:37:06.323 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-12-09T09:37:06.323 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:06.323 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2019-12-09T09:37:06.323 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:06.323 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package (+4 Dependent packages) 2019-12-09T09:37:06.323 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:06.323 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 38 M 2019-12-09T09:37:06.324 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 134 M 2019-12-09T09:37:06.324 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading packages: 2019-12-09T09:37:06.463 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-12-09T09:37:06.785 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-12-09T09:37:08.159 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:37:08.160 INFO:teuthology.orchestra.run.smithi132.stdout:Total 21 MB/s | 38 MB 00:01 2019-12-09T09:37:08.163 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2019-12-09T09:37:08.190 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2019-12-09T09:37:08.263 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded 2019-12-09T09:37:08.263 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2019-12-09T09:37:08.952 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-12-09T09:37:09.227 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-12-09T09:37:09.525 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-12-09T09:37:10.763 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-12-09T09:37:11.069 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 5/5 2019-12-09T09:37:11.175 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 1/5 2019-12-09T09:37:11.267 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 2/5 2019-12-09T09:37:11.381 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 3/5 2019-12-09T09:37:11.451 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-12-09T09:37:11.903 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-12-09T09:37:11.903 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:11.903 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2019-12-09T09:37:11.903 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:11.904 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:11.904 INFO:teuthology.orchestra.run.smithi121.stdout:Dependency Installed: 2019-12-09T09:37:11.904 INFO:teuthology.orchestra.run.smithi121.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-12-09T09:37:11.904 INFO:teuthology.orchestra.run.smithi121.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-12-09T09:37:11.904 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:11.904 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2019-12-09T09:37:12.028 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph 2019-12-09T09:37:12.305 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:37:12.351 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:37:12.352 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:37:12.353 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:37:12.353 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:37:12.353 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:37:13.015 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:37:13.360 INFO:teuthology.orchestra.run.smithi121.stdout:Resolving Dependencies 2019-12-09T09:37:13.361 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:13.361 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:13.363 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:13.393 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:13.394 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:13.395 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:13.396 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:13.396 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:13.406 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:13.408 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:13.409 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:13.411 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:13.411 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:13.412 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:13.413 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:13.414 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:13.417 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:13.421 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:13.422 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-12-09T09:37:13.422 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-12-09T09:37:13.423 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-12-09T09:37:13.424 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T09:37:13.424 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T09:37:13.425 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T09:37:13.426 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T09:37:13.427 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T09:37:13.428 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-12-09T09:37:13.428 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-12-09T09:37:13.429 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-12-09T09:37:13.429 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-12-09T09:37:13.430 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-12-09T09:37:13.431 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:13.431 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-12-09T09:37:13.431 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-12-09T09:37:13.432 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-12-09T09:37:13.433 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-12-09T09:37:13.433 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-12-09T09:37:13.433 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-12-09T09:37:13.434 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-12-09T09:37:13.434 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-12-09T09:37:13.434 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-12-09T09:37:13.434 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:13.434 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-12-09T09:37:13.435 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-12-09T09:37:13.435 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-12-09T09:37:13.435 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:13.436 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-12-09T09:37:13.436 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-12-09T09:37:13.436 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:13.436 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-12-09T09:37:13.748 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-12-09T09:37:13.795 INFO:teuthology.orchestra.run.smithi121.stdout:--> Finished Dependency Resolution 2019-12-09T09:37:14.015 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:14.015 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies Resolved 2019-12-09T09:37:14.027 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:14.027 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:14.028 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository 2019-12-09T09:37:14.028 INFO:teuthology.orchestra.run.smithi121.stdout: Size 2019-12-09T09:37:14.028 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:14.028 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2019-12-09T09:37:14.029 INFO:teuthology.orchestra.run.smithi121.stdout: ceph x86_64 2:15.0.0-7900.g1351c81.el7 ceph 2.0 k 2019-12-09T09:37:14.029 INFO:teuthology.orchestra.run.smithi121.stdout:Installing for dependencies: 2019-12-09T09:37:14.029 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.9 M 2019-12-09T09:37:14.029 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.7 M 2019-12-09T09:37:14.030 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon x86_64 2:15.0.0-7900.g1351c81.el7 ceph 4.4 M 2019-12-09T09:37:14.030 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd x86_64 2:15.0.0-7900.g1351c81.el7 ceph 16 M 2019-12-09T09:37:14.030 INFO:teuthology.orchestra.run.smithi121.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-12-09T09:37:14.030 INFO:teuthology.orchestra.run.smithi121.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-12-09T09:37:14.030 INFO:teuthology.orchestra.run.smithi121.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-12-09T09:37:14.031 INFO:teuthology.orchestra.run.smithi121.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-12-09T09:37:14.031 INFO:teuthology.orchestra.run.smithi121.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-12-09T09:37:14.031 INFO:teuthology.orchestra.run.smithi121.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-12-09T09:37:14.031 INFO:teuthology.orchestra.run.smithi121.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-12-09T09:37:14.032 INFO:teuthology.orchestra.run.smithi121.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-12-09T09:37:14.032 INFO:teuthology.orchestra.run.smithi121.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-12-09T09:37:14.032 INFO:teuthology.orchestra.run.smithi121.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-12-09T09:37:14.032 INFO:teuthology.orchestra.run.smithi121.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-12-09T09:37:14.033 INFO:teuthology.orchestra.run.smithi121.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-12-09T09:37:14.033 INFO:teuthology.orchestra.run.smithi121.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-12-09T09:37:14.033 INFO:teuthology.orchestra.run.smithi121.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-12-09T09:37:14.033 INFO:teuthology.orchestra.run.smithi121.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-12-09T09:37:14.034 INFO:teuthology.orchestra.run.smithi121.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-12-09T09:37:14.034 INFO:teuthology.orchestra.run.smithi121.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-12-09T09:37:14.034 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:14.034 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2019-12-09T09:37:14.035 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:14.035 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package (+21 Dependent packages) 2019-12-09T09:37:14.035 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:14.035 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 28 M 2019-12-09T09:37:14.036 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 87 M 2019-12-09T09:37:14.036 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading packages: 2019-12-09T09:37:14.037 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 5/5 2019-12-09T09:37:14.148 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 1/5 2019-12-09T09:37:14.248 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 2/5 2019-12-09T09:37:14.415 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 3/5 2019-12-09T09:37:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-12-09T09:37:15.250 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-12-09T09:37:15.251 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:15.251 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2019-12-09T09:37:15.251 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:15.251 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:15.251 INFO:teuthology.orchestra.run.smithi132.stdout:Dependency Installed: 2019-12-09T09:37:15.251 INFO:teuthology.orchestra.run.smithi132.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-12-09T09:37:15.251 INFO:teuthology.orchestra.run.smithi132.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-12-09T09:37:15.252 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:15.252 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2019-12-09T09:37:15.379 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph 2019-12-09T09:37:15.650 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:37:15.695 INFO:teuthology.orchestra.run.smithi132.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:37:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:37:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:37:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:37:15.697 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:37:15.962 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:37:15.962 INFO:teuthology.orchestra.run.smithi121.stdout:Total 14 MB/s | 28 MB 00:01 2019-12-09T09:37:15.989 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2019-12-09T09:37:16.037 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2019-12-09T09:37:16.316 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded 2019-12-09T09:37:16.317 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2019-12-09T09:37:16.350 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:37:16.688 INFO:teuthology.orchestra.run.smithi132.stdout:Resolving Dependencies 2019-12-09T09:37:16.689 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:16.689 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:16.691 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:16.721 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:16.722 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:16.723 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:16.725 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:16.725 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:16.734 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:16.736 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:16.737 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:16.739 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:16.740 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:16.741 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:16.742 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:37:16.743 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:16.746 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:16.750 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:16.750 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-12-09T09:37:16.751 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-12-09T09:37:16.752 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-12-09T09:37:16.753 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T09:37:16.753 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T09:37:16.754 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T09:37:16.755 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T09:37:16.756 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-12-09T09:37:16.757 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-12-09T09:37:16.757 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-12-09T09:37:16.758 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-12-09T09:37:16.759 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-12-09T09:37:16.759 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-12-09T09:37:16.760 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:16.760 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-12-09T09:37:16.760 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-12-09T09:37:16.761 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-12-09T09:37:16.762 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-12-09T09:37:16.762 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-12-09T09:37:16.762 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-12-09T09:37:16.763 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-12-09T09:37:16.763 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-12-09T09:37:16.763 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-12-09T09:37:16.763 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:16.764 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-12-09T09:37:16.764 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-12-09T09:37:16.764 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-12-09T09:37:16.765 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:16.765 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-12-09T09:37:16.765 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-12-09T09:37:16.765 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:16.766 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-12-09T09:37:17.110 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-12-09T09:37:17.124 INFO:teuthology.orchestra.run.smithi132.stdout:--> Finished Dependency Resolution 2019-12-09T09:37:17.349 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:17.349 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies Resolved 2019-12-09T09:37:17.351 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:17.352 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:17.352 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository 2019-12-09T09:37:17.352 INFO:teuthology.orchestra.run.smithi132.stdout: Size 2019-12-09T09:37:17.352 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:17.352 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2019-12-09T09:37:17.352 INFO:teuthology.orchestra.run.smithi132.stdout: ceph x86_64 2:15.0.0-7900.g1351c81.el7 ceph 2.0 k 2019-12-09T09:37:17.352 INFO:teuthology.orchestra.run.smithi132.stdout:Installing for dependencies: 2019-12-09T09:37:17.353 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.9 M 2019-12-09T09:37:17.353 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.7 M 2019-12-09T09:37:17.353 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon x86_64 2:15.0.0-7900.g1351c81.el7 ceph 4.4 M 2019-12-09T09:37:17.353 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd x86_64 2:15.0.0-7900.g1351c81.el7 ceph 16 M 2019-12-09T09:37:17.353 INFO:teuthology.orchestra.run.smithi132.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-12-09T09:37:17.353 INFO:teuthology.orchestra.run.smithi132.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-12-09T09:37:17.353 INFO:teuthology.orchestra.run.smithi132.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-12-09T09:37:17.354 INFO:teuthology.orchestra.run.smithi132.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-12-09T09:37:17.354 INFO:teuthology.orchestra.run.smithi132.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-12-09T09:37:17.354 INFO:teuthology.orchestra.run.smithi132.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-12-09T09:37:17.354 INFO:teuthology.orchestra.run.smithi132.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-12-09T09:37:17.354 INFO:teuthology.orchestra.run.smithi132.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-12-09T09:37:17.354 INFO:teuthology.orchestra.run.smithi132.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-12-09T09:37:17.354 INFO:teuthology.orchestra.run.smithi132.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-12-09T09:37:17.355 INFO:teuthology.orchestra.run.smithi132.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-12-09T09:37:17.355 INFO:teuthology.orchestra.run.smithi132.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-12-09T09:37:17.355 INFO:teuthology.orchestra.run.smithi132.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-12-09T09:37:17.355 INFO:teuthology.orchestra.run.smithi132.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-12-09T09:37:17.355 INFO:teuthology.orchestra.run.smithi132.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-12-09T09:37:17.355 INFO:teuthology.orchestra.run.smithi132.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-12-09T09:37:17.355 INFO:teuthology.orchestra.run.smithi132.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-12-09T09:37:17.355 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:17.356 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2019-12-09T09:37:17.356 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:17.356 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package (+21 Dependent packages) 2019-12-09T09:37:17.356 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:17.357 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 28 M 2019-12-09T09:37:17.357 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 87 M 2019-12-09T09:37:17.357 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading packages: 2019-12-09T09:37:17.462 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-12-09T09:37:17.720 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-12-09T09:37:18.202 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 4/22 2019-12-09T09:37:18.539 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 5/22 2019-12-09T09:37:18.974 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 6/22 2019-12-09T09:37:19.446 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:37:19.446 INFO:teuthology.orchestra.run.smithi132.stdout:Total 13 MB/s | 28 MB 00:02 2019-12-09T09:37:19.473 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2019-12-09T09:37:19.520 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2019-12-09T09:37:20.073 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded 2019-12-09T09:37:20.073 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2019-12-09T09:37:20.172 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 7/22 2019-12-09T09:37:21.108 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-12-09T09:37:21.435 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-12-09T09:37:21.729 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-12-09T09:37:22.038 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 8/22 2019-12-09T09:37:22.189 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 4/22 2019-12-09T09:37:22.472 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-osd-15.0.0-7900.g1351c81.el7.x86_64 9/22 2019-12-09T09:37:22.505 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 5/22 2019-12-09T09:37:22.860 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 10/22 2019-12-09T09:37:22.944 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 6/22 2019-12-09T09:37:23.186 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-mako-0.8.1-2.el7.noarch 11/22 2019-12-09T09:37:23.440 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 7/22 2019-12-09T09:37:23.950 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 12/22 2019-12-09T09:37:24.421 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-mon-15.0.0-7900.g1351c81.el7.x86_64 13/22 2019-12-09T09:37:24.712 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/22 2019-12-09T09:37:25.279 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/22 2019-12-09T09:37:25.294 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 8/22 2019-12-09T09:37:25.627 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-mds-15.0.0-7900.g1351c81.el7.x86_64 16/22 2019-12-09T09:37:25.682 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-osd-15.0.0-7900.g1351c81.el7.x86_64 9/22 2019-12-09T09:37:25.866 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-12-09T09:37:26.058 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 10/22 2019-12-09T09:37:26.146 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-12-09T09:37:26.360 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-mako-0.8.1-2.el7.noarch 11/22 2019-12-09T09:37:26.563 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-12-09T09:37:27.120 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 12/22 2019-12-09T09:37:27.212 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-12-09T09:37:27.571 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-mon-15.0.0-7900.g1351c81.el7.x86_64 13/22 2019-12-09T09:37:27.619 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 21/22 2019-12-09T09:37:27.890 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/22 2019-12-09T09:37:27.891 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 22/22 2019-12-09T09:37:28.010 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-12-09T09:37:28.111 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-12-09T09:37:28.228 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-12-09T09:37:28.345 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-12-09T09:37:28.445 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-mds-15.0.0-7900.g1351c81.el7.x86_64 5/22 2019-12-09T09:37:28.450 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/22 2019-12-09T09:37:28.571 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-12-09T09:37:28.671 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-mon-15.0.0-7900.g1351c81.el7.x86_64 7/22 2019-12-09T09:37:28.805 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 8/22 2019-12-09T09:37:28.828 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-mds-15.0.0-7900.g1351c81.el7.x86_64 16/22 2019-12-09T09:37:28.914 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 9/22 2019-12-09T09:37:29.006 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 10/22 2019-12-09T09:37:29.048 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-12-09T09:37:29.098 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-12-09T09:37:29.199 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/22 2019-12-09T09:37:29.307 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-osd-15.0.0-7900.g1351c81.el7.x86_64 13/22 2019-12-09T09:37:29.338 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-12-09T09:37:29.416 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 14/22 2019-12-09T09:37:29.726 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-12-09T09:37:29.735 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 15/22 2019-12-09T09:37:29.842 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 16/22 2019-12-09T09:37:29.976 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-12-09T09:37:30.093 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 18/22 2019-12-09T09:37:30.210 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 19/22 2019-12-09T09:37:30.321 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 20/22 2019-12-09T09:37:30.420 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 21/22 2019-12-09T09:37:30.557 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-12-09T09:37:30.906 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 22/22 2019-12-09T09:37:30.906 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:30.906 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2019-12-09T09:37:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: ceph.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:30.907 INFO:teuthology.orchestra.run.smithi121.stdout:Dependency Installed: 2019-12-09T09:37:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:30.907 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-12-09T09:37:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-12-09T09:37:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-12-09T09:37:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-12-09T09:37:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-12-09T09:37:30.908 INFO:teuthology.orchestra.run.smithi121.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-12-09T09:37:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-12-09T09:37:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-12-09T09:37:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-12-09T09:37:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-12-09T09:37:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-12-09T09:37:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-12-09T09:37:30.909 INFO:teuthology.orchestra.run.smithi121.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-12-09T09:37:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-12-09T09:37:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-12-09T09:37:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-12-09T09:37:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-12-09T09:37:30.910 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:30.910 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2019-12-09T09:37:30.960 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 21/22 2019-12-09T09:37:31.032 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-daemon 2019-12-09T09:37:31.227 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 22/22 2019-12-09T09:37:31.320 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:37:31.351 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-12-09T09:37:31.366 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:37:31.367 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:37:31.368 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:37:31.368 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:37:31.368 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:37:31.459 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-12-09T09:37:31.594 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-12-09T09:37:31.710 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-12-09T09:37:31.802 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-mds-15.0.0-7900.g1351c81.el7.x86_64 5/22 2019-12-09T09:37:31.936 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-12-09T09:37:32.030 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:37:32.062 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-mon-15.0.0-7900.g1351c81.el7.x86_64 7/22 2019-12-09T09:37:32.170 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 8/22 2019-12-09T09:37:32.304 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 9/22 2019-12-09T09:37:32.372 INFO:teuthology.orchestra.run.smithi121.stdout:Resolving Dependencies 2019-12-09T09:37:32.373 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:32.373 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:32.438 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 10/22 2019-12-09T09:37:32.555 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-12-09T09:37:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/22 2019-12-09T09:37:32.738 INFO:teuthology.orchestra.run.smithi121.stdout:--> Finished Dependency Resolution 2019-12-09T09:37:32.765 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-osd-15.0.0-7900.g1351c81.el7.x86_64 13/22 2019-12-09T09:37:32.865 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 14/22 2019-12-09T09:37:32.958 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:32.958 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies Resolved 2019-12-09T09:37:32.959 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:32.959 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:32.960 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository 2019-12-09T09:37:32.960 INFO:teuthology.orchestra.run.smithi121.stdout: Size 2019-12-09T09:37:32.960 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:32.960 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2019-12-09T09:37:32.960 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-daemon x86_64 2:15.0.0-7900.g1351c81.el7 ceph 17 k 2019-12-09T09:37:32.960 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:32.960 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2019-12-09T09:37:32.961 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:32.961 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2019-12-09T09:37:32.961 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:32.961 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 17 k 2019-12-09T09:37:32.961 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 68 k 2019-12-09T09:37:32.961 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading packages: 2019-12-09T09:37:32.965 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 15/22 2019-12-09T09:37:33.058 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 16/22 2019-12-09T09:37:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-12-09T09:37:33.278 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2019-12-09T09:37:33.287 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2019-12-09T09:37:33.288 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded 2019-12-09T09:37:33.289 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2019-12-09T09:37:33.300 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 18/22 2019-12-09T09:37:33.409 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 19/22 2019-12-09T09:37:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 20/22 2019-12-09T09:37:33.668 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 21/22 2019-12-09T09:37:34.045 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-daemon-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T09:37:34.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 22/22 2019-12-09T09:37:34.164 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:34.164 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2019-12-09T09:37:34.164 INFO:teuthology.orchestra.run.smithi132.stdout: ceph.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:34.164 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:34.164 INFO:teuthology.orchestra.run.smithi132.stdout:Dependency Installed: 2019-12-09T09:37:34.165 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:34.165 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:34.165 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:34.165 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:34.165 INFO:teuthology.orchestra.run.smithi132.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-12-09T09:37:34.165 INFO:teuthology.orchestra.run.smithi132.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-12-09T09:37:34.165 INFO:teuthology.orchestra.run.smithi132.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-12-09T09:37:34.166 INFO:teuthology.orchestra.run.smithi132.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-12-09T09:37:34.166 INFO:teuthology.orchestra.run.smithi132.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-12-09T09:37:34.166 INFO:teuthology.orchestra.run.smithi132.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-12-09T09:37:34.166 INFO:teuthology.orchestra.run.smithi132.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-12-09T09:37:34.166 INFO:teuthology.orchestra.run.smithi132.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-12-09T09:37:34.166 INFO:teuthology.orchestra.run.smithi132.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-12-09T09:37:34.166 INFO:teuthology.orchestra.run.smithi132.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-12-09T09:37:34.167 INFO:teuthology.orchestra.run.smithi132.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-12-09T09:37:34.167 INFO:teuthology.orchestra.run.smithi132.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-12-09T09:37:34.167 INFO:teuthology.orchestra.run.smithi132.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-12-09T09:37:34.167 INFO:teuthology.orchestra.run.smithi132.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-12-09T09:37:34.167 INFO:teuthology.orchestra.run.smithi132.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-12-09T09:37:34.167 INFO:teuthology.orchestra.run.smithi132.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-12-09T09:37:34.167 INFO:teuthology.orchestra.run.smithi132.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-12-09T09:37:34.168 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:34.168 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2019-12-09T09:37:34.294 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-daemon 2019-12-09T09:37:34.578 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-daemon-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T09:37:34.578 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:34.578 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2019-12-09T09:37:34.578 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-daemon.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:34.579 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:34.579 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2019-12-09T09:37:34.588 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:37:34.633 INFO:teuthology.orchestra.run.smithi132.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:37:34.634 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:37:34.635 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:37:34.635 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:37:34.635 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:37:34.694 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr 2019-12-09T09:37:34.957 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:37:35.002 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:37:35.003 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:37:35.003 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:37:35.003 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:37:35.004 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:37:35.281 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:37:35.626 INFO:teuthology.orchestra.run.smithi132.stdout:Resolving Dependencies 2019-12-09T09:37:35.627 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:35.627 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:35.651 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:37:35.993 INFO:teuthology.orchestra.run.smithi132.stdout:--> Finished Dependency Resolution 2019-12-09T09:37:35.997 INFO:teuthology.orchestra.run.smithi121.stdout:Package 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-09T09:37:35.997 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do 2019-12-09T09:37:36.057 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-dashboard 2019-12-09T09:37:36.217 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:36.217 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies Resolved 2019-12-09T09:37:36.218 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:36.218 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:36.218 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository 2019-12-09T09:37:36.218 INFO:teuthology.orchestra.run.smithi132.stdout: Size 2019-12-09T09:37:36.218 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:36.218 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2019-12-09T09:37:36.218 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-daemon x86_64 2:15.0.0-7900.g1351c81.el7 ceph 17 k 2019-12-09T09:37:36.219 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:36.219 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2019-12-09T09:37:36.219 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:36.219 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2019-12-09T09:37:36.219 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:36.219 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 17 k 2019-12-09T09:37:36.219 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 68 k 2019-12-09T09:37:36.220 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading packages: 2019-12-09T09:37:36.322 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:37:36.369 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:37:36.370 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:37:36.370 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:37:36.371 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:37:36.371 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:37:36.535 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2019-12-09T09:37:36.544 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2019-12-09T09:37:36.545 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded 2019-12-09T09:37:36.546 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2019-12-09T09:37:37.029 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:37:37.323 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-daemon-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T09:37:37.365 INFO:teuthology.orchestra.run.smithi121.stdout:Resolving Dependencies 2019-12-09T09:37:37.366 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:37.366 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:37.369 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T09:37:37.400 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T09:37:37.400 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:37.400 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:37.400 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-12-09T09:37:37.401 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-12-09T09:37:37.401 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:37.401 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-12-09T09:37:37.767 INFO:teuthology.orchestra.run.smithi121.stdout:--> Finished Dependency Resolution 2019-12-09T09:37:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-daemon-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T09:37:37.801 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:37.802 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2019-12-09T09:37:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-daemon.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:37.802 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:37.802 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2019-12-09T09:37:37.929 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-mgr 2019-12-09T09:37:37.989 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:37.990 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies Resolved 2019-12-09T09:37:37.991 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:37.991 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:37.991 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2019-12-09T09:37:37.992 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:37.992 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2019-12-09T09:37:37.992 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 3.9 M 2019-12-09T09:37:37.992 INFO:teuthology.orchestra.run.smithi121.stdout:Installing for dependencies: 2019-12-09T09:37:37.993 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 18 k 2019-12-09T09:37:37.993 INFO:teuthology.orchestra.run.smithi121.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-12-09T09:37:37.993 INFO:teuthology.orchestra.run.smithi121.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-12-09T09:37:37.993 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:37.993 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2019-12-09T09:37:37.994 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:37.994 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package (+3 Dependent packages) 2019-12-09T09:37:37.994 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:37.994 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 4.6 M 2019-12-09T09:37:37.994 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 20 M 2019-12-09T09:37:37.995 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading packages: 2019-12-09T09:37:38.144 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:37:38.183 INFO:teuthology.orchestra.run.smithi132.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:37:38.184 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:37:38.185 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:37:38.185 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:37:38.185 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:37:38.605 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:37:38.605 INFO:teuthology.orchestra.run.smithi121.stdout:Total 7.4 MB/s | 4.6 MB 00:00 2019-12-09T09:37:38.611 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2019-12-09T09:37:38.620 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2019-12-09T09:37:38.793 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded 2019-12-09T09:37:38.794 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2019-12-09T09:37:38.828 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:37:39.157 INFO:teuthology.orchestra.run.smithi132.stdout:Package 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-09T09:37:39.157 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do 2019-12-09T09:37:39.219 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-mgr-dashboard 2019-12-09T09:37:39.413 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7900.g1351c81.el7.noarch 1/4 2019-12-09T09:37:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:37:39.515 INFO:teuthology.orchestra.run.smithi132.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:37:39.516 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:37:39.517 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:37:39.517 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:37:39.517 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:37:40.164 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:37:40.503 INFO:teuthology.orchestra.run.smithi132.stdout:Resolving Dependencies 2019-12-09T09:37:40.503 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:40.503 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:40.507 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T09:37:40.537 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T09:37:40.538 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:40.538 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:40.538 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-12-09T09:37:40.539 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-12-09T09:37:40.539 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:40.540 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-12-09T09:37:40.853 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-12-09T09:37:40.903 INFO:teuthology.orchestra.run.smithi132.stdout:--> Finished Dependency Resolution 2019-12-09T09:37:41.129 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:41.129 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies Resolved 2019-12-09T09:37:41.130 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:41.130 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:41.130 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2019-12-09T09:37:41.130 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:41.130 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2019-12-09T09:37:41.130 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 3.9 M 2019-12-09T09:37:41.130 INFO:teuthology.orchestra.run.smithi132.stdout:Installing for dependencies: 2019-12-09T09:37:41.131 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 18 k 2019-12-09T09:37:41.131 INFO:teuthology.orchestra.run.smithi132.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-12-09T09:37:41.131 INFO:teuthology.orchestra.run.smithi132.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-12-09T09:37:41.131 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:41.131 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2019-12-09T09:37:41.131 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:41.131 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package (+3 Dependent packages) 2019-12-09T09:37:41.132 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:41.132 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 4.6 M 2019-12-09T09:37:41.132 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 20 M 2019-12-09T09:37:41.132 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading packages: 2019-12-09T09:37:41.754 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:37:41.754 INFO:teuthology.orchestra.run.smithi132.stdout:Total 7.3 MB/s | 4.6 MB 00:00 2019-12-09T09:37:41.760 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2019-12-09T09:37:41.768 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2019-12-09T09:37:41.926 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded 2019-12-09T09:37:41.927 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2019-12-09T09:37:41.981 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-12-09T09:37:42.365 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 4/4 2019-12-09T09:37:42.480 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-12-09T09:37:42.571 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7900.g1351c81.el7.noarch 1/4 2019-12-09T09:37:42.631 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2/4 2019-12-09T09:37:42.748 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7900.g1351c81.el7.noarch 3/4 2019-12-09T09:37:42.966 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-12-09T09:37:43.249 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-12-09T09:37:43.249 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:43.250 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2019-12-09T09:37:43.250 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:43.250 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:43.250 INFO:teuthology.orchestra.run.smithi121.stdout:Dependency Installed: 2019-12-09T09:37:43.250 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:43.250 INFO:teuthology.orchestra.run.smithi121.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-12-09T09:37:43.250 INFO:teuthology.orchestra.run.smithi121.stdout: python-routes.noarch 0:1.13-2.el7 2019-12-09T09:37:43.251 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:43.251 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2019-12-09T09:37:43.379 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-12-09T09:37:43.616 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:37:43.657 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:37:43.658 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:37:43.659 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:37:43.659 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:37:43.659 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:37:44.041 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-12-09T09:37:44.307 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:37:44.463 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 4/4 2019-12-09T09:37:44.589 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-12-09T09:37:44.638 INFO:teuthology.orchestra.run.smithi121.stdout:Resolving Dependencies 2019-12-09T09:37:44.638 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:44.639 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:44.706 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2/4 2019-12-09T09:37:44.798 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7900.g1351c81.el7.noarch 3/4 2019-12-09T09:37:45.002 INFO:teuthology.orchestra.run.smithi121.stdout:--> Finished Dependency Resolution 2019-12-09T09:37:45.224 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:45.224 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies Resolved 2019-12-09T09:37:45.225 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:45.225 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:45.225 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2019-12-09T09:37:45.225 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:45.225 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2019-12-09T09:37:45.226 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-cloud 2019-12-09T09:37:45.226 INFO:teuthology.orchestra.run.smithi121.stdout: noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 82 k 2019-12-09T09:37:45.226 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:45.226 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2019-12-09T09:37:45.226 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:45.226 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2019-12-09T09:37:45.226 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:45.227 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 82 k 2019-12-09T09:37:45.227 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 411 k 2019-12-09T09:37:45.227 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading packages: 2019-12-09T09:37:45.566 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2019-12-09T09:37:45.568 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2019-12-09T09:37:45.610 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded 2019-12-09T09:37:45.610 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2019-12-09T09:37:46.289 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7900.g1351c81.el7.n 1/1 2019-12-09T09:37:46.400 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-12-09T09:37:46.400 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:46.400 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2019-12-09T09:37:46.401 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:46.401 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:46.401 INFO:teuthology.orchestra.run.smithi132.stdout:Dependency Installed: 2019-12-09T09:37:46.401 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:46.401 INFO:teuthology.orchestra.run.smithi132.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-12-09T09:37:46.401 INFO:teuthology.orchestra.run.smithi132.stdout: python-routes.noarch 0:1.13-2.el7 2019-12-09T09:37:46.401 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:46.402 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2019-12-09T09:37:46.522 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-12-09T09:37:46.745 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7900.g1351c81.el7.n 1/1 2019-12-09T09:37:46.745 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:46.745 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2019-12-09T09:37:46.745 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:46.745 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:46.746 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2019-12-09T09:37:46.782 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:37:46.827 INFO:teuthology.orchestra.run.smithi132.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:37:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:37:46.828 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:37:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:37:46.837 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:37:46.863 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-diskprediction-local 2019-12-09T09:37:47.107 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:37:47.148 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:37:47.149 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:37:47.150 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:37:47.150 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:37:47.150 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:37:47.473 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:37:47.797 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:37:47.813 INFO:teuthology.orchestra.run.smithi132.stdout:Resolving Dependencies 2019-12-09T09:37:47.813 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:47.813 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:48.127 INFO:teuthology.orchestra.run.smithi121.stdout:Resolving Dependencies 2019-12-09T09:37:48.127 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:48.127 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:48.129 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T09:37:48.160 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:48.160 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-12-09T09:37:48.167 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-12-09T09:37:48.168 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-09T09:37:48.170 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-09T09:37:48.170 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:48.170 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-12-09T09:37:48.171 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-12-09T09:37:48.172 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-09T09:37:48.173 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-09T09:37:48.174 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:48.174 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-12-09T09:37:48.180 INFO:teuthology.orchestra.run.smithi132.stdout:--> Finished Dependency Resolution 2019-12-09T09:37:48.405 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:48.405 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies Resolved 2019-12-09T09:37:48.406 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:48.406 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:48.407 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2019-12-09T09:37:48.407 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:48.407 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2019-12-09T09:37:48.407 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-cloud 2019-12-09T09:37:48.407 INFO:teuthology.orchestra.run.smithi132.stdout: noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 82 k 2019-12-09T09:37:48.408 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:48.408 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2019-12-09T09:37:48.408 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:48.408 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2019-12-09T09:37:48.409 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:48.409 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 82 k 2019-12-09T09:37:48.409 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 411 k 2019-12-09T09:37:48.409 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading packages: 2019-12-09T09:37:48.534 INFO:teuthology.orchestra.run.smithi121.stdout:--> Finished Dependency Resolution 2019-12-09T09:37:48.741 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2019-12-09T09:37:48.744 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2019-12-09T09:37:48.755 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:48.755 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies Resolved 2019-12-09T09:37:48.756 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:48.756 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:48.756 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2019-12-09T09:37:48.757 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:48.757 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2019-12-09T09:37:48.757 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local 2019-12-09T09:37:48.757 INFO:teuthology.orchestra.run.smithi121.stdout: noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 8.6 M 2019-12-09T09:37:48.757 INFO:teuthology.orchestra.run.smithi121.stdout:Installing for dependencies: 2019-12-09T09:37:48.757 INFO:teuthology.orchestra.run.smithi121.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-12-09T09:37:48.758 INFO:teuthology.orchestra.run.smithi121.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-12-09T09:37:48.758 INFO:teuthology.orchestra.run.smithi121.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-12-09T09:37:48.758 INFO:teuthology.orchestra.run.smithi121.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-12-09T09:37:48.758 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:48.758 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2019-12-09T09:37:48.758 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:48.759 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package (+4 Dependent packages) 2019-12-09T09:37:48.759 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:48.759 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 19 M 2019-12-09T09:37:48.759 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 104 M 2019-12-09T09:37:48.760 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading packages: 2019-12-09T09:37:48.795 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded 2019-12-09T09:37:48.795 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2019-12-09T09:37:49.460 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7900.g1351c81.el7.n 1/1 2019-12-09T09:37:49.937 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7900.g1351c81.el7.n 1/1 2019-12-09T09:37:49.937 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:49.937 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2019-12-09T09:37:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:49.938 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2019-12-09T09:37:49.975 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:37:49.975 INFO:teuthology.orchestra.run.smithi121.stdout:Total 16 MB/s | 19 MB 00:01 2019-12-09T09:37:49.988 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2019-12-09T09:37:50.020 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2019-12-09T09:37:50.052 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-mgr-diskprediction-local 2019-12-09T09:37:50.149 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded 2019-12-09T09:37:50.150 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2019-12-09T09:37:50.329 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:37:50.364 INFO:teuthology.orchestra.run.smithi132.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:37:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:37:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:37:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:37:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:37:51.016 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:37:51.086 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-12-09T09:37:51.350 INFO:teuthology.orchestra.run.smithi132.stdout:Resolving Dependencies 2019-12-09T09:37:51.351 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:51.351 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:51.353 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T09:37:51.384 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:51.384 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-12-09T09:37:51.391 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-12-09T09:37:51.391 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-09T09:37:51.394 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-09T09:37:51.394 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:51.394 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-12-09T09:37:51.395 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-12-09T09:37:51.396 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-09T09:37:51.397 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-09T09:37:51.398 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:37:51.398 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-12-09T09:37:51.544 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-12-09T09:37:51.762 INFO:teuthology.orchestra.run.smithi132.stdout:--> Finished Dependency Resolution 2019-12-09T09:37:51.986 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:51.986 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies Resolved 2019-12-09T09:37:51.987 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:51.987 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:51.987 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2019-12-09T09:37:51.987 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:51.988 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2019-12-09T09:37:51.988 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local 2019-12-09T09:37:51.988 INFO:teuthology.orchestra.run.smithi132.stdout: noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 8.6 M 2019-12-09T09:37:51.988 INFO:teuthology.orchestra.run.smithi132.stdout:Installing for dependencies: 2019-12-09T09:37:51.988 INFO:teuthology.orchestra.run.smithi132.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-12-09T09:37:51.988 INFO:teuthology.orchestra.run.smithi132.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-12-09T09:37:51.988 INFO:teuthology.orchestra.run.smithi132.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-12-09T09:37:51.989 INFO:teuthology.orchestra.run.smithi132.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-12-09T09:37:51.989 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:51.989 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2019-12-09T09:37:51.989 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:37:51.989 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package (+4 Dependent packages) 2019-12-09T09:37:51.989 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:51.989 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 19 M 2019-12-09T09:37:51.989 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 104 M 2019-12-09T09:37:51.990 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading packages: 2019-12-09T09:37:52.694 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:37:52.695 INFO:teuthology.orchestra.run.smithi132.stdout:Total 27 MB/s | 19 MB 00:00 2019-12-09T09:37:52.708 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2019-12-09T09:37:52.741 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2019-12-09T09:37:52.905 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded 2019-12-09T09:37:52.906 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2019-12-09T09:37:53.304 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-12-09T09:37:53.767 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-12-09T09:37:54.235 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-12-09T09:37:55.000 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-12-09T09:37:55.822 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.n 5/5 2019-12-09T09:37:55.889 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-12-09T09:37:55.926 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-12-09T09:37:56.034 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.n 2/5 2019-12-09T09:37:56.160 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 3/5 2019-12-09T09:37:56.252 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 4/5 2019-12-09T09:37:56.737 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-12-09T09:37:56.737 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:56.738 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2019-12-09T09:37:56.738 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:56.738 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:56.738 INFO:teuthology.orchestra.run.smithi121.stdout:Dependency Installed: 2019-12-09T09:37:56.739 INFO:teuthology.orchestra.run.smithi121.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-12-09T09:37:56.739 INFO:teuthology.orchestra.run.smithi121.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-12-09T09:37:56.739 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:56.739 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2019-12-09T09:37:56.862 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-rook 2019-12-09T09:37:57.130 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:37:57.169 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:37:57.170 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:37:57.171 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:37:57.171 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:37:57.171 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:37:57.819 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:37:57.917 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-12-09T09:37:58.145 INFO:teuthology.orchestra.run.smithi121.stdout:Resolving Dependencies 2019-12-09T09:37:58.146 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:58.146 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:37:58.147 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T09:37:58.177 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:58.178 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-12-09T09:37:58.180 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-09T09:37:58.181 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-09T09:37:58.181 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-09T09:37:58.182 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-09T09:37:58.183 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:58.184 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-12-09T09:37:58.184 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-12-09T09:37:58.184 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-12-09T09:37:58.185 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-09T09:37:58.186 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-09T09:37:58.186 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-09T09:37:58.187 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-12-09T09:37:58.188 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-12-09T09:37:58.189 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:58.189 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-12-09T09:37:58.189 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-12-09T09:37:58.189 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-12-09T09:37:58.190 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-12-09T09:37:58.191 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-12-09T09:37:58.191 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:37:58.191 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-12-09T09:37:58.223 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.n 5/5 2019-12-09T09:37:58.343 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-12-09T09:37:58.452 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.n 2/5 2019-12-09T09:37:58.553 INFO:teuthology.orchestra.run.smithi121.stdout:--> Finished Dependency Resolution 2019-12-09T09:37:58.561 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 3/5 2019-12-09T09:37:58.636 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 4/5 2019-12-09T09:37:58.776 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:58.776 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies Resolved 2019-12-09T09:37:58.778 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:58.778 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:58.778 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2019-12-09T09:37:58.778 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:58.778 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2019-12-09T09:37:58.779 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 23 k 2019-12-09T09:37:58.779 INFO:teuthology.orchestra.run.smithi121.stdout:Installing for dependencies: 2019-12-09T09:37:58.779 INFO:teuthology.orchestra.run.smithi121.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-12-09T09:37:58.779 INFO:teuthology.orchestra.run.smithi121.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-12-09T09:37:58.779 INFO:teuthology.orchestra.run.smithi121.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-12-09T09:37:58.779 INFO:teuthology.orchestra.run.smithi121.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-12-09T09:37:58.780 INFO:teuthology.orchestra.run.smithi121.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-12-09T09:37:58.780 INFO:teuthology.orchestra.run.smithi121.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-12-09T09:37:58.780 INFO:teuthology.orchestra.run.smithi121.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-12-09T09:37:58.780 INFO:teuthology.orchestra.run.smithi121.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-12-09T09:37:58.781 INFO:teuthology.orchestra.run.smithi121.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-12-09T09:37:58.781 INFO:teuthology.orchestra.run.smithi121.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-12-09T09:37:58.781 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:58.781 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2019-12-09T09:37:58.781 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:37:58.781 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package (+10 Dependent packages) 2019-12-09T09:37:58.782 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:37:58.782 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 1.6 M 2019-12-09T09:37:58.783 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 24 M 2019-12-09T09:37:58.783 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading packages: 2019-12-09T09:37:59.105 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-12-09T09:37:59.105 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:59.105 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2019-12-09T09:37:59.106 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:37:59.106 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:59.106 INFO:teuthology.orchestra.run.smithi132.stdout:Dependency Installed: 2019-12-09T09:37:59.106 INFO:teuthology.orchestra.run.smithi132.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-12-09T09:37:59.107 INFO:teuthology.orchestra.run.smithi132.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-12-09T09:37:59.107 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:37:59.107 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2019-12-09T09:37:59.236 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-mgr-rook 2019-12-09T09:37:59.503 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:37:59.548 INFO:teuthology.orchestra.run.smithi132.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:37:59.549 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:37:59.550 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:37:59.550 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:37:59.550 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:37:59.574 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:37:59.575 INFO:teuthology.orchestra.run.smithi121.stdout:Total 2.1 MB/s | 1.6 MB 00:00 2019-12-09T09:37:59.590 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2019-12-09T09:37:59.603 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2019-12-09T09:37:59.672 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded 2019-12-09T09:37:59.672 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2019-12-09T09:38:00.201 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:00.473 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-12-09T09:38:00.540 INFO:teuthology.orchestra.run.smithi132.stdout:Resolving Dependencies 2019-12-09T09:38:00.540 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:38:00.540 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:38:00.542 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T09:38:00.572 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:38:00.573 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-12-09T09:38:00.574 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-09T09:38:00.576 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-09T09:38:00.576 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-09T09:38:00.577 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-09T09:38:00.579 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:38:00.579 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-12-09T09:38:00.579 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-12-09T09:38:00.580 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-12-09T09:38:00.580 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-09T09:38:00.580 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-09T09:38:00.581 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-09T09:38:00.582 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-12-09T09:38:00.583 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-12-09T09:38:00.584 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:38:00.584 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-12-09T09:38:00.584 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-12-09T09:38:00.585 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-12-09T09:38:00.586 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-12-09T09:38:00.586 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-12-09T09:38:00.586 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:38:00.586 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-12-09T09:38:00.819 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-12-09T09:38:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:--> Finished Dependency Resolution 2019-12-09T09:38:01.178 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:01.178 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies Resolved 2019-12-09T09:38:01.180 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:01.181 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:01.181 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2019-12-09T09:38:01.181 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:01.181 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2019-12-09T09:38:01.182 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 23 k 2019-12-09T09:38:01.182 INFO:teuthology.orchestra.run.smithi132.stdout:Installing for dependencies: 2019-12-09T09:38:01.182 INFO:teuthology.orchestra.run.smithi132.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-12-09T09:38:01.182 INFO:teuthology.orchestra.run.smithi132.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-12-09T09:38:01.182 INFO:teuthology.orchestra.run.smithi132.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-12-09T09:38:01.183 INFO:teuthology.orchestra.run.smithi132.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-12-09T09:38:01.183 INFO:teuthology.orchestra.run.smithi132.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-12-09T09:38:01.183 INFO:teuthology.orchestra.run.smithi132.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-12-09T09:38:01.183 INFO:teuthology.orchestra.run.smithi132.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-12-09T09:38:01.184 INFO:teuthology.orchestra.run.smithi132.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-12-09T09:38:01.184 INFO:teuthology.orchestra.run.smithi132.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-12-09T09:38:01.184 INFO:teuthology.orchestra.run.smithi132.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-12-09T09:38:01.184 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:01.184 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2019-12-09T09:38:01.185 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:01.185 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package (+10 Dependent packages) 2019-12-09T09:38:01.185 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:01.185 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 1.6 M 2019-12-09T09:38:01.186 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 24 M 2019-12-09T09:38:01.186 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading packages: 2019-12-09T09:38:01.187 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-12-09T09:38:01.509 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-12-09T09:38:01.833 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-12-09T09:38:01.964 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:38:01.965 INFO:teuthology.orchestra.run.smithi132.stdout:Total 2.1 MB/s | 1.6 MB 00:00 2019-12-09T09:38:01.976 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2019-12-09T09:38:01.987 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2019-12-09T09:38:02.049 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded 2019-12-09T09:38:02.051 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2019-12-09T09:38:02.178 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-12-09T09:38:02.590 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-12-09T09:38:02.787 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-12-09T09:38:02.900 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-12-09T09:38:03.156 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-12-09T09:38:03.481 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-12-09T09:38:03.781 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-12-09T09:38:04.110 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-12-09T09:38:04.116 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-12-09T09:38:04.441 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-12-09T09:38:04.510 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-12-09T09:38:04.787 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 11/11 2019-12-09T09:38:04.808 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-12-09T09:38:04.929 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-12-09T09:38:05.088 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-12-09T09:38:05.154 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-12-09T09:38:05.205 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 3/11 2019-12-09T09:38:05.297 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 4/11 2019-12-09T09:38:05.381 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 5/11 2019-12-09T09:38:05.490 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-12-09T09:38:05.600 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 7/11 2019-12-09T09:38:05.741 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 8/11 2019-12-09T09:38:05.833 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 9/11 2019-12-09T09:38:05.927 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 10/11 2019-12-09T09:38:06.411 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-12-09T09:38:06.411 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:06.411 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2019-12-09T09:38:06.411 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:38:06.411 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:06.412 INFO:teuthology.orchestra.run.smithi121.stdout:Dependency Installed: 2019-12-09T09:38:06.412 INFO:teuthology.orchestra.run.smithi121.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-12-09T09:38:06.412 INFO:teuthology.orchestra.run.smithi121.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-12-09T09:38:06.412 INFO:teuthology.orchestra.run.smithi121.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-12-09T09:38:06.412 INFO:teuthology.orchestra.run.smithi121.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-12-09T09:38:06.412 INFO:teuthology.orchestra.run.smithi121.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-12-09T09:38:06.412 INFO:teuthology.orchestra.run.smithi121.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-12-09T09:38:06.413 INFO:teuthology.orchestra.run.smithi121.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-12-09T09:38:06.413 INFO:teuthology.orchestra.run.smithi121.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-12-09T09:38:06.413 INFO:teuthology.orchestra.run.smithi121.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-12-09T09:38:06.413 INFO:teuthology.orchestra.run.smithi121.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-12-09T09:38:06.413 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:06.413 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2019-12-09T09:38:06.414 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-12-09T09:38:06.531 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-ssh 2019-12-09T09:38:06.755 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-12-09T09:38:06.790 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:38:06.835 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:38:06.836 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:38:06.836 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:38:06.837 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:38:06.837 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:38:07.034 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 11/11 2019-12-09T09:38:07.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-12-09T09:38:07.332 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-12-09T09:38:07.458 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 3/11 2019-12-09T09:38:07.483 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:07.550 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 4/11 2019-12-09T09:38:07.642 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 5/11 2019-12-09T09:38:07.751 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-12-09T09:38:07.836 INFO:teuthology.orchestra.run.smithi121.stdout:Resolving Dependencies 2019-12-09T09:38:07.836 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:38:07.837 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:38:07.839 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T09:38:07.851 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 7/11 2019-12-09T09:38:07.869 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:38:07.869 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-12-09T09:38:07.870 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-12-09T09:38:07.870 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:38:07.870 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-12-09T09:38:07.961 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 8/11 2019-12-09T09:38:08.053 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 9/11 2019-12-09T09:38:08.145 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 10/11 2019-12-09T09:38:08.236 INFO:teuthology.orchestra.run.smithi121.stdout:--> Finished Dependency Resolution 2019-12-09T09:38:08.460 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:08.461 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies Resolved 2019-12-09T09:38:08.461 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:08.462 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:38:08.462 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2019-12-09T09:38:08.462 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:38:08.462 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2019-12-09T09:38:08.462 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-ssh noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 33 k 2019-12-09T09:38:08.462 INFO:teuthology.orchestra.run.smithi121.stdout:Installing for dependencies: 2019-12-09T09:38:08.462 INFO:teuthology.orchestra.run.smithi121.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-12-09T09:38:08.463 INFO:teuthology.orchestra.run.smithi121.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-12-09T09:38:08.463 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:08.463 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2019-12-09T09:38:08.463 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:38:08.463 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package (+2 Dependent packages) 2019-12-09T09:38:08.463 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:08.463 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 316 k 2019-12-09T09:38:08.464 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 1.1 M 2019-12-09T09:38:08.464 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading packages: 2019-12-09T09:38:08.655 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-12-09T09:38:08.656 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:08.656 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2019-12-09T09:38:08.656 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:38:08.656 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:08.656 INFO:teuthology.orchestra.run.smithi132.stdout:Dependency Installed: 2019-12-09T09:38:08.656 INFO:teuthology.orchestra.run.smithi132.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-12-09T09:38:08.657 INFO:teuthology.orchestra.run.smithi132.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-12-09T09:38:08.657 INFO:teuthology.orchestra.run.smithi132.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-12-09T09:38:08.657 INFO:teuthology.orchestra.run.smithi132.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-12-09T09:38:08.657 INFO:teuthology.orchestra.run.smithi132.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-12-09T09:38:08.657 INFO:teuthology.orchestra.run.smithi132.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-12-09T09:38:08.657 INFO:teuthology.orchestra.run.smithi132.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-12-09T09:38:08.657 INFO:teuthology.orchestra.run.smithi132.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-12-09T09:38:08.658 INFO:teuthology.orchestra.run.smithi132.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-12-09T09:38:08.658 INFO:teuthology.orchestra.run.smithi132.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-12-09T09:38:08.658 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:08.658 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2019-12-09T09:38:08.776 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-mgr-ssh 2019-12-09T09:38:09.008 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:38:09.008 INFO:teuthology.orchestra.run.smithi121.stdout:Total 579 kB/s | 316 kB 00:00 2019-12-09T09:38:09.011 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2019-12-09T09:38:09.020 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2019-12-09T09:38:09.089 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:38:09.100 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded 2019-12-09T09:38:09.101 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2019-12-09T09:38:09.133 INFO:teuthology.orchestra.run.smithi132.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:38:09.134 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:38:09.134 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:38:09.134 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:38:09.135 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:38:09.781 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:09.945 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-12-09T09:38:10.119 INFO:teuthology.orchestra.run.smithi132.stdout:Resolving Dependencies 2019-12-09T09:38:10.120 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:38:10.120 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:38:10.122 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 2019-12-09T09:38:10.153 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:38:10.154 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-12-09T09:38:10.154 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-12-09T09:38:10.155 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:38:10.155 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-12-09T09:38:10.459 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-12-09T09:38:10.520 INFO:teuthology.orchestra.run.smithi132.stdout:--> Finished Dependency Resolution 2019-12-09T09:38:10.748 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:10.748 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies Resolved 2019-12-09T09:38:10.749 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:10.749 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:10.750 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2019-12-09T09:38:10.750 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:10.750 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2019-12-09T09:38:10.750 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-ssh noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 33 k 2019-12-09T09:38:10.751 INFO:teuthology.orchestra.run.smithi132.stdout:Installing for dependencies: 2019-12-09T09:38:10.751 INFO:teuthology.orchestra.run.smithi132.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-12-09T09:38:10.751 INFO:teuthology.orchestra.run.smithi132.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-12-09T09:38:10.751 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:10.751 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2019-12-09T09:38:10.752 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:10.752 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package (+2 Dependent packages) 2019-12-09T09:38:10.752 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:10.752 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 316 k 2019-12-09T09:38:10.753 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 1.1 M 2019-12-09T09:38:10.753 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading packages: 2019-12-09T09:38:10.754 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 3/3 2019-12-09T09:38:10.857 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-12-09T09:38:10.957 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-12-09T09:38:11.281 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:38:11.282 INFO:teuthology.orchestra.run.smithi132.stdout:Total 594 kB/s | 316 kB 00:00 2019-12-09T09:38:11.286 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2019-12-09T09:38:11.294 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2019-12-09T09:38:11.374 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded 2019-12-09T09:38:11.375 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2019-12-09T09:38:11.450 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 3/3 2019-12-09T09:38:11.450 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:11.450 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2019-12-09T09:38:11.451 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:38:11.451 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:11.451 INFO:teuthology.orchestra.run.smithi121.stdout:Dependency Installed: 2019-12-09T09:38:11.451 INFO:teuthology.orchestra.run.smithi121.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-12-09T09:38:11.451 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:11.452 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2019-12-09T09:38:11.568 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-fuse 2019-12-09T09:38:11.773 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:38:11.812 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:38:11.813 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:38:11.813 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:38:11.813 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:38:11.814 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:38:12.199 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-12-09T09:38:12.437 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-12-09T09:38:12.463 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:12.689 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 3/3 2019-12-09T09:38:12.788 INFO:teuthology.orchestra.run.smithi121.stdout:Resolving Dependencies 2019-12-09T09:38:12.789 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:38:12.789 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:38:12.799 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:38:12.810 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-12-09T09:38:12.832 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python3 for package: 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:38:12.832 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:38:12.833 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-12-09T09:38:12.833 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-12-09T09:38:12.835 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-12-09T09:38:12.835 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-12-09T09:38:12.836 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-12-09T09:38:12.837 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:38:12.837 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-12-09T09:38:12.843 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-12-09T09:38:12.843 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-12-09T09:38:12.927 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-12-09T09:38:13.207 INFO:teuthology.orchestra.run.smithi121.stdout:--> Finished Dependency Resolution 2019-12-09T09:38:13.430 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:13.430 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies Resolved 2019-12-09T09:38:13.430 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:13.431 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:38:13.431 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository 2019-12-09T09:38:13.431 INFO:teuthology.orchestra.run.smithi121.stdout: Size 2019-12-09T09:38:13.431 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:38:13.431 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2019-12-09T09:38:13.431 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 566 k 2019-12-09T09:38:13.432 INFO:teuthology.orchestra.run.smithi121.stdout:Installing for dependencies: 2019-12-09T09:38:13.432 INFO:teuthology.orchestra.run.smithi121.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-12-09T09:38:13.432 INFO:teuthology.orchestra.run.smithi121.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-12-09T09:38:13.432 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-12-09T09:38:13.432 INFO:teuthology.orchestra.run.smithi121.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-12-09T09:38:13.432 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:13.433 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2019-12-09T09:38:13.433 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:38:13.433 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package (+4 Dependent packages) 2019-12-09T09:38:13.433 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:13.434 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 10 M 2019-12-09T09:38:13.434 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 49 M 2019-12-09T09:38:13.434 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading packages: 2019-12-09T09:38:13.437 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 3/3 2019-12-09T09:38:13.437 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:13.437 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2019-12-09T09:38:13.437 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:38:13.437 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:13.438 INFO:teuthology.orchestra.run.smithi132.stdout:Dependency Installed: 2019-12-09T09:38:13.438 INFO:teuthology.orchestra.run.smithi132.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-12-09T09:38:13.438 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:13.438 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2019-12-09T09:38:13.555 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-fuse 2019-12-09T09:38:13.804 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:38:13.848 INFO:teuthology.orchestra.run.smithi132.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:38:13.849 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:38:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:38:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:38:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:38:13.898 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:38:13.898 INFO:teuthology.orchestra.run.smithi121.stdout:Total 21 MB/s | 10 MB 00:00 2019-12-09T09:38:13.913 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2019-12-09T09:38:13.935 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2019-12-09T09:38:14.054 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded 2019-12-09T09:38:14.054 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2019-12-09T09:38:14.500 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:14.839 INFO:teuthology.orchestra.run.smithi132.stdout:Resolving Dependencies 2019-12-09T09:38:14.840 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:38:14.840 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:38:14.850 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:38:14.883 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python3 for package: 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:38:14.884 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:38:14.884 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-12-09T09:38:14.885 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-12-09T09:38:14.886 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-12-09T09:38:14.887 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-12-09T09:38:14.888 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-12-09T09:38:14.888 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:38:14.889 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-12-09T09:38:14.894 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-12-09T09:38:14.894 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-12-09T09:38:15.259 INFO:teuthology.orchestra.run.smithi132.stdout:--> Finished Dependency Resolution 2019-12-09T09:38:15.484 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:15.484 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies Resolved 2019-12-09T09:38:15.485 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:15.485 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:15.486 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository 2019-12-09T09:38:15.486 INFO:teuthology.orchestra.run.smithi132.stdout: Size 2019-12-09T09:38:15.486 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:15.486 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2019-12-09T09:38:15.486 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 566 k 2019-12-09T09:38:15.486 INFO:teuthology.orchestra.run.smithi132.stdout:Installing for dependencies: 2019-12-09T09:38:15.487 INFO:teuthology.orchestra.run.smithi132.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-12-09T09:38:15.487 INFO:teuthology.orchestra.run.smithi132.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-12-09T09:38:15.487 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-12-09T09:38:15.487 INFO:teuthology.orchestra.run.smithi132.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-12-09T09:38:15.487 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:15.487 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2019-12-09T09:38:15.488 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:15.488 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package (+4 Dependent packages) 2019-12-09T09:38:15.488 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:15.488 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 10 M 2019-12-09T09:38:15.488 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 49 M 2019-12-09T09:38:15.488 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading packages: 2019-12-09T09:38:15.997 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:38:15.997 INFO:teuthology.orchestra.run.smithi132.stdout:Total 20 MB/s | 10 MB 00:00 2019-12-09T09:38:16.021 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2019-12-09T09:38:16.051 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2019-12-09T09:38:16.182 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded 2019-12-09T09:38:16.183 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2019-12-09T09:38:16.350 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 1/5 2019-12-09T09:38:16.859 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-3.6.8-10.el7.x86_64 2/5 2019-12-09T09:38:17.723 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 3/5 2019-12-09T09:38:18.223 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-12-09T09:38:18.494 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 5/5 2019-12-09T09:38:18.504 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 1/5 2019-12-09T09:38:18.594 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/5 2019-12-09T09:38:18.736 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-12-09T09:38:18.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-12-09T09:38:18.954 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-12-09T09:38:18.978 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-3.6.8-10.el7.x86_64 2/5 2019-12-09T09:38:19.396 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 5/5 2019-12-09T09:38:19.396 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:19.396 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2019-12-09T09:38:19.397 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:38:19.397 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:19.397 INFO:teuthology.orchestra.run.smithi121.stdout:Dependency Installed: 2019-12-09T09:38:19.397 INFO:teuthology.orchestra.run.smithi121.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-12-09T09:38:19.397 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-12-09T09:38:19.397 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:19.397 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2019-12-09T09:38:19.527 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install libcephfs2 2019-12-09T09:38:19.787 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:38:19.831 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:38:19.832 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:38:19.833 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:38:19.833 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:38:19.833 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:38:19.853 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 3/5 2019-12-09T09:38:20.297 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-12-09T09:38:20.485 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:20.591 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 5/5 2019-12-09T09:38:20.714 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/5 2019-12-09T09:38:20.820 INFO:teuthology.orchestra.run.smithi121.stdout:Package 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-09T09:38:20.840 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do 2019-12-09T09:38:20.841 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-12-09T09:38:20.880 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install libcephfs-devel 2019-12-09T09:38:20.966 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-12-09T09:38:21.091 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-12-09T09:38:21.133 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:38:21.178 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:38:21.179 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:38:21.180 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:38:21.180 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:38:21.180 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:38:21.558 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 5/5 2019-12-09T09:38:21.559 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:21.559 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2019-12-09T09:38:21.559 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:38:21.559 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:21.559 INFO:teuthology.orchestra.run.smithi132.stdout:Dependency Installed: 2019-12-09T09:38:21.559 INFO:teuthology.orchestra.run.smithi132.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-12-09T09:38:21.560 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-12-09T09:38:21.560 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:21.560 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2019-12-09T09:38:21.688 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install libcephfs2 2019-12-09T09:38:21.834 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:21.874 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:38:21.912 INFO:teuthology.orchestra.run.smithi132.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:38:21.913 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:38:21.913 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:38:21.913 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:38:21.914 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:38:22.171 INFO:teuthology.orchestra.run.smithi121.stdout:Resolving Dependencies 2019-12-09T09:38:22.171 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:38:22.172 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:38:22.172 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7900.g1351c81.el7 for package: 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:38:22.202 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:38:22.203 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package librados-devel.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:38:22.516 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:22.573 INFO:teuthology.orchestra.run.smithi121.stdout:--> Finished Dependency Resolution 2019-12-09T09:38:22.797 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:22.797 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies Resolved 2019-12-09T09:38:22.798 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:22.798 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:38:22.798 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository 2019-12-09T09:38:22.799 INFO:teuthology.orchestra.run.smithi121.stdout: Size 2019-12-09T09:38:22.799 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:38:22.799 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2019-12-09T09:38:22.799 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel x86_64 2:15.0.0-7900.g1351c81.el7 ceph 17 k 2019-12-09T09:38:22.799 INFO:teuthology.orchestra.run.smithi121.stdout:Installing for dependencies: 2019-12-09T09:38:22.799 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel x86_64 2:15.0.0-7900.g1351c81.el7 ceph 153 k 2019-12-09T09:38:22.799 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:22.800 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2019-12-09T09:38:22.800 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:38:22.800 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package (+1 Dependent package) 2019-12-09T09:38:22.800 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:22.800 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 170 k 2019-12-09T09:38:22.800 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 679 k 2019-12-09T09:38:22.800 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading packages: 2019-12-09T09:38:22.843 INFO:teuthology.orchestra.run.smithi132.stdout:Package 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-09T09:38:22.843 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do 2019-12-09T09:38:22.906 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install libcephfs-devel 2019-12-09T09:38:23.108 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:38:23.144 INFO:teuthology.orchestra.run.smithi132.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:38:23.145 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:38:23.146 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:38:23.146 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:38:23.146 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:38:23.155 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:38:23.156 INFO:teuthology.orchestra.run.smithi121.stdout:Total 476 kB/s | 170 kB 00:00 2019-12-09T09:38:23.158 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2019-12-09T09:38:23.169 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2019-12-09T09:38:23.172 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded 2019-12-09T09:38:23.172 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2019-12-09T09:38:23.730 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:23.750 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:librados-devel-15.0.0-7900.g1351c81.el7.x86_64 1/2 2019-12-09T09:38:24.003 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2/2 2019-12-09T09:38:24.057 INFO:teuthology.orchestra.run.smithi132.stdout:Resolving Dependencies 2019-12-09T09:38:24.058 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:38:24.058 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:38:24.058 INFO:teuthology.orchestra.run.smithi132.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7900.g1351c81.el7 for package: 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2019-12-09T09:38:24.089 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:38:24.089 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package librados-devel.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:38:24.117 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:librados-devel-15.0.0-7900.g1351c81.el7.x86_64 1/2 2019-12-09T09:38:24.459 INFO:teuthology.orchestra.run.smithi132.stdout:--> Finished Dependency Resolution 2019-12-09T09:38:24.568 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2/2 2019-12-09T09:38:24.568 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:24.569 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2019-12-09T09:38:24.569 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:38:24.569 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:24.569 INFO:teuthology.orchestra.run.smithi121.stdout:Dependency Installed: 2019-12-09T09:38:24.569 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:38:24.569 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:24.569 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2019-12-09T09:38:24.687 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:24.687 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies Resolved 2019-12-09T09:38:24.689 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install librados2 2019-12-09T09:38:24.689 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:24.689 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:24.689 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository 2019-12-09T09:38:24.689 INFO:teuthology.orchestra.run.smithi132.stdout: Size 2019-12-09T09:38:24.690 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:24.690 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2019-12-09T09:38:24.690 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel x86_64 2:15.0.0-7900.g1351c81.el7 ceph 17 k 2019-12-09T09:38:24.690 INFO:teuthology.orchestra.run.smithi132.stdout:Installing for dependencies: 2019-12-09T09:38:24.690 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel x86_64 2:15.0.0-7900.g1351c81.el7 ceph 153 k 2019-12-09T09:38:24.690 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:24.691 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2019-12-09T09:38:24.691 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:24.691 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package (+1 Dependent package) 2019-12-09T09:38:24.691 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:24.691 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 170 k 2019-12-09T09:38:24.691 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 679 k 2019-12-09T09:38:24.691 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading packages: 2019-12-09T09:38:24.919 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:38:24.963 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:38:24.966 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:38:24.966 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:38:24.967 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:38:24.967 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:38:25.025 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:38:25.025 INFO:teuthology.orchestra.run.smithi132.stdout:Total 504 kB/s | 170 kB 00:00 2019-12-09T09:38:25.028 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2019-12-09T09:38:25.041 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2019-12-09T09:38:25.041 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded 2019-12-09T09:38:25.041 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2019-12-09T09:38:25.619 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:25.646 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:librados-devel-15.0.0-7900.g1351c81.el7.x86_64 1/2 2019-12-09T09:38:25.952 INFO:teuthology.orchestra.run.smithi121.stdout:Package 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-09T09:38:25.952 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do 2019-12-09T09:38:26.013 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install librbd1 2019-12-09T09:38:26.167 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:38:26.201 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:38:26.201 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:38:26.202 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:38:26.202 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:38:26.202 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:38:26.373 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2/2 2019-12-09T09:38:26.524 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:librados-devel-15.0.0-7900.g1351c81.el7.x86_64 1/2 2019-12-09T09:38:26.783 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:26.966 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2/2 2019-12-09T09:38:26.966 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:26.967 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2019-12-09T09:38:26.967 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:38:26.967 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:26.967 INFO:teuthology.orchestra.run.smithi132.stdout:Dependency Installed: 2019-12-09T09:38:26.967 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:38:26.967 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:26.968 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2019-12-09T09:38:27.090 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install librados2 2019-12-09T09:38:27.107 INFO:teuthology.orchestra.run.smithi121.stdout:Package 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-09T09:38:27.108 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do 2019-12-09T09:38:27.168 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install python-ceph 2019-12-09T09:38:27.274 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:38:27.311 INFO:teuthology.orchestra.run.smithi132.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:38:27.312 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:38:27.313 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:38:27.313 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:38:27.313 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:38:27.327 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:38:27.361 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:38:27.361 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:38:27.362 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:38:27.362 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:38:27.363 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:38:27.917 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:27.946 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:28.241 INFO:teuthology.orchestra.run.smithi132.stdout:Package 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-09T09:38:28.242 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do 2019-12-09T09:38:28.271 INFO:teuthology.orchestra.run.smithi121.stdout:Resolving Dependencies 2019-12-09T09:38:28.272 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:38:28.272 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:38:28.302 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install librbd1 2019-12-09T09:38:28.548 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:38:28.593 INFO:teuthology.orchestra.run.smithi132.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:38:28.594 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:38:28.594 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:38:28.594 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:38:28.595 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:38:28.642 INFO:teuthology.orchestra.run.smithi121.stdout:--> Finished Dependency Resolution 2019-12-09T09:38:28.821 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:28.821 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies Resolved 2019-12-09T09:38:28.822 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:28.822 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:38:28.822 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository 2019-12-09T09:38:28.823 INFO:teuthology.orchestra.run.smithi121.stdout: Size 2019-12-09T09:38:28.823 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:38:28.823 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2019-12-09T09:38:28.823 INFO:teuthology.orchestra.run.smithi121.stdout: python-ceph-compat x86_64 2:15.0.0-7900.g1351c81.el7 ceph 2.2 k 2019-12-09T09:38:28.823 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:28.823 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2019-12-09T09:38:28.823 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:38:28.824 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2019-12-09T09:38:28.824 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:28.824 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 2.2 k 2019-12-09T09:38:28.824 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 0 2019-12-09T09:38:28.824 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading packages: 2019-12-09T09:38:29.120 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2019-12-09T09:38:29.122 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2019-12-09T09:38:29.124 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded 2019-12-09T09:38:29.124 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2019-12-09T09:38:29.240 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:29.580 INFO:teuthology.orchestra.run.smithi132.stdout:Package 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-09T09:38:29.580 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do 2019-12-09T09:38:29.642 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install python-ceph 2019-12-09T09:38:29.714 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:python-ceph-compat-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T09:38:29.890 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:38:29.929 INFO:teuthology.orchestra.run.smithi132.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:38:29.930 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:38:29.930 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:38:29.931 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:38:29.931 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:38:30.219 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:python-ceph-compat-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T09:38:30.219 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:30.219 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2019-12-09T09:38:30.220 INFO:teuthology.orchestra.run.smithi121.stdout: python-ceph-compat.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:38:30.220 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:30.220 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2019-12-09T09:38:30.323 INFO:teuthology.orchestra.run.smithi121:> sudo yum -y install rbd-fuse 2019-12-09T09:38:30.528 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:38:30.566 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:38:30.567 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:38:30.567 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:38:30.568 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:38:30.568 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:38:30.581 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:30.909 INFO:teuthology.orchestra.run.smithi132.stdout:Resolving Dependencies 2019-12-09T09:38:30.910 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:38:30.910 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:38:31.199 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:31.284 INFO:teuthology.orchestra.run.smithi132.stdout:--> Finished Dependency Resolution 2019-12-09T09:38:31.466 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:31.467 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies Resolved 2019-12-09T09:38:31.467 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:31.468 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:31.468 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository 2019-12-09T09:38:31.468 INFO:teuthology.orchestra.run.smithi132.stdout: Size 2019-12-09T09:38:31.468 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:31.468 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2019-12-09T09:38:31.469 INFO:teuthology.orchestra.run.smithi132.stdout: python-ceph-compat x86_64 2:15.0.0-7900.g1351c81.el7 ceph 2.2 k 2019-12-09T09:38:31.469 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:31.469 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2019-12-09T09:38:31.469 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:31.469 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2019-12-09T09:38:31.469 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:31.470 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 2.2 k 2019-12-09T09:38:31.470 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 0 2019-12-09T09:38:31.470 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading packages: 2019-12-09T09:38:31.523 INFO:teuthology.orchestra.run.smithi121.stdout:Resolving Dependencies 2019-12-09T09:38:31.523 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:38:31.524 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:38:31.780 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2019-12-09T09:38:31.781 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2019-12-09T09:38:31.783 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded 2019-12-09T09:38:31.784 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2019-12-09T09:38:31.897 INFO:teuthology.orchestra.run.smithi121.stdout:--> Finished Dependency Resolution 2019-12-09T09:38:32.081 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:32.081 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies Resolved 2019-12-09T09:38:32.082 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:32.082 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:38:32.082 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2019-12-09T09:38:32.083 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:38:32.083 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2019-12-09T09:38:32.083 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 76 k 2019-12-09T09:38:32.083 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:32.083 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2019-12-09T09:38:32.083 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:38:32.083 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2019-12-09T09:38:32.084 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:32.084 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 76 k 2019-12-09T09:38:32.084 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 200 k 2019-12-09T09:38:32.084 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading packages: 2019-12-09T09:38:32.353 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:python-ceph-compat-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T09:38:32.429 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2019-12-09T09:38:32.451 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2019-12-09T09:38:32.453 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded 2019-12-09T09:38:32.454 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2019-12-09T09:38:32.887 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:python-ceph-compat-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T09:38:32.887 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:32.887 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2019-12-09T09:38:32.887 INFO:teuthology.orchestra.run.smithi132.stdout: python-ceph-compat.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:38:32.888 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:32.888 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2019-12-09T09:38:33.007 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install rbd-fuse 2019-12-09T09:38:33.009 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : 2:rbd-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T09:38:33.235 INFO:teuthology.orchestra.run.smithi132.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:38:33.276 INFO:teuthology.orchestra.run.smithi132.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:38:33.276 INFO:teuthology.orchestra.run.smithi132.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:38:33.277 INFO:teuthology.orchestra.run.smithi132.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:38:33.277 INFO:teuthology.orchestra.run.smithi132.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:38:33.278 INFO:teuthology.orchestra.run.smithi132.stdout: * updates: mirror.cogentco.com 2019-12-09T09:38:33.468 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : 2:rbd-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T09:38:33.468 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:33.468 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2019-12-09T09:38:33.468 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:38:33.469 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:38:33.469 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2019-12-09T09:38:33.575 DEBUG:teuthology.parallel:result is None 2019-12-09T09:38:33.925 INFO:teuthology.orchestra.run.smithi132.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:38:34.254 INFO:teuthology.orchestra.run.smithi132.stdout:Resolving Dependencies 2019-12-09T09:38:34.255 INFO:teuthology.orchestra.run.smithi132.stdout:--> Running transaction check 2019-12-09T09:38:34.255 INFO:teuthology.orchestra.run.smithi132.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-09T09:38:34.632 INFO:teuthology.orchestra.run.smithi132.stdout:--> Finished Dependency Resolution 2019-12-09T09:38:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:34.816 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies Resolved 2019-12-09T09:38:34.817 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:34.817 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:34.817 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2019-12-09T09:38:34.817 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:34.818 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2019-12-09T09:38:34.818 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 76 k 2019-12-09T09:38:34.818 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:34.818 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2019-12-09T09:38:34.818 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2019-12-09T09:38:34.818 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2019-12-09T09:38:34.818 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:34.819 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 76 k 2019-12-09T09:38:34.819 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 200 k 2019-12-09T09:38:34.819 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading packages: 2019-12-09T09:38:35.169 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2019-12-09T09:38:35.182 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2019-12-09T09:38:35.184 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded 2019-12-09T09:38:35.184 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2019-12-09T09:38:35.714 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : 2:rbd-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T09:38:36.417 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : 2:rbd-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-09T09:38:36.418 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:36.418 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2019-12-09T09:38:36.418 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-09T09:38:36.418 INFO:teuthology.orchestra.run.smithi132.stdout: 2019-12-09T09:38:36.418 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2019-12-09T09:38:36.541 DEBUG:teuthology.parallel:result is None 2019-12-09T09:38:36.542 INFO:teuthology.orchestra.run.smithi121:> sudo lsb_release -is 2019-12-09T09:38:36.693 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS 2019-12-09T09:38:36.695 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-09T09:38:36.695 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=1351c819e1a9518cde4c8b12d645782009028360 2019-12-09T09:38:36.861 INFO:teuthology.orchestra.run.smithi121:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-12-09T09:38:36.993 INFO:teuthology.orchestra.run.smithi121.stdout:15.0.0-7900.g1351c81.el7 2019-12-09T09:38:36.994 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7900.g1351c81.el7 2019-12-09T09:38:36.994 INFO:teuthology.task.install:The correct ceph version 15.0.0-7900.g1351c81 is installed. 2019-12-09T09:38:36.994 INFO:teuthology.orchestra.run.smithi132:> sudo lsb_release -is 2019-12-09T09:38:37.145 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS 2019-12-09T09:38:37.147 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-09T09:38:37.147 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=1351c819e1a9518cde4c8b12d645782009028360 2019-12-09T09:38:37.306 INFO:teuthology.orchestra.run.smithi132:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-12-09T09:38:37.445 INFO:teuthology.orchestra.run.smithi132.stdout:15.0.0-7900.g1351c81.el7 2019-12-09T09:38:37.446 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7900.g1351c81.el7 2019-12-09T09:38:37.446 INFO:teuthology.task.install:The correct ceph version 15.0.0-7900.g1351c81 is installed. 2019-12-09T09:38:37.446 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-12-09T09:38:37.446 INFO:teuthology.orchestra.run.smithi121:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-09T09:38:37.568 INFO:teuthology.orchestra.run.smithi132:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-09T09:38:37.690 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-12-09T09:38:37.691 INFO:teuthology.orchestra.run.smithi121:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-09T09:38:37.813 INFO:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-09T09:38:37.929 INFO:teuthology.orchestra.run.smithi132:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-09T09:38:38.109 INFO:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-09T09:38:38.214 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-12-09T09:38:38.215 INFO:teuthology.orchestra.run.smithi121:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-09T09:38:38.337 INFO:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-09T09:38:38.436 INFO:teuthology.orchestra.run.smithi132:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-09T09:38:38.557 INFO:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-09T09:38:38.663 INFO:teuthology.run_tasks:Running task ceph... 2019-12-09T09:38:38.792 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2019-12-09T09:38:38.792 INFO:teuthology.orchestra.run.smithi121:> sudo chmod 777 /var/log/ceph 2019-12-09T09:38:38.796 INFO:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2019-12-09T09:38:38.918 INFO:tasks.ceph:Disabling ceph logrotate... 2019-12-09T09:38:38.919 INFO:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/logrotate.d/ceph 2019-12-09T09:38:38.930 INFO:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2019-12-09T09:38:39.036 INFO:tasks.ceph:Creating extra log directories... 2019-12-09T09:38:39.036 INFO:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-12-09T09:38:39.041 INFO:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-12-09T09:38:39.145 INFO:tasks.ceph:Creating ceph cluster ceph... 2019-12-09T09:38:39.145 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'debug ms': 1, 'debug journal': 20, 'osd fast shutdown': False, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd sloppy crc': True, 'debug filestore': 20, 'osd shutdown pgref assert': True}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}} 2019-12-09T09:38:39.146 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'flavor': 'notcmalloc', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh']}}}, {'ragweed': {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}}}, {'s3tests-java': {'client.0': {'force-repo': 'https://github.com/ceph/java_s3tests.git', 'force-branch': 'master'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}}}, {'swift': {'client.0': {'rgw_server': 'client.0'}}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.29534', 'owner': 'scheduled_ofriedma@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'targets': {'smithi121.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9Q1nXH6WHjP9As7cMHu6H9iQSjfQw5lx28eYO82uOiyb9w+6wklzp9ymHNdB8jZjjWFGGYX6RtEEc6QpRf0VcP9hevwfgJuM/2Cg+yqjRFsqx1QBI5290FHY3K5WpNdFpDykse4WtDT0fqtk/SSEzY7vGRzbBRjT56Xsyyl5UA5WQTJW0KLv2shtEevg3Q/g2KU9WBmbE5vACKykuRd+/BwKlHwtIRDYRjMsgCdTa2/+KhajmjygkqZk/sk2Fxj8Qn6mA2vh6VBfuNE4hGrqOW884ZEcy4JIaGSQxjJWKIrq1NUoqup6GPmbwGH361zF2/R2wprPdPVqNZXVjhhwF', 'smithi132.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDtI/Noh4STN/oCwCHowUPiNadUDdFWJ4GmFu4xB1whIpkd26MtDNkFbv6MYLrhbM9vW9eGw5FOVdDdTEJ5ckQhOMhj5A7Wa20OIfuNMeoKz1FbfE9av68rdYn8rzgD3kOwH24h6qbpWdGgTbb+8XGgFRlfGaV6360aJ20sR0E9nANLelP0kCfc/zgECuv0lYpwagrfPYdUBjISMgWNyuFCPlX3qvuLb5r6ZsPq8RyVF92hkSKSmmbKhFoqXNB3b32/0l/vE2Hyb1JW+lfsffIXSh5MKb2p/1nKQMFV0fWeTDrkbOtT4KOOvkG2yi9GrKXFa+Hv2TfA7Bn6YrIVgIgF'}, 'job_id': '4584243', 'tube': 'smithi', 'suite_branch': 'wip-ofriedma-dynamic-disable', 'priority': 60, 'first_in_suite': False, 'branch': 'wip-ofriedma-dynamic-disable', 'suite': 'rgw', 'email': 'ofriedma@redhat.com', 'archive_path': '/home/teuthworker/archive/ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4584243', 'description': 'rgw/verify/{clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}', 'nuke-on-error': True, 'repo': 'https://github.com/ceph/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360', 'name': 'ofriedma-2019-12-09_08:35:41-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '1351c819e1a9518cde4c8b12d645782009028360', 'os_type': 'centos', 'overrides': {'s3tests': {'slow_backend': True}, 'ceph-deploy': {'fs': 'xfs', 'filestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'osd sloppy crc': True, 'osd objectstore': 'filestore'}}}, 'rgw': {'frontend': 'beast', 'ec-data-pool': True, 'client.1': {'ssl certificate': 'rgw.client.1'}, 'client.0': {'ssl certificate': 'rgw.client.0'}, 'storage classes': 'LUKEWARM, FROZEN', 'compression type': 'random'}, 'workunit': {'sha1': '1351c819e1a9518cde4c8b12d645782009028360', 'branch': 'wip-ofriedma-dynamic-disable'}, 'ceph': {'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'debug ms': 1, 'debug journal': 20, 'osd fast shutdown': False, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd sloppy crc': True, 'debug filestore': 20, 'osd shutdown pgref assert': True}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}, 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}, 'fs': 'xfs', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360'}, 'openssl_keys': {'rgw.client.1': {'ca': 'root', 'client': 'client.1', 'embed-key': True}, 'root': {'key-type': 'rsa:4096', 'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0', 'client.1']}, 'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}}, 'install': {'ceph': {'flavor': 'notcmalloc', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360'}}, 'admin_socket': {'branch': 'wip-ofriedma-dynamic-disable'}}} 2019-12-09T09:38:39.147 INFO:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-12-09T09:38:39.155 INFO:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-12-09T09:38:39.235 INFO:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/run/ceph 2019-12-09T09:38:39.240 INFO:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2019-12-09T09:38:39.430 DEBUG:teuthology.orchestra.remote:smithi121:/scratch_devs is 72B 2019-12-09T09:38:39.515 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-09T09:38:39.515 INFO:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-09T09:38:39.580 INFO:teuthology.orchestra.run.smithi121.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-12-09T09:38:39.581 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-09T09:38:39.581 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 96054 Links: 1 2019-12-09T09:38:39.581 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-09T09:38:39.581 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2019-12-09T09:38:39.581 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2019-12-09 09:37:27.486642001 +0000 2019-12-09T09:38:39.581 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2019-12-09 09:35:42.252553680 +0000 2019-12-09T09:38:39.581 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2019-12-09 09:35:42.252553680 +0000 2019-12-09T09:38:39.582 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2019-12-09T09:38:39.606 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2019-12-09T09:38:39.606 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2019-12-09T09:38:39.607 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes (512 B) copied, 0.000406781 s, 1.3 MB/s 2019-12-09T09:38:39.610 INFO:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-09T09:38:39.672 INFO:teuthology.orchestra.run.smithi121.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-12-09T09:38:39.673 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-09T09:38:39.673 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 104760 Links: 1 2019-12-09T09:38:39.673 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-09T09:38:39.673 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2019-12-09T09:38:39.673 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2019-12-09 09:37:27.486642001 +0000 2019-12-09T09:38:39.673 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2019-12-09 09:35:42.734546967 +0000 2019-12-09T09:38:39.673 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2019-12-09 09:35:42.734546967 +0000 2019-12-09T09:38:39.674 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2019-12-09T09:38:39.691 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2019-12-09T09:38:39.692 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2019-12-09T09:38:39.692 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes (512 B) copied, 0.000310432 s, 1.6 MB/s 2019-12-09T09:38:39.696 INFO:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-09T09:38:39.744 INFO:teuthology.orchestra.run.smithi121.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-12-09T09:38:39.744 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-09T09:38:39.744 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 104790 Links: 1 2019-12-09T09:38:39.745 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-09T09:38:39.745 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2019-12-09T09:38:39.745 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2019-12-09 09:37:27.486642001 +0000 2019-12-09T09:38:39.745 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2019-12-09 09:35:43.250539780 +0000 2019-12-09T09:38:39.746 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2019-12-09 09:35:43.250539780 +0000 2019-12-09T09:38:39.746 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2019-12-09T09:38:39.761 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2019-12-09T09:38:39.761 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2019-12-09T09:38:39.761 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes (512 B) copied, 0.000361615 s, 1.4 MB/s 2019-12-09T09:38:39.764 INFO:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-09T09:38:39.811 INFO:teuthology.orchestra.run.smithi121.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-12-09T09:38:39.811 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-09T09:38:39.811 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 109602 Links: 1 2019-12-09T09:38:39.811 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-09T09:38:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2019-12-09T09:38:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2019-12-09 09:37:27.486642001 +0000 2019-12-09T09:38:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2019-12-09 09:35:43.711533359 +0000 2019-12-09T09:38:39.812 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2019-12-09 09:35:43.711533359 +0000 2019-12-09T09:38:39.812 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2019-12-09T09:38:39.826 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2019-12-09T09:38:39.826 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2019-12-09T09:38:39.826 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes (512 B) copied, 0.000457939 s, 1.1 MB/s 2019-12-09T09:38:39.829 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-12-09T09:38:39.829 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-09T09:38:39.830 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-12-09T09:38:39.830 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-09T09:38:39.925 DEBUG:teuthology.orchestra.remote:smithi132:/scratch_devs is 72B 2019-12-09T09:38:40.013 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-09T09:38:40.013 INFO:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-09T09:38:40.083 INFO:teuthology.orchestra.run.smithi132.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-12-09T09:38:40.083 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-09T09:38:40.083 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 106252 Links: 1 2019-12-09T09:38:40.083 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-09T09:38:40.083 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2019-12-09T09:38:40.084 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2019-12-09 09:37:30.841947895 +0000 2019-12-09T09:38:40.084 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2019-12-09 09:35:42.181379698 +0000 2019-12-09T09:38:40.084 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2019-12-09 09:35:42.181379698 +0000 2019-12-09T09:38:40.084 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2019-12-09T09:38:40.112 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2019-12-09T09:38:40.112 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2019-12-09T09:38:40.113 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes (512 B) copied, 0.000321679 s, 1.6 MB/s 2019-12-09T09:38:40.118 INFO:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-09T09:38:40.175 INFO:teuthology.orchestra.run.smithi132.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-12-09T09:38:40.175 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-09T09:38:40.175 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 96154 Links: 1 2019-12-09T09:38:40.175 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-09T09:38:40.175 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2019-12-09T09:38:40.175 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2019-12-09 09:37:30.841947895 +0000 2019-12-09T09:38:40.176 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2019-12-09 09:35:42.649365004 +0000 2019-12-09T09:38:40.176 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2019-12-09 09:35:42.649365004 +0000 2019-12-09T09:38:40.176 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2019-12-09T09:38:40.198 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2019-12-09T09:38:40.198 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2019-12-09T09:38:40.198 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes (512 B) copied, 0.000303052 s, 1.7 MB/s 2019-12-09T09:38:40.202 INFO:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-09T09:38:40.273 INFO:teuthology.orchestra.run.smithi132.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-12-09T09:38:40.274 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-09T09:38:40.274 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 104901 Links: 1 2019-12-09T09:38:40.274 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-09T09:38:40.274 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2019-12-09T09:38:40.274 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2019-12-09 09:37:30.841947895 +0000 2019-12-09T09:38:40.274 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2019-12-09 09:35:43.146349400 +0000 2019-12-09T09:38:40.274 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2019-12-09 09:35:43.146349400 +0000 2019-12-09T09:38:40.275 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2019-12-09T09:38:40.290 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2019-12-09T09:38:40.290 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2019-12-09T09:38:40.290 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes (512 B) copied, 0.00042781 s, 1.2 MB/s 2019-12-09T09:38:40.294 INFO:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-09T09:38:40.353 INFO:teuthology.orchestra.run.smithi132.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-12-09T09:38:40.353 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-09T09:38:40.353 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 106334 Links: 1 2019-12-09T09:38:40.353 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-09T09:38:40.353 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2019-12-09T09:38:40.353 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2019-12-09 09:37:30.841947895 +0000 2019-12-09T09:38:40.354 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2019-12-09 09:35:43.598335208 +0000 2019-12-09T09:38:40.354 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2019-12-09 09:35:43.598335208 +0000 2019-12-09T09:38:40.354 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2019-12-09T09:38:40.370 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2019-12-09T09:38:40.370 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2019-12-09T09:38:40.370 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes (512 B) copied, 0.000351919 s, 1.5 MB/s 2019-12-09T09:38:40.373 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-12-09T09:38:40.373 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-09T09:38:40.373 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-12-09T09:38:40.373 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-09T09:38:40.373 INFO:tasks.ceph:Generating config... 2019-12-09T09:38:40.375 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2019-12-09T09:38:40.376 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2019-12-09T09:38:40.376 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2019-12-09T09:38:40.376 INFO:tasks.ceph:[global] mon client directed command retry = 5 2019-12-09T09:38:40.376 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2019-12-09T09:38:40.376 INFO:tasks.ceph:[osd] debug ms = 1 2019-12-09T09:38:40.376 INFO:tasks.ceph:[osd] debug journal = 20 2019-12-09T09:38:40.376 INFO:tasks.ceph:[osd] osd fast shutdown = False 2019-12-09T09:38:40.377 INFO:tasks.ceph:[osd] debug osd = 25 2019-12-09T09:38:40.377 INFO:tasks.ceph:[osd] osd objectstore = filestore 2019-12-09T09:38:40.377 INFO:tasks.ceph:[osd] osd sloppy crc = True 2019-12-09T09:38:40.377 INFO:tasks.ceph:[osd] debug filestore = 20 2019-12-09T09:38:40.377 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2019-12-09T09:38:40.377 INFO:tasks.ceph:[mon] debug mon = 20 2019-12-09T09:38:40.377 INFO:tasks.ceph:[mon] debug paxos = 20 2019-12-09T09:38:40.377 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2019-12-09T09:38:40.378 INFO:tasks.ceph:[mon] debug ms = 1 2019-12-09T09:38:40.378 INFO:tasks.ceph:[client] debug rgw = 20 2019-12-09T09:38:40.378 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2019-12-09T09:38:40.378 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2019-12-09T09:38:40.378 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2019-12-09T09:38:40.380 INFO:tasks.ceph:[client] rgw lc debug interval = 10 2019-12-09T09:38:40.380 INFO:tasks.ceph:Setting up mon.a... 2019-12-09T09:38:40.380 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2019-12-09T09:38:40.546 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.keyring 2019-12-09T09:38:40.551 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2019-12-09T09:38:40.707 INFO:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-09T09:38:40.809 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.121'), ('mon.c', '[v2:172.21.15.121:3301,v1:172.21.15.121:6790]'), ('mon.b', '172.21.15.132')] 2019-12-09T09:38:40.810 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.121 --addv c '[v2:172.21.15.121:3301,v1:172.21.15.121:6790]' --add b 172.21.15.132 --print /home/ubuntu/cephtest/ceph.monmap 2019-12-09T09:38:40.911 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2019-12-09T09:38:40.912 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: generated fsid 088b3efd-6d92-4fd4-828b-36094e307953 2019-12-09T09:38:40.912 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 0 2019-12-09T09:38:40.912 INFO:teuthology.orchestra.run.smithi121.stdout:fsid 088b3efd-6d92-4fd4-828b-36094e307953 2019-12-09T09:38:40.912 INFO:teuthology.orchestra.run.smithi121.stdout:last_changed 2019-12-09T09:38:40.912347+0000 2019-12-09T09:38:40.912 INFO:teuthology.orchestra.run.smithi121.stdout:created 2019-12-09T09:38:40.912347+0000 2019-12-09T09:38:40.912 INFO:teuthology.orchestra.run.smithi121.stdout:min_mon_release 0 (unknown) 2019-12-09T09:38:40.913 INFO:teuthology.orchestra.run.smithi121.stdout:0: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.a 2019-12-09T09:38:40.913 INFO:teuthology.orchestra.run.smithi121.stdout:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2019-12-09T09:38:40.913 INFO:teuthology.orchestra.run.smithi121.stdout:2: [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] mon.c 2019-12-09T09:38:40.913 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2019-12-09T09:38:40.914 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 088b3efd-6d92-4fd4-828b-36094e307953... 2019-12-09T09:38:40.915 INFO:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-12-09T09:38:40.918 INFO:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-12-09T09:38:41.100 INFO:tasks.ceph:Creating admin key on mon.a... 2019-12-09T09:38:41.100 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2019-12-09T09:38:41.232 INFO:tasks.ceph:Copying monmap to all nodes... 2019-12-09T09:38:41.308 DEBUG:teuthology.orchestra.remote:smithi121:/etc/ceph/ceph.keyring is 206B 2019-12-09T09:38:41.463 DEBUG:teuthology.orchestra.remote:smithi121:/home/ubuntu/cephtest/ceph.monmap is 379B 2019-12-09T09:38:41.544 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi121.front.sepia.ceph.com 2019-12-09T09:38:41.544 INFO:teuthology.orchestra.run.smithi121:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-09T09:38:41.652 INFO:teuthology.orchestra.run.smithi121:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-12-09T09:38:41.708 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2019-12-09T09:38:41.708 INFO:teuthology.orchestra.run.smithi132:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-09T09:38:41.856 INFO:teuthology.orchestra.run.smithi132:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-12-09T09:38:41.927 INFO:tasks.ceph:Setting up mon nodes... 2019-12-09T09:38:41.927 INFO:tasks.ceph:Setting up mgr nodes... 2019-12-09T09:38:41.928 INFO:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2019-12-09T09:38:42.087 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2019-12-09T09:38:42.099 INFO:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2019-12-09T09:38:42.286 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2019-12-09T09:38:42.290 INFO:tasks.ceph:Setting up mds nodes... 2019-12-09T09:38:42.290 INFO:tasks.ceph_client:Setting up client nodes... 2019-12-09T09:38:42.290 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2019-12-09T09:38:42.431 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.client.0.keyring 2019-12-09T09:38:42.461 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2019-12-09T09:38:42.604 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.client.1.keyring 2019-12-09T09:38:42.639 INFO:tasks.ceph:Running mkfs on osd nodes... 2019-12-09T09:38:42.639 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}} 2019-12-09T09:38:42.639 INFO:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2019-12-09T09:38:42.753 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-09T09:38:42.754 INFO:tasks.ceph:{} 2019-12-09T09:38:42.754 INFO:tasks.ceph:osd.0 2019-12-09T09:38:42.754 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi121.front.sepia.ceph.com 2019-12-09T09:38:42.754 INFO:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-12-09T09:38:43.338 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-12-09T09:38:43.338 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-09T09:38:43.338 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=0, sparse=0 2019-12-09T09:38:43.338 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-09T09:38:43.338 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2019-12-09T09:38:43.339 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-09T09:38:43.339 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-09T09:38:43.339 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-09T09:38:43.339 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-09T09:38:43.340 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2019-12-09T09:38:43.341 INFO:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2019-12-09T09:38:43.538 INFO:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2019-12-09T09:38:43.662 INFO:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2019-12-09T09:38:43.757 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-09T09:38:43.757 INFO:tasks.ceph:{} 2019-12-09T09:38:43.757 INFO:tasks.ceph:osd.1 2019-12-09T09:38:43.757 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com 2019-12-09T09:38:43.757 INFO:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-12-09T09:38:44.307 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-12-09T09:38:44.307 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-09T09:38:44.307 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=0, sparse=0 2019-12-09T09:38:44.308 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-09T09:38:44.308 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2019-12-09T09:38:44.308 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-09T09:38:44.308 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-09T09:38:44.308 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-09T09:38:44.308 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-09T09:38:44.309 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2019-12-09T09:38:44.309 INFO:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2019-12-09T09:38:44.468 INFO:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2019-12-09T09:38:44.584 INFO:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2019-12-09T09:38:44.688 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-09T09:38:44.689 INFO:tasks.ceph:{} 2019-12-09T09:38:44.689 INFO:tasks.ceph:osd.2 2019-12-09T09:38:44.689 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com 2019-12-09T09:38:44.689 INFO:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-12-09T09:38:45.280 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-12-09T09:38:45.280 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-09T09:38:45.280 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=0, sparse=0 2019-12-09T09:38:45.280 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-09T09:38:45.281 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2019-12-09T09:38:45.281 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-09T09:38:45.281 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-09T09:38:45.281 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-09T09:38:45.281 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-09T09:38:45.283 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2019-12-09T09:38:45.283 INFO:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2019-12-09T09:38:45.461 INFO:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2019-12-09T09:38:45.569 INFO:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2019-12-09T09:38:45.673 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-09T09:38:45.673 INFO:tasks.ceph:{} 2019-12-09T09:38:45.674 INFO:tasks.ceph:osd.3 2019-12-09T09:38:45.674 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com 2019-12-09T09:38:45.674 INFO:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-12-09T09:38:46.233 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-12-09T09:38:46.233 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-09T09:38:46.234 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=0, sparse=0 2019-12-09T09:38:46.234 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-09T09:38:46.234 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2019-12-09T09:38:46.234 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-09T09:38:46.235 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-09T09:38:46.235 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-09T09:38:46.235 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-09T09:38:46.236 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2019-12-09T09:38:46.237 INFO:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2019-12-09T09:38:46.354 INFO:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2019-12-09T09:38:46.429 INFO:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-09T09:38:46.546 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:46.546+0000 7f2030243b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2019-12-09T09:38:46.548 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:46.548+0000 7f2030243b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2019-12-09T09:38:46.571 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:46.570+0000 7f2030243b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:38:46.571 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:46.571+0000 7f2030243b40 -1 journal FileJournal::_open_file : zeroing journal 2019-12-09T09:38:46.820 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:46.819+0000 7f2030243b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:38:46.822 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:46.822+0000 7f2030243b40 -1 journal do_read_entry(4096): bad header magic 2019-12-09T09:38:46.823 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:46.822+0000 7f2030243b40 -1 journal do_read_entry(4096): bad header magic 2019-12-09T09:38:46.852 INFO:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2019-12-09T09:38:46.961 INFO:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-09T09:38:47.074 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:47.074+0000 7f7ddbde4b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2019-12-09T09:38:47.079 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:47.078+0000 7f7ddbde4b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2019-12-09T09:38:47.119 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:47.119+0000 7f7ddbde4b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:38:47.120 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:47.119+0000 7f7ddbde4b40 -1 journal FileJournal::_open_file : zeroing journal 2019-12-09T09:38:47.370 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:47.369+0000 7f7ddbde4b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:38:47.371 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:47.371+0000 7f7ddbde4b40 -1 journal do_read_entry(4096): bad header magic 2019-12-09T09:38:47.371 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:47.371+0000 7f7ddbde4b40 -1 journal do_read_entry(4096): bad header magic 2019-12-09T09:38:47.404 INFO:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2019-12-09T09:38:47.516 INFO:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-09T09:38:47.640 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:47.639+0000 7f6eebc0bb40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2019-12-09T09:38:47.641 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:47.640+0000 7f6eebc0bb40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2019-12-09T09:38:47.656 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:47.656+0000 7f6eebc0bb40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:38:47.657 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:47.656+0000 7f6eebc0bb40 -1 journal FileJournal::_open_file : zeroing journal 2019-12-09T09:38:47.804 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:47.803+0000 7f6eebc0bb40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:38:47.804 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:47.803+0000 7f6eebc0bb40 -1 journal do_read_entry(4096): bad header magic 2019-12-09T09:38:47.804 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:47.803+0000 7f6eebc0bb40 -1 journal do_read_entry(4096): bad header magic 2019-12-09T09:38:47.818 INFO:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2019-12-09T09:38:47.919 INFO:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-09T09:38:48.034 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:48.034+0000 7ff47e375b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2019-12-09T09:38:48.035 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:48.034+0000 7ff47e375b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2019-12-09T09:38:48.047 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:48.047+0000 7ff47e375b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:38:48.048 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:48.047+0000 7ff47e375b40 -1 journal FileJournal::_open_file : zeroing journal 2019-12-09T09:38:48.189 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:48.186+0000 7ff47e375b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:38:48.189 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:48.186+0000 7ff47e375b40 -1 journal do_read_entry(4096): bad header magic 2019-12-09T09:38:48.189 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:38:48.186+0000 7ff47e375b40 -1 journal do_read_entry(4096): bad header magic 2019-12-09T09:38:48.200 INFO:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2019-12-09T09:38:48.282 INFO:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2019-12-09T09:38:48.401 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-09T09:38:48.401 INFO:tasks.ceph:{} 2019-12-09T09:38:48.402 INFO:tasks.ceph:osd.4 2019-12-09T09:38:48.402 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com 2019-12-09T09:38:48.402 INFO:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-12-09T09:38:48.994 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-12-09T09:38:48.995 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-09T09:38:48.995 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=0, sparse=0 2019-12-09T09:38:48.995 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-09T09:38:48.995 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2019-12-09T09:38:48.995 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-09T09:38:48.995 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-09T09:38:48.996 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-09T09:38:48.996 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-09T09:38:48.997 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2019-12-09T09:38:48.998 INFO:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2019-12-09T09:38:49.177 INFO:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2019-12-09T09:38:49.273 INFO:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2019-12-09T09:38:49.346 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-09T09:38:49.346 INFO:tasks.ceph:{} 2019-12-09T09:38:49.346 INFO:tasks.ceph:osd.5 2019-12-09T09:38:49.347 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2019-12-09T09:38:49.347 INFO:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-12-09T09:38:49.864 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-12-09T09:38:49.864 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-09T09:38:49.864 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=0, sparse=0 2019-12-09T09:38:49.865 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-09T09:38:49.865 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2019-12-09T09:38:49.865 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-09T09:38:49.865 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-09T09:38:49.865 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-09T09:38:49.865 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-09T09:38:49.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2019-12-09T09:38:49.867 INFO:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2019-12-09T09:38:50.011 INFO:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2019-12-09T09:38:50.096 INFO:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2019-12-09T09:38:50.177 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-09T09:38:50.177 INFO:tasks.ceph:{} 2019-12-09T09:38:50.177 INFO:tasks.ceph:osd.6 2019-12-09T09:38:50.177 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com 2019-12-09T09:38:50.178 INFO:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-12-09T09:38:50.731 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-12-09T09:38:50.731 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-09T09:38:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=0, sparse=0 2019-12-09T09:38:50.732 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-09T09:38:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2019-12-09T09:38:50.732 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-09T09:38:50.732 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-09T09:38:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-09T09:38:50.733 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-09T09:38:50.737 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2019-12-09T09:38:50.737 INFO:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2019-12-09T09:38:50.893 INFO:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2019-12-09T09:38:51.011 INFO:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2019-12-09T09:38:51.108 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-09T09:38:51.108 INFO:tasks.ceph:{} 2019-12-09T09:38:51.108 INFO:tasks.ceph:osd.7 2019-12-09T09:38:51.108 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com 2019-12-09T09:38:51.108 INFO:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-12-09T09:38:51.653 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-12-09T09:38:51.653 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-09T09:38:51.653 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=0, sparse=0 2019-12-09T09:38:51.654 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-09T09:38:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2019-12-09T09:38:51.654 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-09T09:38:51.654 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-09T09:38:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-09T09:38:51.654 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-09T09:38:51.656 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2019-12-09T09:38:51.656 INFO:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2019-12-09T09:38:51.785 INFO:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2019-12-09T09:38:51.895 INFO:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-09T09:38:52.041 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.027+0000 7ff988231b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2019-12-09T09:38:52.042 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.028+0000 7ff988231b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2019-12-09T09:38:52.056 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.042+0000 7ff988231b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:38:52.056 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.042+0000 7ff988231b40 -1 journal FileJournal::_open_file : zeroing journal 2019-12-09T09:38:52.199 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.185+0000 7ff988231b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:38:52.200 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.185+0000 7ff988231b40 -1 journal do_read_entry(4096): bad header magic 2019-12-09T09:38:52.200 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.185+0000 7ff988231b40 -1 journal do_read_entry(4096): bad header magic 2019-12-09T09:38:52.214 INFO:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2019-12-09T09:38:52.312 INFO:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-09T09:38:52.433 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.418+0000 7fccd6ed3b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2019-12-09T09:38:52.433 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.419+0000 7fccd6ed3b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2019-12-09T09:38:52.449 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.435+0000 7fccd6ed3b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:38:52.449 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.435+0000 7fccd6ed3b40 -1 journal FileJournal::_open_file : zeroing journal 2019-12-09T09:38:52.585 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.571+0000 7fccd6ed3b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:38:52.586 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.571+0000 7fccd6ed3b40 -1 journal do_read_entry(4096): bad header magic 2019-12-09T09:38:52.586 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.571+0000 7fccd6ed3b40 -1 journal do_read_entry(4096): bad header magic 2019-12-09T09:38:52.596 INFO:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2019-12-09T09:38:52.690 INFO:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-09T09:38:52.811 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.796+0000 7f0fe81e7b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2019-12-09T09:38:52.811 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.797+0000 7f0fe81e7b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2019-12-09T09:38:52.826 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.812+0000 7f0fe81e7b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:38:52.826 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.812+0000 7f0fe81e7b40 -1 journal FileJournal::_open_file : zeroing journal 2019-12-09T09:38:52.968 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.954+0000 7f0fe81e7b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:38:52.968 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.954+0000 7f0fe81e7b40 -1 journal do_read_entry(4096): bad header magic 2019-12-09T09:38:52.969 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:52.954+0000 7f0fe81e7b40 -1 journal do_read_entry(4096): bad header magic 2019-12-09T09:38:52.980 INFO:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2019-12-09T09:38:53.067 INFO:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-09T09:38:53.166 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:53.153+0000 7f555f796b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2019-12-09T09:38:53.167 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:53.153+0000 7f555f796b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2019-12-09T09:38:53.175 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:53.162+0000 7f555f796b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:38:53.175 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:53.162+0000 7f555f796b40 -1 journal FileJournal::_open_file : zeroing journal 2019-12-09T09:38:53.321 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:53.307+0000 7f555f796b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:38:53.321 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:53.308+0000 7f555f796b40 -1 journal do_read_entry(4096): bad header magic 2019-12-09T09:38:53.321 INFO:teuthology.orchestra.run.smithi132.stderr:2019-12-09T09:38:53.308+0000 7f555f796b40 -1 journal do_read_entry(4096): bad header magic 2019-12-09T09:38:53.334 INFO:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2019-12-09T09:38:53.421 INFO:tasks.ceph:Reading keys from all nodes... 2019-12-09T09:38:53.421 INFO:teuthology.orchestra.run.smithi121:> mktemp 2019-12-09T09:38:53.510 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.a9ACvxs6Jd 2019-12-09T09:38:53.510 INFO:teuthology.orchestra.run.smithi121:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.a9ACvxs6Jd 2019-12-09T09:38:53.601 INFO:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.a9ACvxs6Jd 2019-12-09T09:38:53.750 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.a9ACvxs6Jd is 56B 2019-12-09T09:38:53.817 INFO:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.a9ACvxs6Jd 2019-12-09T09:38:53.871 INFO:teuthology.orchestra.run.smithi121:> mktemp 2019-12-09T09:38:53.921 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.MdOSwIURXk 2019-12-09T09:38:53.922 INFO:teuthology.orchestra.run.smithi121:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.MdOSwIURXk 2019-12-09T09:38:53.989 INFO:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.MdOSwIURXk 2019-12-09T09:38:54.109 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.MdOSwIURXk is 56B 2019-12-09T09:38:54.164 INFO:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.MdOSwIURXk 2019-12-09T09:38:54.209 INFO:teuthology.orchestra.run.smithi121:> mktemp 2019-12-09T09:38:54.326 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.9mCekLibNI 2019-12-09T09:38:54.326 INFO:teuthology.orchestra.run.smithi121:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.9mCekLibNI 2019-12-09T09:38:54.439 INFO:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.9mCekLibNI 2019-12-09T09:38:54.618 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.9mCekLibNI is 56B 2019-12-09T09:38:54.704 INFO:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.9mCekLibNI 2019-12-09T09:38:54.768 INFO:teuthology.orchestra.run.smithi121:> mktemp 2019-12-09T09:38:54.833 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.d336g9decC 2019-12-09T09:38:54.834 INFO:teuthology.orchestra.run.smithi121:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.d336g9decC 2019-12-09T09:38:54.917 INFO:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.d336g9decC 2019-12-09T09:38:55.057 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.d336g9decC is 56B 2019-12-09T09:38:55.114 INFO:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.d336g9decC 2019-12-09T09:38:55.166 INFO:teuthology.orchestra.run.smithi121:> mktemp 2019-12-09T09:38:55.212 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.a664szAVcB 2019-12-09T09:38:55.212 INFO:teuthology.orchestra.run.smithi121:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.a664szAVcB 2019-12-09T09:38:55.276 INFO:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.a664szAVcB 2019-12-09T09:38:55.388 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.a664szAVcB is 56B 2019-12-09T09:38:55.443 INFO:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.a664szAVcB 2019-12-09T09:38:55.487 INFO:teuthology.orchestra.run.smithi132:> mktemp 2019-12-09T09:38:55.579 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.1SlWI9NuKV 2019-12-09T09:38:55.580 INFO:teuthology.orchestra.run.smithi132:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.1SlWI9NuKV 2019-12-09T09:38:55.683 INFO:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.1SlWI9NuKV 2019-12-09T09:38:55.838 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.1SlWI9NuKV is 56B 2019-12-09T09:38:55.909 INFO:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.1SlWI9NuKV 2019-12-09T09:38:55.964 INFO:teuthology.orchestra.run.smithi132:> mktemp 2019-12-09T09:38:56.098 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.0tQuGHNIap 2019-12-09T09:38:56.098 INFO:teuthology.orchestra.run.smithi132:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.0tQuGHNIap 2019-12-09T09:38:56.198 INFO:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.0tQuGHNIap 2019-12-09T09:38:56.368 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.0tQuGHNIap is 56B 2019-12-09T09:38:56.433 INFO:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.0tQuGHNIap 2019-12-09T09:38:56.486 INFO:teuthology.orchestra.run.smithi132:> mktemp 2019-12-09T09:38:56.595 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.sm0sV62tX9 2019-12-09T09:38:56.595 INFO:teuthology.orchestra.run.smithi132:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.sm0sV62tX9 2019-12-09T09:38:56.699 INFO:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.sm0sV62tX9 2019-12-09T09:38:56.885 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.sm0sV62tX9 is 56B 2019-12-09T09:38:56.957 INFO:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.sm0sV62tX9 2019-12-09T09:38:57.014 INFO:teuthology.orchestra.run.smithi132:> mktemp 2019-12-09T09:38:57.122 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.aasagCLaJK 2019-12-09T09:38:57.123 INFO:teuthology.orchestra.run.smithi132:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.aasagCLaJK 2019-12-09T09:38:57.211 INFO:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.aasagCLaJK 2019-12-09T09:38:57.358 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.aasagCLaJK is 56B 2019-12-09T09:38:57.415 INFO:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.aasagCLaJK 2019-12-09T09:38:57.469 INFO:teuthology.orchestra.run.smithi132:> mktemp 2019-12-09T09:38:57.599 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.wm9DuIonb2 2019-12-09T09:38:57.599 INFO:teuthology.orchestra.run.smithi132:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.wm9DuIonb2 2019-12-09T09:38:57.705 INFO:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.wm9DuIonb2 2019-12-09T09:38:57.882 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.wm9DuIonb2 is 56B 2019-12-09T09:38:57.949 INFO:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.wm9DuIonb2 2019-12-09T09:38:58.109 DEBUG:teuthology.orchestra.remote:smithi121:/etc/ceph/ceph.client.0.keyring is 59B 2019-12-09T09:38:58.297 DEBUG:teuthology.orchestra.remote:smithi132:/etc/ceph/ceph.client.1.keyring is 59B 2019-12-09T09:38:58.401 INFO:tasks.ceph:Adding keys to all mons... 2019-12-09T09:38:58.401 INFO:teuthology.orchestra.run.smithi121:> sudo tee -a /etc/ceph/ceph.keyring 2019-12-09T09:38:58.411 INFO:teuthology.orchestra.run.smithi132:> sudo tee -a /etc/ceph/ceph.keyring 2019-12-09T09:38:58.522 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.y] 2019-12-09T09:38:58.522 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAiFu5dDeY/BRAAi0e8NdGcthGr4zuWo0lHpg== 2019-12-09T09:38:58.522 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.0] 2019-12-09T09:38:58.523 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAmFu5d+qaeIBAAPNbJCIv1P9IS0ht2Wl2S4g== 2019-12-09T09:38:58.523 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.1] 2019-12-09T09:38:58.523 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAnFu5dNwCDBBAAfLJsAvtVBEESWx1Zq1lA1A== 2019-12-09T09:38:58.523 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.2] 2019-12-09T09:38:58.523 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAnFu5d0IUzJhAAMcv6uPbLaqTDS4IksX9Hsg== 2019-12-09T09:38:58.523 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.3] 2019-12-09T09:38:58.523 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAoFu5d/JMdAhAAJVlav8SNVYG+Bchd6ZDDrg== 2019-12-09T09:38:58.524 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.x] 2019-12-09T09:38:58.524 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAiFu5d4g5bEBAAH0Khm/s02NmE2xBs7JmkNA== 2019-12-09T09:38:58.524 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.4] 2019-12-09T09:38:58.524 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAsFu5dZ9G/ARAAexqXRMam3doElShdAdyyGA== 2019-12-09T09:38:58.524 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.5] 2019-12-09T09:38:58.524 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAsFu5dC88PGRAApW1a3rukcZMpVM87zq2y9g== 2019-12-09T09:38:58.524 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.6] 2019-12-09T09:38:58.525 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAsFu5dcZKZLxAA5Jr5nfTo96Cf2BBh4F8OIA== 2019-12-09T09:38:58.525 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.7] 2019-12-09T09:38:58.525 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAtFu5dd6UtCRAAIJxifLpE/ivM3iXGOS4uyw== 2019-12-09T09:38:58.525 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2019-12-09T09:38:58.525 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAiFu5dEoDGGRAAIXrtqjlw6CWcWgySsXkebQ== 2019-12-09T09:38:58.525 INFO:teuthology.orchestra.run.smithi121.stdout:[client.1] 2019-12-09T09:38:58.525 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAiFu5d0NpbIxAASCVAiD+kEl8cLEOxmDaDJA== 2019-12-09T09:38:58.536 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.y] 2019-12-09T09:38:58.536 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAiFu5dDeY/BRAAi0e8NdGcthGr4zuWo0lHpg== 2019-12-09T09:38:58.537 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.0] 2019-12-09T09:38:58.537 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAmFu5d+qaeIBAAPNbJCIv1P9IS0ht2Wl2S4g== 2019-12-09T09:38:58.537 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.1] 2019-12-09T09:38:58.537 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAnFu5dNwCDBBAAfLJsAvtVBEESWx1Zq1lA1A== 2019-12-09T09:38:58.537 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.2] 2019-12-09T09:38:58.537 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAnFu5d0IUzJhAAMcv6uPbLaqTDS4IksX9Hsg== 2019-12-09T09:38:58.537 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.3] 2019-12-09T09:38:58.538 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAoFu5d/JMdAhAAJVlav8SNVYG+Bchd6ZDDrg== 2019-12-09T09:38:58.538 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.x] 2019-12-09T09:38:58.538 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAiFu5d4g5bEBAAH0Khm/s02NmE2xBs7JmkNA== 2019-12-09T09:38:58.538 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.4] 2019-12-09T09:38:58.538 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAsFu5dZ9G/ARAAexqXRMam3doElShdAdyyGA== 2019-12-09T09:38:58.538 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.5] 2019-12-09T09:38:58.538 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAsFu5dC88PGRAApW1a3rukcZMpVM87zq2y9g== 2019-12-09T09:38:58.538 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.6] 2019-12-09T09:38:58.539 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAsFu5dcZKZLxAA5Jr5nfTo96Cf2BBh4F8OIA== 2019-12-09T09:38:58.539 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.7] 2019-12-09T09:38:58.539 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAtFu5dd6UtCRAAIJxifLpE/ivM3iXGOS4uyw== 2019-12-09T09:38:58.539 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2019-12-09T09:38:58.539 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAiFu5dEoDGGRAAIXrtqjlw6CWcWgySsXkebQ== 2019-12-09T09:38:58.539 INFO:teuthology.orchestra.run.smithi132.stdout:[client.1] 2019-12-09T09:38:58.539 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAiFu5d0NpbIxAASCVAiD+kEl8cLEOxmDaDJA== 2019-12-09T09:38:58.540 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-09T09:38:58.544 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-09T09:38:58.708 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T09:38:58.712 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T09:38:58.879 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T09:38:58.882 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T09:38:59.047 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T09:38:59.051 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T09:38:59.218 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T09:38:59.222 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T09:38:59.379 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-09T09:38:59.382 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-09T09:38:59.535 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T09:38:59.541 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T09:38:59.712 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T09:38:59.715 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T09:38:59.857 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T09:38:59.861 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T09:38:59.996 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T09:39:00.001 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-09T09:39:00.165 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-09T09:39:00.169 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-09T09:39:00.340 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-09T09:39:00.343 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-09T09:39:00.499 INFO:tasks.ceph:Running mkfs on mon nodes... 2019-12-09T09:39:00.500 INFO:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2019-12-09T09:39:00.613 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-12-09T09:39:00.800 INFO:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2019-12-09T09:39:00.941 INFO:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2019-12-09T09:39:01.042 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-12-09T09:39:01.194 INFO:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2019-12-09T09:39:01.295 INFO:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2019-12-09T09:39:01.415 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-12-09T09:39:01.569 INFO:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2019-12-09T09:39:01.686 INFO:teuthology.orchestra.run.smithi121:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-12-09T09:39:01.690 INFO:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-12-09T09:39:01.776 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2019-12-09T09:39:01.777 DEBUG:teuthology.misc:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-12-09T09:39:01.777 INFO:tasks.ceph.mon.a:Restarting daemon 2019-12-09T09:39:01.777 INFO:teuthology.orchestra.run.smithi121:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2019-12-09T09:39:01.782 INFO:tasks.ceph.mon.a:Started 2019-12-09T09:39:01.782 DEBUG:teuthology.misc:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-12-09T09:39:01.782 INFO:tasks.ceph.mon.c:Restarting daemon 2019-12-09T09:39:01.782 INFO:teuthology.orchestra.run.smithi121:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2019-12-09T09:39:01.787 INFO:tasks.ceph.mon.c:Started 2019-12-09T09:39:01.788 DEBUG:teuthology.misc:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-12-09T09:39:01.788 INFO:tasks.ceph.mon.b:Restarting daemon 2019-12-09T09:39:01.788 INFO:teuthology.orchestra.run.smithi132:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2019-12-09T09:39:01.797 INFO:tasks.ceph.mon.b:Started 2019-12-09T09:39:01.797 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2019-12-09T09:39:01.797 INFO:tasks.ceph.mgr.y:Restarting daemon 2019-12-09T09:39:01.798 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2019-12-09T09:39:01.804 INFO:tasks.ceph.mgr.y:Started 2019-12-09T09:39:01.805 INFO:tasks.ceph.mgr.x:Restarting daemon 2019-12-09T09:39:01.805 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2019-12-09T09:39:01.814 INFO:tasks.ceph.mgr.x:Started 2019-12-09T09:39:01.814 INFO:tasks.ceph:Setting crush tunables to default 2019-12-09T09:39:01.815 INFO:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd crush tunables default 2019-12-09T09:39:05.672 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:00:03.701 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T09:39:05.732 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:00:03.761 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T09:39:05.747 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:00:03.760 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T09:39:17.944 INFO:teuthology.orchestra.run.smithi121.stderr:adjusted tunables profile to default 2019-12-09T09:39:17.964 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2019-12-09T09:39:17.964 INFO:teuthology.orchestra.run.smithi121:> mktemp 2019-12-09T09:39:18.041 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.7xfR1kqMaq 2019-12-09T09:39:18.041 INFO:teuthology.orchestra.run.smithi121:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.7xfR1kqMaq 2019-12-09T09:39:18.134 INFO:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.7xfR1kqMaq 2019-12-09T09:39:18.360 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.7xfR1kqMaq is 37B 2019-12-09T09:39:18.423 INFO:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.7xfR1kqMaq 2019-12-09T09:39:18.475 INFO:teuthology.orchestra.run.smithi121:> mktemp 2019-12-09T09:39:18.573 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.NiltHkQ8FW 2019-12-09T09:39:18.574 INFO:teuthology.orchestra.run.smithi121:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.NiltHkQ8FW 2019-12-09T09:39:18.634 INFO:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.NiltHkQ8FW 2019-12-09T09:39:18.774 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.NiltHkQ8FW is 37B 2019-12-09T09:39:18.821 INFO:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.NiltHkQ8FW 2019-12-09T09:39:18.862 INFO:teuthology.orchestra.run.smithi121:> mktemp 2019-12-09T09:39:18.958 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.Fw4E4EtoEE 2019-12-09T09:39:18.958 INFO:teuthology.orchestra.run.smithi121:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.Fw4E4EtoEE 2019-12-09T09:39:19.020 INFO:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.Fw4E4EtoEE 2019-12-09T09:39:19.132 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.Fw4E4EtoEE is 37B 2019-12-09T09:39:19.184 INFO:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.Fw4E4EtoEE 2019-12-09T09:39:19.226 INFO:teuthology.orchestra.run.smithi121:> mktemp 2019-12-09T09:39:19.335 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.RXYRvDwy8o 2019-12-09T09:39:19.336 INFO:teuthology.orchestra.run.smithi121:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.RXYRvDwy8o 2019-12-09T09:39:19.401 INFO:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.RXYRvDwy8o 2019-12-09T09:39:19.520 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.RXYRvDwy8o is 37B 2019-12-09T09:39:19.568 INFO:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.RXYRvDwy8o 2019-12-09T09:39:19.611 INFO:teuthology.orchestra.run.smithi132:> mktemp 2019-12-09T09:39:19.690 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.9OOMLYMYAm 2019-12-09T09:39:19.690 INFO:teuthology.orchestra.run.smithi132:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.9OOMLYMYAm 2019-12-09T09:39:19.801 INFO:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.9OOMLYMYAm 2019-12-09T09:39:19.951 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.9OOMLYMYAm is 37B 2019-12-09T09:39:20.010 INFO:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.9OOMLYMYAm 2019-12-09T09:39:20.056 INFO:teuthology.orchestra.run.smithi132:> mktemp 2019-12-09T09:39:20.156 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.qSogqUH4D5 2019-12-09T09:39:20.156 INFO:teuthology.orchestra.run.smithi132:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.qSogqUH4D5 2019-12-09T09:39:20.224 INFO:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.qSogqUH4D5 2019-12-09T09:39:20.342 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.qSogqUH4D5 is 37B 2019-12-09T09:39:20.389 INFO:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.qSogqUH4D5 2019-12-09T09:39:20.431 INFO:teuthology.orchestra.run.smithi132:> mktemp 2019-12-09T09:39:20.532 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.nXegTdtRMz 2019-12-09T09:39:20.532 INFO:teuthology.orchestra.run.smithi132:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.nXegTdtRMz 2019-12-09T09:39:20.608 INFO:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.nXegTdtRMz 2019-12-09T09:39:20.717 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.nXegTdtRMz is 37B 2019-12-09T09:39:20.774 INFO:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.nXegTdtRMz 2019-12-09T09:39:20.818 INFO:teuthology.orchestra.run.smithi132:> mktemp 2019-12-09T09:39:20.944 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.MfLPjU1KU5 2019-12-09T09:39:20.944 INFO:teuthology.orchestra.run.smithi132:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.MfLPjU1KU5 2019-12-09T09:39:21.052 INFO:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.MfLPjU1KU5 2019-12-09T09:39:21.203 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.MfLPjU1KU5 is 37B 2019-12-09T09:39:21.262 INFO:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.MfLPjU1KU5 2019-12-09T09:39:21.312 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 48cd80a1-aa43-4fc0-b748-b0f62f03ec7a 0 2019-12-09T09:39:22.609 INFO:teuthology.orchestra.run.smithi132.stdout:0 2019-12-09T09:39:22.776 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 3f23075e-dbbd-49a8-b258-f516758ee02b 1 2019-12-09T09:39:24.013 INFO:teuthology.orchestra.run.smithi132.stdout:1 2019-12-09T09:39:24.031 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 608c7a3a-bf3c-477d-b3d2-63660ef11e6f 2 2019-12-09T09:39:25.031 INFO:teuthology.orchestra.run.smithi132.stdout:2 2019-12-09T09:39:25.053 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 78df4d42-593c-4ac4-a461-0f2dd9f08c27 3 2019-12-09T09:39:26.148 INFO:teuthology.orchestra.run.smithi132.stdout:3 2019-12-09T09:39:26.170 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 34c02013-12de-4294-8c1a-fb7cc12709ae 4 2019-12-09T09:39:27.229 INFO:teuthology.orchestra.run.smithi132.stdout:4 2019-12-09T09:39:27.251 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 30f5db95-1841-4b66-9fca-f9d38ef9b909 5 2019-12-09T09:39:28.286 INFO:teuthology.orchestra.run.smithi132.stdout:5 2019-12-09T09:39:28.311 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new fb69089d-585e-413e-ac9c-7e5fe46d2420 6 2019-12-09T09:39:29.299 INFO:teuthology.orchestra.run.smithi132.stdout:6 2019-12-09T09:39:29.320 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 87bd48be-2330-4934-8ba6-31c541d04d00 7 2019-12-09T09:39:30.384 INFO:teuthology.orchestra.run.smithi132.stdout:7 2019-12-09T09:39:30.409 DEBUG:teuthology.misc:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-09T09:39:30.410 INFO:tasks.ceph.osd.0:Restarting daemon 2019-12-09T09:39:30.410 INFO:teuthology.orchestra.run.smithi121:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 0 2019-12-09T09:39:30.413 INFO:tasks.ceph.osd.0:Started 2019-12-09T09:39:30.413 DEBUG:teuthology.misc:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-09T09:39:30.413 INFO:tasks.ceph.osd.1:Restarting daemon 2019-12-09T09:39:30.414 INFO:teuthology.orchestra.run.smithi121:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 1 2019-12-09T09:39:30.416 INFO:tasks.ceph.osd.1:Started 2019-12-09T09:39:30.417 DEBUG:teuthology.misc:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-09T09:39:30.417 INFO:tasks.ceph.osd.2:Restarting daemon 2019-12-09T09:39:30.417 INFO:teuthology.orchestra.run.smithi121:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 2 2019-12-09T09:39:30.420 INFO:tasks.ceph.osd.2:Started 2019-12-09T09:39:30.420 DEBUG:teuthology.misc:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-09T09:39:30.420 INFO:tasks.ceph.osd.3:Restarting daemon 2019-12-09T09:39:30.421 INFO:teuthology.orchestra.run.smithi121:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 3 2019-12-09T09:39:30.424 INFO:tasks.ceph.osd.3:Started 2019-12-09T09:39:30.424 DEBUG:teuthology.misc:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-09T09:39:30.424 INFO:tasks.ceph.osd.4:Restarting daemon 2019-12-09T09:39:30.424 INFO:teuthology.orchestra.run.smithi132:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 4 2019-12-09T09:39:30.427 INFO:tasks.ceph.osd.4:Started 2019-12-09T09:39:30.428 DEBUG:teuthology.misc:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-09T09:39:30.428 INFO:tasks.ceph.osd.5:Restarting daemon 2019-12-09T09:39:30.428 INFO:teuthology.orchestra.run.smithi132:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 5 2019-12-09T09:39:30.431 INFO:tasks.ceph.osd.5:Started 2019-12-09T09:39:30.432 DEBUG:teuthology.misc:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-09T09:39:30.432 INFO:tasks.ceph.osd.6:Restarting daemon 2019-12-09T09:39:30.432 INFO:teuthology.orchestra.run.smithi132:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 6 2019-12-09T09:39:30.435 INFO:tasks.ceph.osd.6:Started 2019-12-09T09:39:30.435 DEBUG:teuthology.misc:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-09T09:39:30.436 INFO:tasks.ceph.osd.7:Restarting daemon 2019-12-09T09:39:30.436 INFO:teuthology.orchestra.run.smithi132:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 7 2019-12-09T09:39:30.439 INFO:tasks.ceph.osd.7:Started 2019-12-09T09:39:30.439 INFO:tasks.ceph:Waiting for OSDs to come up 2019-12-09T09:39:31.246 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-12-09T09:39:32.242 INFO:teuthology.misc.health.smithi121.stdout: 2019-12-09T09:39:32.242 INFO:teuthology.misc.health.smithi121.stdout:{"epoch":10,"fsid":"088b3efd-6d92-4fd4-828b-36094e307953","created":"2019-12-09T09:39:15.125077+0000","modified":"2019-12-09T09:39:30.242063+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"48cd80a1-aa43-4fc0-b748-b0f62f03ec7a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3f23075e-dbbd-49a8-b258-f516758ee02b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"608c7a3a-bf3c-477d-b3d2-63660ef11e6f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"78df4d42-593c-4ac4-a461-0f2dd9f08c27","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"34c02013-12de-4294-8c1a-fb7cc12709ae","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"30f5db95-1841-4b66-9fca-f9d38ef9b909","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fb69089d-585e-413e-ac9c-7e5fe46d2420","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"87bd48be-2330-4934-8ba6-31c541d04d00","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-09T09:39:32.265 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-12-09T09:39:34.230 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T09:39:34.219+0000 9b13800 -1 Falling back to public interface 2019-12-09T09:39:34.282 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T09:39:34.251+0000 9b13800 -1 Falling back to public interface 2019-12-09T09:39:34.336 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T09:39:34.323+0000 9b13800 -1 Falling back to public interface 2019-12-09T09:39:34.373 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T09:39:34.361+0000 9b13800 -1 Falling back to public interface 2019-12-09T09:39:34.427 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T09:39:34.410+0000 9b13800 -1 Falling back to public interface 2019-12-09T09:39:34.525 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T09:39:34.494+0000 9b13800 -1 Falling back to public interface 2019-12-09T09:39:35.136 INFO:tasks.ceph.osd.0.smithi121.stderr:==00:00:00:04.614 9956== Warning: unimplemented fcntl command: 1036 2019-12-09T09:39:35.223 INFO:tasks.ceph.osd.3.smithi121.stderr:==00:00:00:04.693 9957== Warning: unimplemented fcntl command: 1036 2019-12-09T09:39:35.256 INFO:tasks.ceph.osd.7.smithi132.stderr:==00:00:00:04.697 10193== Warning: unimplemented fcntl command: 1036 2019-12-09T09:39:35.274 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T09:39:35.242+0000 9b13800 -1 Falling back to public interface 2019-12-09T09:39:35.299 INFO:tasks.ceph.osd.1.smithi121.stderr:==00:00:00:04.750 9958== Warning: unimplemented fcntl command: 1036 2019-12-09T09:39:35.324 INFO:tasks.ceph.osd.2.smithi121.stderr:==00:00:00:04.816 9952== Warning: unimplemented fcntl command: 1036 2019-12-09T09:39:35.449 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T09:39:35.421+0000 9b13800 -1 Falling back to public interface 2019-12-09T09:39:35.508 INFO:tasks.ceph.osd.6.smithi132.stderr:==00:00:00:04.933 10196== Warning: unimplemented fcntl command: 1036 2019-12-09T09:39:35.521 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T09:39:35.491+0000 9b13800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:39:35.536 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T09:39:35.507+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-09T09:39:35.536 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T09:39:35.510+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-09T09:39:35.590 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T09:39:35.575+0000 9b13800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:39:35.626 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T09:39:35.596+0000 9b13800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:39:35.642 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T09:39:35.611+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-09T09:39:35.642 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T09:39:35.614+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-09T09:39:35.667 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T09:39:35.592+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-09T09:39:35.672 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T09:39:35.595+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-09T09:39:35.693 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T09:39:35.676+0000 9b13800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:39:35.724 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T09:39:35.704+0000 9b13800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:39:35.724 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T09:39:35.695+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-09T09:39:35.733 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T09:39:35.728+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-09T09:39:35.733 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T09:39:35.698+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-09T09:39:35.753 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T09:39:35.733+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-09T09:39:35.910 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T09:39:35.875+0000 9b13800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:39:35.953 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T09:39:35.890+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-09T09:39:35.953 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T09:39:35.894+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-09T09:39:36.196 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T09:39:36.193+0000 9b13800 -1 osd.0 0 log_to_monitors {default=true} 2019-12-09T09:39:36.202 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T09:39:36.183+0000 9b13800 -1 osd.7 0 log_to_monitors {default=true} 2019-12-09T09:39:36.211 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T09:39:36.209+0000 9b13800 -1 osd.3 0 log_to_monitors {default=true} 2019-12-09T09:39:36.275 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T09:39:36.268+0000 9b13800 -1 osd.2 0 log_to_monitors {default=true} 2019-12-09T09:39:36.285 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T09:39:36.282+0000 9b13800 -1 osd.1 0 log_to_monitors {default=true} 2019-12-09T09:39:36.329 INFO:tasks.ceph.osd.5.smithi132.stderr:==00:00:00:05.759 10194== Warning: unimplemented fcntl command: 1036 2019-12-09T09:39:36.465 INFO:tasks.ceph.osd.4.smithi132.stderr:==00:00:00:05.894 10195== Warning: unimplemented fcntl command: 1036 2019-12-09T09:39:36.490 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T09:39:36.471+0000 9b13800 -1 osd.6 0 log_to_monitors {default=true} 2019-12-09T09:39:36.772 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T09:39:36.685+0000 9b13800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:39:36.778 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T09:39:36.701+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-09T09:39:36.814 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T09:39:36.703+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-09T09:39:36.838 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T09:39:36.807+0000 9b13800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-09T09:39:36.882 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T09:39:36.827+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-09T09:39:36.905 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T09:39:36.830+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-09T09:39:37.302 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T09:39:37.283+0000 9b13800 -1 osd.5 0 log_to_monitors {default=true} 2019-12-09T09:39:37.449 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T09:39:37.428+0000 9b13800 -1 osd.4 0 log_to_monitors {default=true} 2019-12-09T09:39:37.836 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T09:39:37.828+0000 29a5f700 -1 osd.3 0 waiting for initial osdmap 2019-12-09T09:39:37.844 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T09:39:37.837+0000 29a5f700 -1 osd.0 0 waiting for initial osdmap 2019-12-09T09:39:37.931 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T09:39:37.911+0000 29a5f700 -1 osd.7 0 waiting for initial osdmap 2019-12-09T09:39:38.998 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T09:39:38.974+0000 29a5f700 -1 osd.5 0 waiting for initial osdmap 2019-12-09T09:39:39.002 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T09:39:38.973+0000 29a5f700 -1 osd.6 0 waiting for initial osdmap 2019-12-09T09:39:39.004 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T09:39:39.001+0000 29a5f700 -1 osd.1 0 waiting for initial osdmap 2019-12-09T09:39:39.013 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T09:39:38.998+0000 29a5f700 -1 osd.2 0 waiting for initial osdmap 2019-12-09T09:39:39.073 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-12-09T09:39:39.783 INFO:teuthology.misc.health.smithi121.stdout: 2019-12-09T09:39:39.784 INFO:teuthology.misc.health.smithi121.stdout:{"epoch":14,"fsid":"088b3efd-6d92-4fd4-828b-36094e307953","created":"2019-12-09T09:39:15.125077+0000","modified":"2019-12-09T09:39:39.594057+0000","last_up_change":"2019-12-09T09:39:39.594057+0000","last_in_change":"2019-12-09T09:39:39.594057+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"48cd80a1-aa43-4fc0-b748-b0f62f03ec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":9956},{"type":"v1","addr":"172.21.15.121:6801","nonce":9956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":9956},{"type":"v1","addr":"172.21.15.121:6803","nonce":9956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":9956},{"type":"v1","addr":"172.21.15.121:6807","nonce":9956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":9956},{"type":"v1","addr":"172.21.15.121:6805","nonce":9956}]},"public_addr":"172.21.15.121:6801/9956","cluster_addr":"172.21.15.121:6803/9956","heartbeat_back_addr":"172.21.15.121:6807/9956","heartbeat_front_addr":"172.21.15.121:6805/9956","state":["exists","up"]},{"osd":1,"uuid":"3f23075e-dbbd-49a8-b258-f516758ee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":9958},{"type":"v1","addr":"172.21.15.121:6817","nonce":9958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":9958},{"type":"v1","addr":"172.21.15.121:6819","nonce":9958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":9958},{"type":"v1","addr":"172.21.15.121:6823","nonce":9958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":9958},{"type":"v1","addr":"172.21.15.121:6821","nonce":9958}]},"public_addr":"172.21.15.121:6817/9958","cluster_addr":"172.21.15.121:6819/9958","heartbeat_back_addr":"172.21.15.121:6823/9958","heartbeat_front_addr":"172.21.15.121:6821/9958","state":["exists","up"]},{"osd":2,"uuid":"608c7a3a-bf3c-477d-b3d2-63660ef11e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":9952},{"type":"v1","addr":"172.21.15.121:6825","nonce":9952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":9952},{"type":"v1","addr":"172.21.15.121:6827","nonce":9952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":9952},{"type":"v1","addr":"172.21.15.121:6831","nonce":9952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":9952},{"type":"v1","addr":"172.21.15.121:6829","nonce":9952}]},"public_addr":"172.21.15.121:6825/9952","cluster_addr":"172.21.15.121:6827/9952","heartbeat_back_addr":"172.21.15.121:6831/9952","heartbeat_front_addr":"172.21.15.121:6829/9952","state":["exists","up"]},{"osd":3,"uuid":"78df4d42-593c-4ac4-a461-0f2dd9f08c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":9957},{"type":"v1","addr":"172.21.15.121:6809","nonce":9957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":9957},{"type":"v1","addr":"172.21.15.121:6811","nonce":9957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":9957},{"type":"v1","addr":"172.21.15.121:6815","nonce":9957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":9957},{"type":"v1","addr":"172.21.15.121:6813","nonce":9957}]},"public_addr":"172.21.15.121:6809/9957","cluster_addr":"172.21.15.121:6811/9957","heartbeat_back_addr":"172.21.15.121:6815/9957","heartbeat_front_addr":"172.21.15.121:6813/9957","state":["exists","up"]},{"osd":4,"uuid":"34c02013-12de-4294-8c1a-fb7cc12709ae","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"30f5db95-1841-4b66-9fca-f9d38ef9b909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":10194},{"type":"v1","addr":"172.21.15.132:6819","nonce":10194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":10194},{"type":"v1","addr":"172.21.15.132:6821","nonce":10194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":10194},{"type":"v1","addr":"172.21.15.132:6825","nonce":10194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":10194},{"type":"v1","addr":"172.21.15.132:6823","nonce":10194}]},"public_addr":"172.21.15.132:6819/10194","cluster_addr":"172.21.15.132:6821/10194","heartbeat_back_addr":"172.21.15.132:6825/10194","heartbeat_front_addr":"172.21.15.132:6823/10194","state":["exists","up"]},{"osd":6,"uuid":"fb69089d-585e-413e-ac9c-7e5fe46d2420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":10196},{"type":"v1","addr":"172.21.15.132:6811","nonce":10196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":10196},{"type":"v1","addr":"172.21.15.132:6813","nonce":10196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":10196},{"type":"v1","addr":"172.21.15.132:6817","nonce":10196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":10196},{"type":"v1","addr":"172.21.15.132:6815","nonce":10196}]},"public_addr":"172.21.15.132:6811/10196","cluster_addr":"172.21.15.132:6813/10196","heartbeat_back_addr":"172.21.15.132:6817/10196","heartbeat_front_addr":"172.21.15.132:6815/10196","state":["exists","up"]},{"osd":7,"uuid":"87bd48be-2330-4934-8ba6-31c541d04d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":10193},{"type":"v1","addr":"172.21.15.132:6803","nonce":10193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":10193},{"type":"v1","addr":"172.21.15.132:6805","nonce":10193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":10193},{"type":"v1","addr":"172.21.15.132:6809","nonce":10193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":10193},{"type":"v1","addr":"172.21.15.132:6807","nonce":10193}]},"public_addr":"172.21.15.132:6803/10193","cluster_addr":"172.21.15.132:6805/10193","heartbeat_back_addr":"172.21.15.132:6809/10193","heartbeat_front_addr":"172.21.15.132:6807/10193","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.288306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.348653+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-09T09:39:39.796 DEBUG:teuthology.misc:7 of 8 OSDs are up 2019-12-09T09:39:40.036 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T09:39:40.008+0000 29a5f700 -1 osd.4 0 waiting for initial osdmap 2019-12-09T09:39:46.603 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-12-09T09:39:47.637 INFO:teuthology.misc.health.smithi121.stdout: 2019-12-09T09:39:47.637 INFO:teuthology.misc.health.smithi121.stdout:{"epoch":16,"fsid":"088b3efd-6d92-4fd4-828b-36094e307953","created":"2019-12-09T09:39:15.125077+0000","modified":"2019-12-09T09:39:42.256066+0000","last_up_change":"2019-12-09T09:39:41.099700+0000","last_in_change":"2019-12-09T09:39:41.099700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"48cd80a1-aa43-4fc0-b748-b0f62f03ec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":9956},{"type":"v1","addr":"172.21.15.121:6801","nonce":9956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":9956},{"type":"v1","addr":"172.21.15.121:6803","nonce":9956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":9956},{"type":"v1","addr":"172.21.15.121:6807","nonce":9956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":9956},{"type":"v1","addr":"172.21.15.121:6805","nonce":9956}]},"public_addr":"172.21.15.121:6801/9956","cluster_addr":"172.21.15.121:6803/9956","heartbeat_back_addr":"172.21.15.121:6807/9956","heartbeat_front_addr":"172.21.15.121:6805/9956","state":["exists","up"]},{"osd":1,"uuid":"3f23075e-dbbd-49a8-b258-f516758ee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":9958},{"type":"v1","addr":"172.21.15.121:6817","nonce":9958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":9958},{"type":"v1","addr":"172.21.15.121:6819","nonce":9958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":9958},{"type":"v1","addr":"172.21.15.121:6823","nonce":9958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":9958},{"type":"v1","addr":"172.21.15.121:6821","nonce":9958}]},"public_addr":"172.21.15.121:6817/9958","cluster_addr":"172.21.15.121:6819/9958","heartbeat_back_addr":"172.21.15.121:6823/9958","heartbeat_front_addr":"172.21.15.121:6821/9958","state":["exists","up"]},{"osd":2,"uuid":"608c7a3a-bf3c-477d-b3d2-63660ef11e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":9952},{"type":"v1","addr":"172.21.15.121:6825","nonce":9952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":9952},{"type":"v1","addr":"172.21.15.121:6827","nonce":9952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":9952},{"type":"v1","addr":"172.21.15.121:6831","nonce":9952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":9952},{"type":"v1","addr":"172.21.15.121:6829","nonce":9952}]},"public_addr":"172.21.15.121:6825/9952","cluster_addr":"172.21.15.121:6827/9952","heartbeat_back_addr":"172.21.15.121:6831/9952","heartbeat_front_addr":"172.21.15.121:6829/9952","state":["exists","up"]},{"osd":3,"uuid":"78df4d42-593c-4ac4-a461-0f2dd9f08c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":9957},{"type":"v1","addr":"172.21.15.121:6809","nonce":9957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":9957},{"type":"v1","addr":"172.21.15.121:6811","nonce":9957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":9957},{"type":"v1","addr":"172.21.15.121:6815","nonce":9957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":9957},{"type":"v1","addr":"172.21.15.121:6813","nonce":9957}]},"public_addr":"172.21.15.121:6809/9957","cluster_addr":"172.21.15.121:6811/9957","heartbeat_back_addr":"172.21.15.121:6815/9957","heartbeat_front_addr":"172.21.15.121:6813/9957","state":["exists","up"]},{"osd":4,"uuid":"34c02013-12de-4294-8c1a-fb7cc12709ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":10195},{"type":"v1","addr":"172.21.15.132:6827","nonce":10195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":10195},{"type":"v1","addr":"172.21.15.132:6829","nonce":10195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":10195},{"type":"v1","addr":"172.21.15.132:6833","nonce":10195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":10195},{"type":"v1","addr":"172.21.15.132:6831","nonce":10195}]},"public_addr":"172.21.15.132:6827/10195","cluster_addr":"172.21.15.132:6829/10195","heartbeat_back_addr":"172.21.15.132:6833/10195","heartbeat_front_addr":"172.21.15.132:6831/10195","state":["exists","up"]},{"osd":5,"uuid":"30f5db95-1841-4b66-9fca-f9d38ef9b909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":10194},{"type":"v1","addr":"172.21.15.132:6819","nonce":10194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":10194},{"type":"v1","addr":"172.21.15.132:6821","nonce":10194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":10194},{"type":"v1","addr":"172.21.15.132:6825","nonce":10194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":10194},{"type":"v1","addr":"172.21.15.132:6823","nonce":10194}]},"public_addr":"172.21.15.132:6819/10194","cluster_addr":"172.21.15.132:6821/10194","heartbeat_back_addr":"172.21.15.132:6825/10194","heartbeat_front_addr":"172.21.15.132:6823/10194","state":["exists","up"]},{"osd":6,"uuid":"fb69089d-585e-413e-ac9c-7e5fe46d2420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":10196},{"type":"v1","addr":"172.21.15.132:6811","nonce":10196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":10196},{"type":"v1","addr":"172.21.15.132:6813","nonce":10196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":10196},{"type":"v1","addr":"172.21.15.132:6817","nonce":10196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":10196},{"type":"v1","addr":"172.21.15.132:6815","nonce":10196}]},"public_addr":"172.21.15.132:6811/10196","cluster_addr":"172.21.15.132:6813/10196","heartbeat_back_addr":"172.21.15.132:6817/10196","heartbeat_front_addr":"172.21.15.132:6815/10196","state":["exists","up"]},{"osd":7,"uuid":"87bd48be-2330-4934-8ba6-31c541d04d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":10193},{"type":"v1","addr":"172.21.15.132:6803","nonce":10193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":10193},{"type":"v1","addr":"172.21.15.132:6805","nonce":10193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":10193},{"type":"v1","addr":"172.21.15.132:6809","nonce":10193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":10193},{"type":"v1","addr":"172.21.15.132:6807","nonce":10193}]},"public_addr":"172.21.15.132:6803/10193","cluster_addr":"172.21.15.132:6805/10193","heartbeat_back_addr":"172.21.15.132:6809/10193","heartbeat_front_addr":"172.21.15.132:6807/10193","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.288306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.391295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.369266+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.348653+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:38.542719+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:38.435889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.586599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.283808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-09T09:39:47.657 DEBUG:teuthology.misc:8 of 8 OSDs are up 2019-12-09T09:39:47.657 INFO:tasks.ceph:Creating RBD pool 2019-12-09T09:39:47.658 INFO:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd pool create rbd 8 2019-12-09T09:39:49.905 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'rbd' created 2019-12-09T09:39:49.921 INFO:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2019-12-09T09:39:50.916 INFO:teuthology.orchestra.run.smithi121.stderr:enabled application 'rbd' on pool 'rbd' 2019-12-09T09:39:50.931 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2019-12-09T09:39:50.932 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-09T09:39:50.932 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2019-12-09T09:39:51.739 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:39:51.740 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":18,"fsid":"088b3efd-6d92-4fd4-828b-36094e307953","created":"2019-12-09T09:39:15.125077+0000","modified":"2019-12-09T09:39:50.728134+0000","last_up_change":"2019-12-09T09:39:41.099700+0000","last_in_change":"2019-12-09T09:39:41.099700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-09T09:39:48.586261+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"48cd80a1-aa43-4fc0-b748-b0f62f03ec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":9956},{"type":"v1","addr":"172.21.15.121:6801","nonce":9956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":9956},{"type":"v1","addr":"172.21.15.121:6803","nonce":9956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":9956},{"type":"v1","addr":"172.21.15.121:6807","nonce":9956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":9956},{"type":"v1","addr":"172.21.15.121:6805","nonce":9956}]},"public_addr":"172.21.15.121:6801/9956","cluster_addr":"172.21.15.121:6803/9956","heartbeat_back_addr":"172.21.15.121:6807/9956","heartbeat_front_addr":"172.21.15.121:6805/9956","state":["exists","up"]},{"osd":1,"uuid":"3f23075e-dbbd-49a8-b258-f516758ee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":9958},{"type":"v1","addr":"172.21.15.121:6817","nonce":9958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":9958},{"type":"v1","addr":"172.21.15.121:6819","nonce":9958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":9958},{"type":"v1","addr":"172.21.15.121:6823","nonce":9958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":9958},{"type":"v1","addr":"172.21.15.121:6821","nonce":9958}]},"public_addr":"172.21.15.121:6817/9958","cluster_addr":"172.21.15.121:6819/9958","heartbeat_back_addr":"172.21.15.121:6823/9958","heartbeat_front_addr":"172.21.15.121:6821/9958","state":["exists","up"]},{"osd":2,"uuid":"608c7a3a-bf3c-477d-b3d2-63660ef11e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":9952},{"type":"v1","addr":"172.21.15.121:6825","nonce":9952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":9952},{"type":"v1","addr":"172.21.15.121:6827","nonce":9952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":9952},{"type":"v1","addr":"172.21.15.121:6831","nonce":9952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":9952},{"type":"v1","addr":"172.21.15.121:6829","nonce":9952}]},"public_addr":"172.21.15.121:6825/9952","cluster_addr":"172.21.15.121:6827/9952","heartbeat_back_addr":"172.21.15.121:6831/9952","heartbeat_front_addr":"172.21.15.121:6829/9952","state":["exists","up"]},{"osd":3,"uuid":"78df4d42-593c-4ac4-a461-0f2dd9f08c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":9957},{"type":"v1","addr":"172.21.15.121:6809","nonce":9957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":9957},{"type":"v1","addr":"172.21.15.121:6811","nonce":9957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":9957},{"type":"v1","addr":"172.21.15.121:6815","nonce":9957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":9957},{"type":"v1","addr":"172.21.15.121:6813","nonce":9957}]},"public_addr":"172.21.15.121:6809/9957","cluster_addr":"172.21.15.121:6811/9957","heartbeat_back_addr":"172.21.15.121:6815/9957","heartbeat_front_addr":"172.21.15.121:6813/9957","state":["exists","up"]},{"osd":4,"uuid":"34c02013-12de-4294-8c1a-fb7cc12709ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":10195},{"type":"v1","addr":"172.21.15.132:6827","nonce":10195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":10195},{"type":"v1","addr":"172.21.15.132:6829","nonce":10195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":10195},{"type":"v1","addr":"172.21.15.132:6833","nonce":10195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":10195},{"type":"v1","addr":"172.21.15.132:6831","nonce":10195}]},"public_addr":"172.21.15.132:6827/10195","cluster_addr":"172.21.15.132:6829/10195","heartbeat_back_addr":"172.21.15.132:6833/10195","heartbeat_front_addr":"172.21.15.132:6831/10195","state":["exists","up"]},{"osd":5,"uuid":"30f5db95-1841-4b66-9fca-f9d38ef9b909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":10194},{"type":"v1","addr":"172.21.15.132:6819","nonce":10194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":10194},{"type":"v1","addr":"172.21.15.132:6821","nonce":10194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":10194},{"type":"v1","addr":"172.21.15.132:6825","nonce":10194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":10194},{"type":"v1","addr":"172.21.15.132:6823","nonce":10194}]},"public_addr":"172.21.15.132:6819/10194","cluster_addr":"172.21.15.132:6821/10194","heartbeat_back_addr":"172.21.15.132:6825/10194","heartbeat_front_addr":"172.21.15.132:6823/10194","state":["exists","up"]},{"osd":6,"uuid":"fb69089d-585e-413e-ac9c-7e5fe46d2420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":10196},{"type":"v1","addr":"172.21.15.132:6811","nonce":10196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":10196},{"type":"v1","addr":"172.21.15.132:6813","nonce":10196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":10196},{"type":"v1","addr":"172.21.15.132:6817","nonce":10196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":10196},{"type":"v1","addr":"172.21.15.132:6815","nonce":10196}]},"public_addr":"172.21.15.132:6811/10196","cluster_addr":"172.21.15.132:6813/10196","heartbeat_back_addr":"172.21.15.132:6817/10196","heartbeat_front_addr":"172.21.15.132:6815/10196","state":["exists","up"]},{"osd":7,"uuid":"87bd48be-2330-4934-8ba6-31c541d04d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":10193},{"type":"v1","addr":"172.21.15.132:6803","nonce":10193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":10193},{"type":"v1","addr":"172.21.15.132:6805","nonce":10193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":10193},{"type":"v1","addr":"172.21.15.132:6809","nonce":10193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":10193},{"type":"v1","addr":"172.21.15.132:6807","nonce":10193}]},"public_addr":"172.21.15.132:6803/10193","cluster_addr":"172.21.15.132:6805/10193","heartbeat_back_addr":"172.21.15.132:6809/10193","heartbeat_front_addr":"172.21.15.132:6807/10193","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.288306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.391295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.369266+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.348653+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:38.542719+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:38.435889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.586599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.283808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-09T09:39:51.763 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-09T09:39:48.586261+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-09T09:39:51.763 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-09T09:39:52.520 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 8 2019-12-09T09:39:52.541 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2019-12-09T09:39:52.542 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2019-12-09T09:39:52.542 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2019-12-09T09:39:53.542 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:39:53.563 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":3,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":8843},{"type":"v1","addr":"172.21.15.132:6801","nonce":8843}]},"active_addr":"172.21.15.132:6801/8843","active_change":"2019-12-09T09:39:18.760227+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]}} 2019-12-09T09:39:53.568 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2019-12-09T09:39:53.568 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2019-12-09T09:39:53.568 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-09T09:39:54.453 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:39:54.453 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":20,"fsid":"088b3efd-6d92-4fd4-828b-36094e307953","created":"2019-12-09T09:39:15.125077+0000","modified":"2019-12-09T09:39:53.045328+0000","last_up_change":"2019-12-09T09:39:41.099700+0000","last_in_change":"2019-12-09T09:39:41.099700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-09T09:39:48.586261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"48cd80a1-aa43-4fc0-b748-b0f62f03ec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":9956},{"type":"v1","addr":"172.21.15.121:6801","nonce":9956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":9956},{"type":"v1","addr":"172.21.15.121:6803","nonce":9956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":9956},{"type":"v1","addr":"172.21.15.121:6807","nonce":9956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":9956},{"type":"v1","addr":"172.21.15.121:6805","nonce":9956}]},"public_addr":"172.21.15.121:6801/9956","cluster_addr":"172.21.15.121:6803/9956","heartbeat_back_addr":"172.21.15.121:6807/9956","heartbeat_front_addr":"172.21.15.121:6805/9956","state":["exists","up"]},{"osd":1,"uuid":"3f23075e-dbbd-49a8-b258-f516758ee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":9958},{"type":"v1","addr":"172.21.15.121:6817","nonce":9958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":9958},{"type":"v1","addr":"172.21.15.121:6819","nonce":9958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":9958},{"type":"v1","addr":"172.21.15.121:6823","nonce":9958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":9958},{"type":"v1","addr":"172.21.15.121:6821","nonce":9958}]},"public_addr":"172.21.15.121:6817/9958","cluster_addr":"172.21.15.121:6819/9958","heartbeat_back_addr":"172.21.15.121:6823/9958","heartbeat_front_addr":"172.21.15.121:6821/9958","state":["exists","up"]},{"osd":2,"uuid":"608c7a3a-bf3c-477d-b3d2-63660ef11e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":9952},{"type":"v1","addr":"172.21.15.121:6825","nonce":9952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":9952},{"type":"v1","addr":"172.21.15.121:6827","nonce":9952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":9952},{"type":"v1","addr":"172.21.15.121:6831","nonce":9952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":9952},{"type":"v1","addr":"172.21.15.121:6829","nonce":9952}]},"public_addr":"172.21.15.121:6825/9952","cluster_addr":"172.21.15.121:6827/9952","heartbeat_back_addr":"172.21.15.121:6831/9952","heartbeat_front_addr":"172.21.15.121:6829/9952","state":["exists","up"]},{"osd":3,"uuid":"78df4d42-593c-4ac4-a461-0f2dd9f08c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":9957},{"type":"v1","addr":"172.21.15.121:6809","nonce":9957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":9957},{"type":"v1","addr":"172.21.15.121:6811","nonce":9957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":9957},{"type":"v1","addr":"172.21.15.121:6815","nonce":9957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":9957},{"type":"v1","addr":"172.21.15.121:6813","nonce":9957}]},"public_addr":"172.21.15.121:6809/9957","cluster_addr":"172.21.15.121:6811/9957","heartbeat_back_addr":"172.21.15.121:6815/9957","heartbeat_front_addr":"172.21.15.121:6813/9957","state":["exists","up"]},{"osd":4,"uuid":"34c02013-12de-4294-8c1a-fb7cc12709ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":10195},{"type":"v1","addr":"172.21.15.132:6827","nonce":10195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":10195},{"type":"v1","addr":"172.21.15.132:6829","nonce":10195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":10195},{"type":"v1","addr":"172.21.15.132:6833","nonce":10195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":10195},{"type":"v1","addr":"172.21.15.132:6831","nonce":10195}]},"public_addr":"172.21.15.132:6827/10195","cluster_addr":"172.21.15.132:6829/10195","heartbeat_back_addr":"172.21.15.132:6833/10195","heartbeat_front_addr":"172.21.15.132:6831/10195","state":["exists","up"]},{"osd":5,"uuid":"30f5db95-1841-4b66-9fca-f9d38ef9b909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":10194},{"type":"v1","addr":"172.21.15.132:6819","nonce":10194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":10194},{"type":"v1","addr":"172.21.15.132:6821","nonce":10194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":10194},{"type":"v1","addr":"172.21.15.132:6825","nonce":10194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":10194},{"type":"v1","addr":"172.21.15.132:6823","nonce":10194}]},"public_addr":"172.21.15.132:6819/10194","cluster_addr":"172.21.15.132:6821/10194","heartbeat_back_addr":"172.21.15.132:6825/10194","heartbeat_front_addr":"172.21.15.132:6823/10194","state":["exists","up"]},{"osd":6,"uuid":"fb69089d-585e-413e-ac9c-7e5fe46d2420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":10196},{"type":"v1","addr":"172.21.15.132:6811","nonce":10196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":10196},{"type":"v1","addr":"172.21.15.132:6813","nonce":10196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":10196},{"type":"v1","addr":"172.21.15.132:6817","nonce":10196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":10196},{"type":"v1","addr":"172.21.15.132:6815","nonce":10196}]},"public_addr":"172.21.15.132:6811/10196","cluster_addr":"172.21.15.132:6813/10196","heartbeat_back_addr":"172.21.15.132:6817/10196","heartbeat_front_addr":"172.21.15.132:6815/10196","state":["exists","up"]},{"osd":7,"uuid":"87bd48be-2330-4934-8ba6-31c541d04d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":10193},{"type":"v1","addr":"172.21.15.132:6803","nonce":10193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":10193},{"type":"v1","addr":"172.21.15.132:6805","nonce":10193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":10193},{"type":"v1","addr":"172.21.15.132:6809","nonce":10193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":10193},{"type":"v1","addr":"172.21.15.132:6807","nonce":10193}]},"public_addr":"172.21.15.132:6803/10193","cluster_addr":"172.21.15.132:6805/10193","heartbeat_back_addr":"172.21.15.132:6809/10193","heartbeat_front_addr":"172.21.15.132:6807/10193","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.288306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.391295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.369266+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.348653+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:38.542719+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:38.435889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.586599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.283808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-09T09:39:54.467 INFO:tasks.ceph.ceph_manager.ceph:all up! 2019-12-09T09:39:54.467 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-09T09:39:55.267 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:39:55.268 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":20,"fsid":"088b3efd-6d92-4fd4-828b-36094e307953","created":"2019-12-09T09:39:15.125077+0000","modified":"2019-12-09T09:39:53.045328+0000","last_up_change":"2019-12-09T09:39:41.099700+0000","last_in_change":"2019-12-09T09:39:41.099700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-09T09:39:48.586261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"48cd80a1-aa43-4fc0-b748-b0f62f03ec7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":9956},{"type":"v1","addr":"172.21.15.121:6801","nonce":9956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":9956},{"type":"v1","addr":"172.21.15.121:6803","nonce":9956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":9956},{"type":"v1","addr":"172.21.15.121:6807","nonce":9956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":9956},{"type":"v1","addr":"172.21.15.121:6805","nonce":9956}]},"public_addr":"172.21.15.121:6801/9956","cluster_addr":"172.21.15.121:6803/9956","heartbeat_back_addr":"172.21.15.121:6807/9956","heartbeat_front_addr":"172.21.15.121:6805/9956","state":["exists","up"]},{"osd":1,"uuid":"3f23075e-dbbd-49a8-b258-f516758ee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":9958},{"type":"v1","addr":"172.21.15.121:6817","nonce":9958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":9958},{"type":"v1","addr":"172.21.15.121:6819","nonce":9958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":9958},{"type":"v1","addr":"172.21.15.121:6823","nonce":9958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":9958},{"type":"v1","addr":"172.21.15.121:6821","nonce":9958}]},"public_addr":"172.21.15.121:6817/9958","cluster_addr":"172.21.15.121:6819/9958","heartbeat_back_addr":"172.21.15.121:6823/9958","heartbeat_front_addr":"172.21.15.121:6821/9958","state":["exists","up"]},{"osd":2,"uuid":"608c7a3a-bf3c-477d-b3d2-63660ef11e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":9952},{"type":"v1","addr":"172.21.15.121:6825","nonce":9952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":9952},{"type":"v1","addr":"172.21.15.121:6827","nonce":9952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":9952},{"type":"v1","addr":"172.21.15.121:6831","nonce":9952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":9952},{"type":"v1","addr":"172.21.15.121:6829","nonce":9952}]},"public_addr":"172.21.15.121:6825/9952","cluster_addr":"172.21.15.121:6827/9952","heartbeat_back_addr":"172.21.15.121:6831/9952","heartbeat_front_addr":"172.21.15.121:6829/9952","state":["exists","up"]},{"osd":3,"uuid":"78df4d42-593c-4ac4-a461-0f2dd9f08c27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":9957},{"type":"v1","addr":"172.21.15.121:6809","nonce":9957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":9957},{"type":"v1","addr":"172.21.15.121:6811","nonce":9957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":9957},{"type":"v1","addr":"172.21.15.121:6815","nonce":9957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":9957},{"type":"v1","addr":"172.21.15.121:6813","nonce":9957}]},"public_addr":"172.21.15.121:6809/9957","cluster_addr":"172.21.15.121:6811/9957","heartbeat_back_addr":"172.21.15.121:6815/9957","heartbeat_front_addr":"172.21.15.121:6813/9957","state":["exists","up"]},{"osd":4,"uuid":"34c02013-12de-4294-8c1a-fb7cc12709ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":10195},{"type":"v1","addr":"172.21.15.132:6827","nonce":10195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":10195},{"type":"v1","addr":"172.21.15.132:6829","nonce":10195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":10195},{"type":"v1","addr":"172.21.15.132:6833","nonce":10195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":10195},{"type":"v1","addr":"172.21.15.132:6831","nonce":10195}]},"public_addr":"172.21.15.132:6827/10195","cluster_addr":"172.21.15.132:6829/10195","heartbeat_back_addr":"172.21.15.132:6833/10195","heartbeat_front_addr":"172.21.15.132:6831/10195","state":["exists","up"]},{"osd":5,"uuid":"30f5db95-1841-4b66-9fca-f9d38ef9b909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":10194},{"type":"v1","addr":"172.21.15.132:6819","nonce":10194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":10194},{"type":"v1","addr":"172.21.15.132:6821","nonce":10194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":10194},{"type":"v1","addr":"172.21.15.132:6825","nonce":10194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":10194},{"type":"v1","addr":"172.21.15.132:6823","nonce":10194}]},"public_addr":"172.21.15.132:6819/10194","cluster_addr":"172.21.15.132:6821/10194","heartbeat_back_addr":"172.21.15.132:6825/10194","heartbeat_front_addr":"172.21.15.132:6823/10194","state":["exists","up"]},{"osd":6,"uuid":"fb69089d-585e-413e-ac9c-7e5fe46d2420","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":10196},{"type":"v1","addr":"172.21.15.132:6811","nonce":10196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":10196},{"type":"v1","addr":"172.21.15.132:6813","nonce":10196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":10196},{"type":"v1","addr":"172.21.15.132:6817","nonce":10196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":10196},{"type":"v1","addr":"172.21.15.132:6815","nonce":10196}]},"public_addr":"172.21.15.132:6811/10196","cluster_addr":"172.21.15.132:6813/10196","heartbeat_back_addr":"172.21.15.132:6817/10196","heartbeat_front_addr":"172.21.15.132:6815/10196","state":["exists","up"]},{"osd":7,"uuid":"87bd48be-2330-4934-8ba6-31c541d04d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":10193},{"type":"v1","addr":"172.21.15.132:6803","nonce":10193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":10193},{"type":"v1","addr":"172.21.15.132:6805","nonce":10193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":10193},{"type":"v1","addr":"172.21.15.132:6809","nonce":10193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":10193},{"type":"v1","addr":"172.21.15.132:6807","nonce":10193}]},"public_addr":"172.21.15.132:6803/10193","cluster_addr":"172.21.15.132:6805/10193","heartbeat_back_addr":"172.21.15.132:6809/10193","heartbeat_front_addr":"172.21.15.132:6807/10193","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.288306+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.391295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.369266+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.348653+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:38.542719+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:38.435889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.586599+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-09T09:39:37.283808+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-09T09:39:55.289 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2019-12-09T09:39:55.773 INFO:teuthology.orchestra.run.smithi121.stdout:55834574854 2019-12-09T09:39:55.774 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2019-12-09T09:39:56.295 INFO:teuthology.orchestra.run.smithi121.stdout:60129542149 2019-12-09T09:39:56.295 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2019-12-09T09:39:56.898 INFO:teuthology.orchestra.run.smithi121.stdout:60129542149 2019-12-09T09:39:56.898 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2019-12-09T09:39:57.374 INFO:teuthology.orchestra.run.smithi121.stdout:55834574854 2019-12-09T09:39:57.374 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2019-12-09T09:39:57.963 INFO:teuthology.orchestra.run.smithi121.stdout:64424509447 2019-12-09T09:39:57.964 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2019-12-09T09:39:58.545 INFO:teuthology.orchestra.run.smithi121.stdout:60129542150 2019-12-09T09:39:58.545 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2019-12-09T09:39:59.153 INFO:teuthology.orchestra.run.smithi121.stdout:60129542149 2019-12-09T09:39:59.154 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2019-12-09T09:39:59.699 INFO:teuthology.orchestra.run.smithi121.stdout:60129542151 2019-12-09T09:39:59.700 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-12-09T09:40:00.554 INFO:teuthology.orchestra.run.smithi121.stdout:55834574855 2019-12-09T09:40:00.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.0 2019-12-09T09:40:00.568 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2019-12-09T09:40:01.332 INFO:teuthology.orchestra.run.smithi121.stdout:60129542149 2019-12-09T09:40:01.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2019-12-09T09:40:01.350 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2019-12-09T09:40:02.225 INFO:teuthology.orchestra.run.smithi121.stdout:60129542150 2019-12-09T09:40:02.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.2 2019-12-09T09:40:02.240 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2019-12-09T09:40:03.038 INFO:teuthology.orchestra.run.smithi121.stdout:55834574855 2019-12-09T09:40:03.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.3 2019-12-09T09:40:03.057 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2019-12-09T09:40:03.778 INFO:teuthology.orchestra.run.smithi121.stdout:64424509448 2019-12-09T09:40:03.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.4 2019-12-09T09:40:03.799 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2019-12-09T09:40:04.618 INFO:teuthology.orchestra.run.smithi121.stdout:60129542151 2019-12-09T09:40:04.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.5 2019-12-09T09:40:04.632 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2019-12-09T09:40:05.514 INFO:teuthology.orchestra.run.smithi121.stdout:60129542150 2019-12-09T09:40:05.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.6 2019-12-09T09:40:05.531 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2019-12-09T09:40:06.251 INFO:teuthology.orchestra.run.smithi121.stdout:60129542152 2019-12-09T09:40:06.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.7 2019-12-09T09:40:06.267 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2019-12-09T09:40:06.267 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-12-09T09:40:07.157 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2019-12-09T09:40:07.157 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:40:07.176 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2019-12-09T09:40:07.019497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":1699680,"kb_used_data":747895360,"kb_used_omap":294,"kb_used_meta":0,"kb_avail":747895360,"statfs":{"total":767585320960,"available":765844848640,"internally_reserved":0,"allocated":765844848640,"data_stored":765844848640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":302019,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-09T09:39:52.246120+0000","last_change":"2019-12-09T09:39:52.216122+0000","last_active":"2019-12-09T09:39:52.246120+0000","last_peered":"2019-12-09T09:39:52.246120+0000","last_clean":"2019-12-09T09:39:52.246120+0000","last_became_active":"2019-12-09T09:39:52.191651+0000","last_became_peered":"2019-12-09T09:39:52.191651+0000","last_unstale":"2019-12-09T09:39:52.246120+0000","last_undegraded":"2019-12-09T09:39:52.246120+0000","last_fullsized":"2019-12-09T09:39:52.246120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_clean_scrub_stamp":"2019-12-09T09:39:49.421726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-09T09:39:51.992246+0000","last_change":"2019-12-09T09:39:51.888230+0000","last_active":"2019-12-09T09:39:51.992246+0000","last_peered":"2019-12-09T09:39:51.992246+0000","last_clean":"2019-12-09T09:39:51.992246+0000","last_became_active":"2019-12-09T09:39:51.858316+0000","last_became_peered":"2019-12-09T09:39:51.858316+0000","last_unstale":"2019-12-09T09:39:51.992246+0000","last_undegraded":"2019-12-09T09:39:51.992246+0000","last_fullsized":"2019-12-09T09:39:51.992246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_clean_scrub_stamp":"2019-12-09T09:39:49.421726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-09T09:39:52.133894+0000","last_change":"2019-12-09T09:39:52.114978+0000","last_active":"2019-12-09T09:39:52.133894+0000","last_peered":"2019-12-09T09:39:52.133894+0000","last_clean":"2019-12-09T09:39:52.133894+0000","last_became_active":"2019-12-09T09:39:52.079348+0000","last_became_peered":"2019-12-09T09:39:52.079348+0000","last_unstale":"2019-12-09T09:39:52.133894+0000","last_undegraded":"2019-12-09T09:39:52.133894+0000","last_fullsized":"2019-12-09T09:39:52.133894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_clean_scrub_stamp":"2019-12-09T09:39:49.421726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-09T09:39:51.860242+0000","last_change":"2019-12-09T09:39:51.324191+0000","last_active":"2019-12-09T09:39:51.860242+0000","last_peered":"2019-12-09T09:39:51.860242+0000","last_clean":"2019-12-09T09:39:51.860242+0000","last_became_active":"2019-12-09T09:39:51.281281+0000","last_became_peered":"2019-12-09T09:39:51.281281+0000","last_unstale":"2019-12-09T09:39:51.860242+0000","last_undegraded":"2019-12-09T09:39:51.860242+0000","last_fullsized":"2019-12-09T09:39:51.860242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_clean_scrub_stamp":"2019-12-09T09:39:49.421726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-09T09:39:52.594426+0000","last_change":"2019-12-09T09:39:52.569542+0000","last_active":"2019-12-09T09:39:52.594426+0000","last_peered":"2019-12-09T09:39:52.594426+0000","last_clean":"2019-12-09T09:39:52.594426+0000","last_became_active":"2019-12-09T09:39:52.536788+0000","last_became_peered":"2019-12-09T09:39:52.536788+0000","last_unstale":"2019-12-09T09:39:52.594426+0000","last_undegraded":"2019-12-09T09:39:52.594426+0000","last_fullsized":"2019-12-09T09:39:52.594426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_clean_scrub_stamp":"2019-12-09T09:39:49.421726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-09T09:39:51.986759+0000","last_change":"2019-12-09T09:39:51.949049+0000","last_active":"2019-12-09T09:39:51.986759+0000","last_peered":"2019-12-09T09:39:51.986759+0000","last_clean":"2019-12-09T09:39:51.986759+0000","last_became_active":"2019-12-09T09:39:51.907043+0000","last_became_peered":"2019-12-09T09:39:51.907043+0000","last_unstale":"2019-12-09T09:39:51.986759+0000","last_undegraded":"2019-12-09T09:39:51.986759+0000","last_fullsized":"2019-12-09T09:39:51.986759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_clean_scrub_stamp":"2019-12-09T09:39:49.421726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-09T09:39:52.186967+0000","last_change":"2019-12-09T09:39:52.170493+0000","last_active":"2019-12-09T09:39:52.186967+0000","last_peered":"2019-12-09T09:39:52.186967+0000","last_clean":"2019-12-09T09:39:52.186967+0000","last_became_active":"2019-12-09T09:39:52.139666+0000","last_became_peered":"2019-12-09T09:39:52.139666+0000","last_unstale":"2019-12-09T09:39:52.186967+0000","last_undegraded":"2019-12-09T09:39:52.186967+0000","last_fullsized":"2019-12-09T09:39:52.186967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_clean_scrub_stamp":"2019-12-09T09:39:49.421726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-09T09:39:52.333601+0000","last_change":"2019-12-09T09:39:52.312808+0000","last_active":"2019-12-09T09:39:52.333601+0000","last_peered":"2019-12-09T09:39:52.333601+0000","last_clean":"2019-12-09T09:39:52.333601+0000","last_became_active":"2019-12-09T09:39:52.260560+0000","last_became_peered":"2019-12-09T09:39:52.260560+0000","last_unstale":"2019-12-09T09:39:52.333601+0000","last_undegraded":"2019-12-09T09:39:52.333601+0000","last_fullsized":"2019-12-09T09:39:52.333601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_clean_scrub_stamp":"2019-12-09T09:39:49.421726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37711,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.690}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.890}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.017}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.889}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":41.153}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.636}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.771}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32935,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.464}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.789}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.970}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.299}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.775}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.903}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":46,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47417,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.667}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.101}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.916}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.714}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.394}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.879}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32891,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.506}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.657}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.696}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.018}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.987}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":36.816}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37711,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.210}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.972}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.960}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":11.651}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.795}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.546}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37831,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":11.268}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.675}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.276}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.553}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.156}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.895}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.826}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":41,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42588,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.771}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.474}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.548}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.423}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.074}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.014}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32935,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.715}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.693}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.634}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.991}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.324}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.297}]}]}]}} 2019-12-09T09:40:07.179 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-12-09T09:40:08.019 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:40:08.019 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2019-12-09T09:40:08.031 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2019-12-09T09:40:07.019497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":1699680,"kb_used_data":747895360,"kb_used_omap":294,"kb_used_meta":0,"kb_avail":747895360,"statfs":{"total":767585320960,"available":765844848640,"internally_reserved":0,"allocated":765844848640,"data_stored":765844848640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":302019,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-09T09:39:52.246120+0000","last_change":"2019-12-09T09:39:52.216122+0000","last_active":"2019-12-09T09:39:52.246120+0000","last_peered":"2019-12-09T09:39:52.246120+0000","last_clean":"2019-12-09T09:39:52.246120+0000","last_became_active":"2019-12-09T09:39:52.191651+0000","last_became_peered":"2019-12-09T09:39:52.191651+0000","last_unstale":"2019-12-09T09:39:52.246120+0000","last_undegraded":"2019-12-09T09:39:52.246120+0000","last_fullsized":"2019-12-09T09:39:52.246120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_clean_scrub_stamp":"2019-12-09T09:39:49.421726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-09T09:39:51.992246+0000","last_change":"2019-12-09T09:39:51.888230+0000","last_active":"2019-12-09T09:39:51.992246+0000","last_peered":"2019-12-09T09:39:51.992246+0000","last_clean":"2019-12-09T09:39:51.992246+0000","last_became_active":"2019-12-09T09:39:51.858316+0000","last_became_peered":"2019-12-09T09:39:51.858316+0000","last_unstale":"2019-12-09T09:39:51.992246+0000","last_undegraded":"2019-12-09T09:39:51.992246+0000","last_fullsized":"2019-12-09T09:39:51.992246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_clean_scrub_stamp":"2019-12-09T09:39:49.421726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-09T09:39:52.133894+0000","last_change":"2019-12-09T09:39:52.114978+0000","last_active":"2019-12-09T09:39:52.133894+0000","last_peered":"2019-12-09T09:39:52.133894+0000","last_clean":"2019-12-09T09:39:52.133894+0000","last_became_active":"2019-12-09T09:39:52.079348+0000","last_became_peered":"2019-12-09T09:39:52.079348+0000","last_unstale":"2019-12-09T09:39:52.133894+0000","last_undegraded":"2019-12-09T09:39:52.133894+0000","last_fullsized":"2019-12-09T09:39:52.133894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_clean_scrub_stamp":"2019-12-09T09:39:49.421726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-09T09:39:51.860242+0000","last_change":"2019-12-09T09:39:51.324191+0000","last_active":"2019-12-09T09:39:51.860242+0000","last_peered":"2019-12-09T09:39:51.860242+0000","last_clean":"2019-12-09T09:39:51.860242+0000","last_became_active":"2019-12-09T09:39:51.281281+0000","last_became_peered":"2019-12-09T09:39:51.281281+0000","last_unstale":"2019-12-09T09:39:51.860242+0000","last_undegraded":"2019-12-09T09:39:51.860242+0000","last_fullsized":"2019-12-09T09:39:51.860242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_clean_scrub_stamp":"2019-12-09T09:39:49.421726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-09T09:39:52.594426+0000","last_change":"2019-12-09T09:39:52.569542+0000","last_active":"2019-12-09T09:39:52.594426+0000","last_peered":"2019-12-09T09:39:52.594426+0000","last_clean":"2019-12-09T09:39:52.594426+0000","last_became_active":"2019-12-09T09:39:52.536788+0000","last_became_peered":"2019-12-09T09:39:52.536788+0000","last_unstale":"2019-12-09T09:39:52.594426+0000","last_undegraded":"2019-12-09T09:39:52.594426+0000","last_fullsized":"2019-12-09T09:39:52.594426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_clean_scrub_stamp":"2019-12-09T09:39:49.421726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-09T09:39:51.986759+0000","last_change":"2019-12-09T09:39:51.949049+0000","last_active":"2019-12-09T09:39:51.986759+0000","last_peered":"2019-12-09T09:39:51.986759+0000","last_clean":"2019-12-09T09:39:51.986759+0000","last_became_active":"2019-12-09T09:39:51.907043+0000","last_became_peered":"2019-12-09T09:39:51.907043+0000","last_unstale":"2019-12-09T09:39:51.986759+0000","last_undegraded":"2019-12-09T09:39:51.986759+0000","last_fullsized":"2019-12-09T09:39:51.986759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_clean_scrub_stamp":"2019-12-09T09:39:49.421726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-09T09:39:52.186967+0000","last_change":"2019-12-09T09:39:52.170493+0000","last_active":"2019-12-09T09:39:52.186967+0000","last_peered":"2019-12-09T09:39:52.186967+0000","last_clean":"2019-12-09T09:39:52.186967+0000","last_became_active":"2019-12-09T09:39:52.139666+0000","last_became_peered":"2019-12-09T09:39:52.139666+0000","last_unstale":"2019-12-09T09:39:52.186967+0000","last_undegraded":"2019-12-09T09:39:52.186967+0000","last_fullsized":"2019-12-09T09:39:52.186967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_clean_scrub_stamp":"2019-12-09T09:39:49.421726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-09T09:39:52.333601+0000","last_change":"2019-12-09T09:39:52.312808+0000","last_active":"2019-12-09T09:39:52.333601+0000","last_peered":"2019-12-09T09:39:52.333601+0000","last_clean":"2019-12-09T09:39:52.333601+0000","last_became_active":"2019-12-09T09:39:52.260560+0000","last_became_peered":"2019-12-09T09:39:52.260560+0000","last_unstale":"2019-12-09T09:39:52.333601+0000","last_undegraded":"2019-12-09T09:39:52.333601+0000","last_fullsized":"2019-12-09T09:39:52.333601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-09T09:39:49.421726+0000","last_clean_scrub_stamp":"2019-12-09T09:39:49.421726+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37711,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.690}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.890}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.017}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.889}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":41.153}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.636}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.771}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32935,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.464}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.789}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.970}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.299}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.775}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.903}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":46,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47417,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.667}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.101}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.916}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.714}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.394}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.879}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32891,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.506}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.657}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.696}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.018}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.987}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":36.816}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37711,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.210}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.972}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.960}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":11.651}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.795}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.546}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37831,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":11.268}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.675}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.276}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.553}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.156}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.895}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.826}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":41,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42588,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.771}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.474}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.548}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.423}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.074}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.014}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32935,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.715}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.693}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.634}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.991}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.324}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.297}]}]}]}} 2019-12-09T09:40:08.033 INFO:tasks.ceph.ceph_manager.ceph:clean! 2019-12-09T09:40:08.034 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2019-12-09T09:40:08.034 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2019-12-09T09:40:08.034 INFO:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2019-12-09T09:40:08.785 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:40:08.798 INFO:teuthology.orchestra.run.smithi121.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-12-09T09:40:08.799 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2019-12-09T09:40:08.799 INFO:teuthology.run_tasks:Running task openssl_keys... 2019-12-09T09:40:08.818 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.1': {'ca': 'root', 'client': 'client.1', 'embed-key': True}, 'root': {'key-type': 'rsa:4096', 'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0', 'client.1']}, 'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}} 2019-12-09T09:40:08.818 INFO:teuthology.orchestra.run.smithi121:> mkdir -p /home/ubuntu/cephtest/ca 2019-12-09T09:40:08.890 INFO:teuthology.orchestra.run.smithi121:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2019-12-09T09:40:08.973 INFO:teuthology.orchestra.run.smithi121.stderr:Generating a 4096 bit RSA private key 2019-12-09T09:40:10.481 INFO:teuthology.orchestra.run.smithi121.stderr:...........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................++ 2019-12-09T09:40:10.543 INFO:teuthology.orchestra.run.smithi121.stderr:....................++ 2019-12-09T09:40:10.544 INFO:teuthology.orchestra.run.smithi121.stderr:writing new private key to '/home/ubuntu/cephtest/ca/root.key' 2019-12-09T09:40:10.544 INFO:teuthology.orchestra.run.smithi121.stderr:----- 2019-12-09T09:40:10.550 INFO:teuthology.orchestra.run.smithi121:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2019-12-09T09:40:10.649 INFO:teuthology.orchestra.run.smithi121:> sudo update-ca-trust 2019-12-09T09:40:11.408 INFO:teuthology.orchestra.run.smithi132:> mkdir -p /home/ubuntu/cephtest/ca 2019-12-09T09:40:11.518 INFO:tasks.openssl_keys:copying from ubuntu@smithi121.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/root.crt to ubuntu@smithi132.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/root.crt... 2019-12-09T09:40:11.608 DEBUG:teuthology.orchestra.remote:smithi121:/home/ubuntu/cephtest/ca/root.crt is 2KB 2019-12-09T09:40:11.758 INFO:teuthology.orchestra.run.smithi132:> sudo mv /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2019-12-09T09:40:11.848 INFO:teuthology.orchestra.run.smithi132:> sudo update-ca-trust 2019-12-09T09:40:12.432 INFO:teuthology.orchestra.run.smithi132:> mkdir -p /home/ubuntu/cephtest/ca 2019-12-09T09:40:12.499 INFO:teuthology.orchestra.run.smithi121:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.1.key -out /home/ubuntu/cephtest/ca/rgw.client.1.csr -subj /CN=smithi132.front.sepia.ceph.com 2019-12-09T09:40:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:Generating a 2048 bit RSA private key 2019-12-09T09:40:12.674 INFO:teuthology.orchestra.run.smithi121.stderr:.........................................................+++ 2019-12-09T09:40:12.743 INFO:teuthology.orchestra.run.smithi121.stderr:..............................................................+++ 2019-12-09T09:40:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:writing new private key to '/home/ubuntu/cephtest/ca/rgw.client.1.key' 2019-12-09T09:40:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:----- 2019-12-09T09:40:12.748 INFO:teuthology.orchestra.run.smithi121:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.1.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.1.crt -days 365 -sha256 2019-12-09T09:40:12.810 INFO:teuthology.orchestra.run.smithi121.stderr:Signature ok 2019-12-09T09:40:12.811 INFO:teuthology.orchestra.run.smithi121.stderr:subject=/CN=smithi132.front.sepia.ceph.com 2019-12-09T09:40:12.811 INFO:teuthology.orchestra.run.smithi121.stderr:Getting CA Private Key 2019-12-09T09:40:12.823 INFO:teuthology.orchestra.run.smithi121:> rm /home/ubuntu/cephtest/ca/rgw.client.1.csr /home/ubuntu/cephtest/ca/root.srl 2019-12-09T09:40:12.875 INFO:teuthology.orchestra.run.smithi121:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.1.crt 2019-12-09T09:40:12.923 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/ca/rgw.client.1.crt: OK 2019-12-09T09:40:12.923 INFO:tasks.openssl_keys:copying from ubuntu@smithi121.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.crt to ubuntu@smithi132.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.crt... 2019-12-09T09:40:12.974 DEBUG:teuthology.orchestra.remote:smithi121:/home/ubuntu/cephtest/ca/rgw.client.1.crt is 1KB 2019-12-09T09:40:13.117 INFO:tasks.openssl_keys:copying from ubuntu@smithi121.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.key to ubuntu@smithi132.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.key... 2019-12-09T09:40:13.185 DEBUG:teuthology.orchestra.remote:smithi121:/home/ubuntu/cephtest/ca/rgw.client.1.key is 2KB 2019-12-09T09:40:13.333 INFO:teuthology.orchestra.run.smithi121:> rm /home/ubuntu/cephtest/ca/rgw.client.1.crt /home/ubuntu/cephtest/ca/rgw.client.1.key 2019-12-09T09:40:13.422 INFO:teuthology.orchestra.run.smithi132:> openssl verify /home/ubuntu/cephtest/ca/rgw.client.1.crt 2019-12-09T09:40:13.537 INFO:teuthology.orchestra.run.smithi132.stdout:/home/ubuntu/cephtest/ca/rgw.client.1.crt: OK 2019-12-09T09:40:13.537 INFO:teuthology.orchestra.run.smithi132:> cat /home/ubuntu/cephtest/ca/rgw.client.1.key >> /home/ubuntu/cephtest/ca/rgw.client.1.crt 2019-12-09T09:40:13.618 INFO:teuthology.orchestra.run.smithi121:> mkdir -p /home/ubuntu/cephtest/ca 2019-12-09T09:40:13.710 INFO:teuthology.orchestra.run.smithi121:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi121.front.sepia.ceph.com 2019-12-09T09:40:13.798 INFO:teuthology.orchestra.run.smithi121.stderr:Generating a 2048 bit RSA private key 2019-12-09T09:40:13.808 INFO:teuthology.orchestra.run.smithi121.stderr:...+++ 2019-12-09T09:40:13.821 INFO:teuthology.orchestra.run.smithi121.stderr:....+++ 2019-12-09T09:40:13.821 INFO:teuthology.orchestra.run.smithi121.stderr:writing new private key to '/home/ubuntu/cephtest/ca/rgw.client.0.key' 2019-12-09T09:40:13.821 INFO:teuthology.orchestra.run.smithi121.stderr:----- 2019-12-09T09:40:13.824 INFO:teuthology.orchestra.run.smithi121:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 2019-12-09T09:40:13.904 INFO:teuthology.orchestra.run.smithi121.stderr:Signature ok 2019-12-09T09:40:13.904 INFO:teuthology.orchestra.run.smithi121.stderr:subject=/CN=smithi121.front.sepia.ceph.com 2019-12-09T09:40:13.905 INFO:teuthology.orchestra.run.smithi121.stderr:Getting CA Private Key 2019-12-09T09:40:13.916 INFO:teuthology.orchestra.run.smithi121:> rm /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl 2019-12-09T09:40:13.987 INFO:teuthology.orchestra.run.smithi121:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2019-12-09T09:40:14.066 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2019-12-09T09:40:14.067 INFO:teuthology.orchestra.run.smithi121:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2019-12-09T09:40:14.129 INFO:teuthology.run_tasks:Running task rgw... 2019-12-09T09:40:14.145 DEBUG:tasks.rgw:config is {'client.1': {'ssl certificate': 'rgw.client.1'}, 'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2019-12-09T09:40:14.145 DEBUG:tasks.rgw:client list is ['client.0'] 2019-12-09T09:40:14.145 INFO:tasks.rgw:Creating data pools 2019-12-09T09:40:14.145 DEBUG:tasks.rgw:Obtaining remote for client client.0 2019-12-09T09:40:14.146 INFO:teuthology.orchestra.run.smithi121:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=2 m=1 --cluster ceph 2019-12-09T09:40:15.265 INFO:teuthology.orchestra.run.smithi121:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2019-12-09T09:40:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'default.rgw.buckets.data' created 2019-12-09T09:40:17.667 INFO:teuthology.orchestra.run.smithi121:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2019-12-09T09:40:18.900 INFO:teuthology.orchestra.run.smithi121.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2019-12-09T09:40:18.915 INFO:teuthology.orchestra.run.smithi121:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2019-12-09T09:40:20.095 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'default.rgw.buckets.index' created 2019-12-09T09:40:20.111 INFO:teuthology.orchestra.run.smithi121:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2019-12-09T09:40:21.173 INFO:teuthology.orchestra.run.smithi121.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2019-12-09T09:40:21.191 DEBUG:tasks.rgw:Pools created 2019-12-09T09:40:21.191 INFO:tasks.rgw:Configuring compression type = random 2019-12-09T09:40:21.192 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-12-09T09:40:21.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-12-09T09:40:21.192 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-12-09T09:40:21.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:21.420+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:23.718 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:23.718+0000 7ffa9007bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:23.718 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:23.718+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:23.739 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:23.739+0000 7ffa9007bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:23.739 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:23.739+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:23.752 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:23.752+0000 7ffa9007bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:23.752 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:23.752+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:23.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:23.926+0000 7ffa9007bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:26.302 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:26.303+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:26.315 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:26.317+0000 7ffa9007bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:26.316 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:26.317+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:26.322 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:26.323+0000 7ffa9007bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:26.322 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:26.323+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:26.337 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:26.334+0000 7ffa9007bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:26.337 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:26.334+0000 7ffa9007bec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T09:40:26.338 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:26.334+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:26.341 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:26.342+0000 7ffa9007bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:26.341 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:26.342+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:26.351 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:26.352+0000 7ffa9007bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:26.351 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:26.352+0000 7ffa9007bec0 10 Creating default zonegroup 2019-12-09T09:40:26.351 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:26.352+0000 7ffa9007bec0 20 get_system_obj_state: rctx=0x7fff459209e0 obj=:.pools.avail state=0x55865a9a9960 s->prefetch_data=0 2019-12-09T09:40:26.356 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:26.356+0000 7ffa9007bec0 10 couldn't find old data placement pools config, setting up new ones for the zone 2019-12-09T09:40:27.093 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:27.094+0000 7ffa9007bec0 10 WARNING: store->list_zones() returned r=-2 2019-12-09T09:40:27.093 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:27.094+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:27.101 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:27.103+0000 7ffa9007bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:28.207 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:28.209+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:28.217 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:28.219+0000 7ffa9007bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:28.217 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:28.219+0000 7ffa9007bec0 10 could not read realm id: (2) No such file or directory 2019-12-09T09:40:28.218 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:28.219+0000 7ffa9007bec0 10 WARNING: failed to set zone as default, r=-22 2019-12-09T09:40:28.218 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:28.219+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:28.229 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:28.230+0000 7ffa9007bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:28.955 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:28.957+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:29.020 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:29.021+0000 7ffa9007bec0 20 rados_obj.operate() r=0 bl.length=805 2019-12-09T09:40:29.020 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:29.021+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:29.020 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:29.021+0000 7ffa7caa4700 0 -- 172.21.15.121:0/3234288687 >> [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] conn(0x7ffa7400d550 msgr2=0x7ffa7400f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T09:40:29.093 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:29.095+0000 7ffa9007bec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-09T09:40:29.094 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:29.095+0000 7ffa9007bec0 20 zonegroup default 2019-12-09T09:40:29.094 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:29.095+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:29.104 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:29.105+0000 7ffa9007bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:29.104 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:29.105+0000 7ffa9007bec0 10 Cannot find current period zone using local zone 2019-12-09T09:40:29.104 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:29.105+0000 7ffa9007bec0 10 Using default name default 2019-12-09T09:40:29.104 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:29.105+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:29.163 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:29.164+0000 7ffa9007bec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:40:29.163 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:29.164+0000 7ffa9007bec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:29.181 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:29.182+0000 7ffa9007bec0 20 rados_obj.operate() r=0 bl.length=805 2019-12-09T09:40:29.181 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:29.182+0000 7ffa9007bec0 20 zone default found 2019-12-09T09:40:29.181 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:29.182+0000 7ffa9007bec0 20 started sync module instance, tier type = 2019-12-09T09:40:29.182 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:29.182+0000 7ffa9007bec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T09:40:33.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:33.197+0000 7ffa7d2a5700 0 -- 172.21.15.121:0/3234288687 >> [v2:172.21.15.132:6802/10193,v1:172.21.15.132:6803/10193] conn(0x55865a9a27c0 msgr2=0x55865a9a4c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T09:40:33.884 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:33.884+0000 7ffa9007bec0 20 add_watcher() i=0 2019-12-09T09:40:33.885 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:33.884+0000 7ffa9007bec0 20 add_watcher() i=1 2019-12-09T09:40:33.885 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:33.884+0000 7ffa9007bec0 20 add_watcher() i=2 2019-12-09T09:40:33.885 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:33.884+0000 7ffa9007bec0 20 add_watcher() i=3 2019-12-09T09:40:33.885 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:33.884+0000 7ffa9007bec0 20 add_watcher() i=4 2019-12-09T09:40:33.885 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:33.884+0000 7ffa9007bec0 20 add_watcher() i=5 2019-12-09T09:40:33.915 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:33.916+0000 7ffa9007bec0 20 add_watcher() i=6 2019-12-09T09:40:33.941 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:33.943+0000 7ffa9007bec0 20 add_watcher() i=7 2019-12-09T09:40:33.942 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:33.943+0000 7ffa9007bec0 2 all 8 watchers are set, enabling cache 2019-12-09T09:40:33.942 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:33.943+0000 7ffa4dfdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T09:40:38.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:38.419+0000 7ffa9007bec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2019-12-09T09:40:42.630 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:42.630+0000 7ffa9007bec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.log 2019-12-09T09:40:46.358 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:46.358+0000 7ff9b3fff700 20 reqs_thread_entry: start 2019-12-09T09:40:46.359 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:46.359+0000 7ff9b1ffb700 20 reqs_thread_entry: start 2019-12-09T09:40:46.359 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:46.359+0000 7ffa9007bec0 20 init_complete bucket index max shards: 0 2019-12-09T09:40:46.359 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:46.360+0000 7ff99ffff700 20 reqs_thread_entry: start 2019-12-09T09:40:46.698 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:46.699+0000 7ffa9007bec0 20 remove_watcher() i=0 2019-12-09T09:40:46.699 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:46.699+0000 7ffa9007bec0 2 removed watcher, disabling cache 2019-12-09T09:40:46.792 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:46.792+0000 7ffa9007bec0 20 remove_watcher() i=1 2019-12-09T09:40:46.851 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:46.852+0000 7ffa9007bec0 20 remove_watcher() i=2 2019-12-09T09:40:46.911 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:46.911+0000 7ffa9007bec0 20 remove_watcher() i=3 2019-12-09T09:40:46.958 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:46.959+0000 7ffa9007bec0 20 remove_watcher() i=4 2019-12-09T09:40:46.995 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:46.995+0000 7ffa9007bec0 20 remove_watcher() i=5 2019-12-09T09:40:47.063 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.063+0000 7ffa9007bec0 20 remove_watcher() i=6 2019-12-09T09:40:47.099 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.100+0000 7ffa9007bec0 20 remove_watcher() i=7 2019-12-09T09:40:47.107 INFO:teuthology.orchestra.run.smithi121.stdout:[] 2019-12-09T09:40:47.107 DEBUG:tasks.util.rgw: json result: [] 2019-12-09T09:40:47.107 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-12-09T09:40:47.107 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-12-09T09:40:47.107 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2019-12-09T09:40:47.315 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.315+0000 7fde69ffb700 20 reqs_thread_entry: start 2019-12-09T09:40:47.315 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.315+0000 7fdf34a4cec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:47.336 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.336+0000 7fdf34a4cec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:40:47.336 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.337+0000 7fdf34a4cec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:47.358 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.359+0000 7fdf34a4cec0 20 rados_obj.operate() r=0 bl.length=805 2019-12-09T09:40:47.358 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.359+0000 7fdf34a4cec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:47.373 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.373+0000 7fdf34a4cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:47.373 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.373+0000 7fdf34a4cec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:47.389 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.390+0000 7fdf34a4cec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:40:47.389 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.390+0000 7fdf34a4cec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:47.411 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.412+0000 7fdf34a4cec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-09T09:40:47.567 INFO:teuthology.orchestra.run.smithi121.stdout:{"id":"a55fd90f-db62-40cd-9264-5916c91f1695","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-12-09T09:40:47.567 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'a55fd90f-db62-40cd-9264-5916c91f1695', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-12-09T09:40:47.567 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-12-09T09:40:47.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-12-09T09:40:47.568 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-12-09T09:40:47.726 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.725+0000 7fa79cafdec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:47.758 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.758+0000 7fa79cafdec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:47.758 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.758+0000 7fa79cafdec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:47.767 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.768+0000 7fa79cafdec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:47.768 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.768+0000 7fa79cafdec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:47.776 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.776+0000 7fa79cafdec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:47.776 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.776+0000 7fa79cafdec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:47.800 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:47.801+0000 7fa79cafdec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:40:48.116 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.116+0000 7fa79cafdec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T09:40:48.116 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.116+0000 7fa79cafdec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T09:40:48.116 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.116+0000 7fa79cafdec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T09:40:48.117 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.116+0000 7fa79cafdec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T09:40:48.117 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.116+0000 7fa79cafdec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:48.133 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.134+0000 7fa79cafdec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:40:48.133 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.134+0000 7fa79cafdec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:48.164 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.164+0000 7fa79cafdec0 20 rados_obj.operate() r=0 bl.length=821 2019-12-09T09:40:48.164 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.164+0000 7fa79cafdec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:48.181 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.182+0000 7fa79cafdec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:40:48.181 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.182+0000 7fa79cafdec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:48.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.194+0000 7fa79cafdec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-09T09:40:48.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.194+0000 7fa79cafdec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:48.204 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.204+0000 7fa79cafdec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:48.204 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.204+0000 7fa79cafdec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T09:40:48.204 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.204+0000 7fa79cafdec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:48.213 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.214+0000 7fa79cafdec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:48.213 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.214+0000 7fa79cafdec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:48.230 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.231+0000 7fa79cafdec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:40:48.231 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.231+0000 7fa79cafdec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:48.245 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.246+0000 7fa79cafdec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-09T09:40:48.245 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.246+0000 7fa79cafdec0 20 zonegroup default 2019-12-09T09:40:48.245 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.246+0000 7fa79cafdec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:48.254 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.254+0000 7fa79cafdec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:48.254 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.255+0000 7fa79cafdec0 10 Cannot find current period zone using local zone 2019-12-09T09:40:48.254 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.255+0000 7fa79cafdec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:48.266 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.266+0000 7fa79cafdec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:48.266 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.267+0000 7fa79cafdec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:48.282 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.283+0000 7fa79cafdec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:40:48.282 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.283+0000 7fa79cafdec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:48.299 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.299+0000 7fa79cafdec0 20 rados_obj.operate() r=0 bl.length=821 2019-12-09T09:40:48.299 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.299+0000 7fa79cafdec0 20 zone default found 2019-12-09T09:40:48.299 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.299+0000 7fa79cafdec0 20 started sync module instance, tier type = 2019-12-09T09:40:48.299 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.299+0000 7fa79cafdec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T09:40:48.708 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.708+0000 7fa79cafdec0 20 add_watcher() i=0 2019-12-09T09:40:48.708 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.708+0000 7fa79cafdec0 20 add_watcher() i=1 2019-12-09T09:40:48.708 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.708+0000 7fa79cafdec0 20 add_watcher() i=2 2019-12-09T09:40:48.708 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.708+0000 7fa79cafdec0 20 add_watcher() i=3 2019-12-09T09:40:48.708 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.708+0000 7fa79cafdec0 20 add_watcher() i=4 2019-12-09T09:40:48.708 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.708+0000 7fa79cafdec0 20 add_watcher() i=5 2019-12-09T09:40:48.709 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.708+0000 7fa79cafdec0 20 add_watcher() i=6 2019-12-09T09:40:48.739 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.740+0000 7fa79cafdec0 20 add_watcher() i=7 2019-12-09T09:40:48.739 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.740+0000 7fa79cafdec0 2 all 8 watchers are set, enabling cache 2019-12-09T09:40:48.739 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.740+0000 7fa75a7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T09:40:48.754 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:48.755+0000 7fa78a528700 0 -- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x560fcf0a9de0 msgr2=0x560fcf0aa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T09:40:49.058 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:49.059+0000 7fa78a528700 0 -- 172.21.15.121:0/1446735448 >> [v2:172.21.15.132:6810/10196,v1:172.21.15.132:6811/10196] conn(0x560fcf0beed0 msgr2=0x560fcf0c12f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T09:40:51.616 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:51.616+0000 7fa6d0ff9700 20 reqs_thread_entry: start 2019-12-09T09:40:51.616 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:51.616+0000 7fa6ca7fc700 20 reqs_thread_entry: start 2019-12-09T09:40:51.616 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:51.617+0000 7fa79cafdec0 20 init_complete bucket index max shards: 0 2019-12-09T09:40:51.617 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:51.618+0000 7fa6c8ff9700 20 reqs_thread_entry: start 2019-12-09T09:40:51.893 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:51.894+0000 7fa79cafdec0 20 remove_watcher() i=0 2019-12-09T09:40:51.893 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:51.894+0000 7fa79cafdec0 2 removed watcher, disabling cache 2019-12-09T09:40:51.958 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:51.959+0000 7fa79cafdec0 20 remove_watcher() i=1 2019-12-09T09:40:52.008 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.008+0000 7fa79cafdec0 20 remove_watcher() i=2 2019-12-09T09:40:52.079 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.079+0000 7fa79cafdec0 20 remove_watcher() i=3 2019-12-09T09:40:52.139 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.139+0000 7fa79cafdec0 20 remove_watcher() i=4 2019-12-09T09:40:52.183 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.184+0000 7fa79cafdec0 20 remove_watcher() i=5 2019-12-09T09:40:52.232 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.232+0000 7fa79cafdec0 20 remove_watcher() i=6 2019-12-09T09:40:52.264 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.265+0000 7fa79cafdec0 20 remove_watcher() i=7 2019-12-09T09:40:52.274 INFO:teuthology.orchestra.run.smithi121.stdout:[] 2019-12-09T09:40:52.274 DEBUG:tasks.util.rgw: json result: [] 2019-12-09T09:40:52.274 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2019-12-09T09:40:52.274 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-12-09T09:40:52.274 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-12-09T09:40:52.275 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2019-12-09T09:40:52.451 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.451+0000 7fad9bfff700 20 reqs_thread_entry: start 2019-12-09T09:40:52.451 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.451+0000 7fae670ccec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:52.469 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.469+0000 7fae670ccec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:52.469 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.469+0000 7fae670ccec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:52.491 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.492+0000 7fae670ccec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:40:52.492 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.492+0000 7fae670ccec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:52.506 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.507+0000 7fae670ccec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-09T09:40:52.506 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.507+0000 7fae670ccec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:52.533 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.534+0000 7fae670ccec0 20 rados_obj.operate() r=0 bl.length=821 2019-12-09T09:40:52.639 INFO:teuthology.orchestra.run.smithi121.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2019-12-09T09:40:52.640 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-12-09T09:40:52.640 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-12-09T09:40:52.640 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-12-09T09:40:52.640 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2019-12-09T09:40:52.828 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.828+0000 7f253bfff700 20 reqs_thread_entry: start 2019-12-09T09:40:52.828 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.828+0000 7f26070ddec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:52.846 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.847+0000 7f26070ddec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:40:52.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.847+0000 7f26070ddec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:52.868 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.869+0000 7f26070ddec0 20 rados_obj.operate() r=0 bl.length=821 2019-12-09T09:40:52.869 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.869+0000 7f26070ddec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:52.886 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.887+0000 7f26070ddec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:52.886 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.887+0000 7f26070ddec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:52.901 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.901+0000 7f26070ddec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:40:52.901 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.901+0000 7f26070ddec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:52.926 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:52.927+0000 7f26070ddec0 20 rados_obj.operate() r=0 bl.length=372 2019-12-09T09:40:53.011 INFO:teuthology.orchestra.run.smithi121.stdout:{"id":"a55fd90f-db62-40cd-9264-5916c91f1695","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-12-09T09:40:53.011 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'a55fd90f-db62-40cd-9264-5916c91f1695', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-12-09T09:40:53.011 INFO:tasks.rgw:Configuring storage class type = FROZEN 2019-12-09T09:40:53.011 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-12-09T09:40:53.012 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-12-09T09:40:53.012 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2019-12-09T09:40:53.209 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.210+0000 7f2c4b7fe700 20 reqs_thread_entry: start 2019-12-09T09:40:53.210 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.210+0000 7f2d16768ec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:53.241 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.241+0000 7f2d16768ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:53.241 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.242+0000 7f2d16768ec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:53.262 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.262+0000 7f2d16768ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:40:53.262 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.262+0000 7f2d16768ec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:53.275 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.276+0000 7f2d16768ec0 20 rados_obj.operate() r=0 bl.length=372 2019-12-09T09:40:53.275 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.276+0000 7f2d16768ec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:53.293 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.293+0000 7f2d16768ec0 20 rados_obj.operate() r=0 bl.length=888 2019-12-09T09:40:53.349 INFO:teuthology.orchestra.run.smithi121.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2019-12-09T09:40:53.350 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'FROZEN', u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-12-09T09:40:53.350 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-12-09T09:40:53.350 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-12-09T09:40:53.350 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2019-12-09T09:40:53.525 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.526+0000 7ffb397fa700 20 reqs_thread_entry: start 2019-12-09T09:40:53.526 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.526+0000 7ffbf43afec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:53.548 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.548+0000 7ffbf43afec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:40:53.548 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.549+0000 7ffbf43afec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:53.567 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.567+0000 7ffbf43afec0 20 rados_obj.operate() r=0 bl.length=888 2019-12-09T09:40:53.567 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.567+0000 7ffbf43afec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:53.580 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.581+0000 7ffbf43afec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:40:53.580 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.581+0000 7ffbf43afec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:53.592 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.592+0000 7ffbf43afec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:40:53.592 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.592+0000 7ffbf43afec0 20 rados->read ofs=0 len=0 2019-12-09T09:40:53.612 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:40:53.613+0000 7ffbf43afec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T09:40:53.683 INFO:teuthology.orchestra.run.smithi121.stdout:{"id":"a55fd90f-db62-40cd-9264-5916c91f1695","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-12-09T09:40:53.684 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'FROZEN': {u'data_pool': u'default.rgw.buckets.data.frozen'}, u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'a55fd90f-db62-40cd-9264-5916c91f1695', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-12-09T09:40:53.684 INFO:tasks.rgw:Starting rgw... 2019-12-09T09:40:53.684 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2019-12-09T09:40:53.684 INFO:tasks.rgw:Using beast as radosgw frontend 2019-12-09T09:40:53.685 DEBUG:teuthology.misc:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--tool=memcheck', '--max-threads=1024'] 2019-12-09T09:40:53.685 INFO:tasks.rgw.client.0:Restarting daemon 2019-12-09T09:40:53.685 INFO:teuthology.orchestra.run.smithi121:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2019-12-09T09:40:53.689 INFO:tasks.rgw.client.0:Started 2019-12-09T09:40:53.689 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi121.front.sepia.ceph.com:443/ 2019-12-09T09:40:53.689 INFO:teuthology.orchestra.run.smithi121:> curl https://smithi121.front.sepia.ceph.com:443/ 2019-12-09T09:40:53.749 INFO:teuthology.orchestra.run.smithi121.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-09T09:40:53.750 INFO:teuthology.orchestra.run.smithi121.stderr: Dload Upload Total Spent Left Speed 2019-12-09T09:40:53.753 INFO:teuthology.orchestra.run.smithi121.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi121.front.sepia.ceph.com:443; Connection refused 2019-12-09T09:40:53.754 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-12-09T09:40:54.755 INFO:teuthology.orchestra.run.smithi121:> curl https://smithi121.front.sepia.ceph.com:443/ 2019-12-09T09:40:54.854 INFO:teuthology.orchestra.run.smithi121.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-09T09:40:54.856 INFO:teuthology.orchestra.run.smithi121.stderr: Dload Upload Total Spent Left Speed 2019-12-09T09:40:54.859 INFO:teuthology.orchestra.run.smithi121.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi121.front.sepia.ceph.com:443; Connection refused 2019-12-09T09:40:54.859 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-12-09T09:40:56.860 INFO:teuthology.orchestra.run.smithi121:> curl https://smithi121.front.sepia.ceph.com:443/ 2019-12-09T09:40:56.904 INFO:teuthology.orchestra.run.smithi121.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-09T09:40:56.905 INFO:teuthology.orchestra.run.smithi121.stderr: Dload Upload Total Spent Left Speed 2019-12-09T09:40:56.909 INFO:teuthology.orchestra.run.smithi121.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi121.front.sepia.ceph.com:443; Connection refused 2019-12-09T09:40:56.910 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-12-09T09:41:00.911 INFO:teuthology.orchestra.run.smithi121:> curl https://smithi121.front.sepia.ceph.com:443/ 2019-12-09T09:41:00.990 INFO:teuthology.orchestra.run.smithi121.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-09T09:41:00.990 INFO:teuthology.orchestra.run.smithi121.stderr: Dload Upload Total Spent Left Speed 2019-12-09T09:41:00.994 INFO:teuthology.orchestra.run.smithi121.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi121.front.sepia.ceph.com:443; Connection refused 2019-12-09T09:41:00.995 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-12-09T09:41:08.996 INFO:teuthology.orchestra.run.smithi121:> curl https://smithi121.front.sepia.ceph.com:443/ 2019-12-09T09:41:09.060 INFO:teuthology.orchestra.run.smithi121.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-09T09:41:09.060 INFO:teuthology.orchestra.run.smithi121.stderr: Dload Upload Total Spent Left Speed 2019-12-09T09:41:10.652 INFO:teuthology.orchestra.run.smithi121.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 100 214 0 214 0 0 134 0 --:--:-- 0:00:01 --:--:-- 134 2019-12-09T09:41:10.654 INFO:teuthology.orchestra.run.smithi121.stdout:anonymous 2019-12-09T09:41:10.654 INFO:teuthology.run_tasks:Running task workunit... 2019-12-09T09:41:10.698 INFO:tasks.workunit:Pulling workunits from ref 1351c819e1a9518cde4c8b12d645782009028360 2019-12-09T09:41:10.699 INFO:tasks.workunit:Making a separate scratch dir for every client... 2019-12-09T09:41:10.699 INFO:teuthology.orchestra.run.smithi121:> stat -- /home/ubuntu/cephtest/mnt.0 2019-12-09T09:41:10.762 INFO:teuthology.orchestra.run.smithi121.stderr:stat: cannot stat ‘/home/ubuntu/cephtest/mnt.0’: No such file or directory 2019-12-09T09:41:10.762 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-09T09:41:10.762 INFO:teuthology.orchestra.run.smithi121:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-12-09T09:41:10.812 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2019-12-09T09:41:10.812 INFO:teuthology.orchestra.run.smithi121:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2019-12-09T09:41:10.857 INFO:tasks.workunit:timeout=3h 2019-12-09T09:41:10.858 INFO:tasks.workunit:cleanup=True 2019-12-09T09:41:10.858 INFO:teuthology.orchestra.run.smithi121:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1351c819e1a9518cde4c8b12d645782009028360 2019-12-09T09:41:11.133 INFO:tasks.workunit.client.0.smithi121.stdout:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2019-12-09T09:42:15.626 INFO:tasks.workunit.client.0.smithi121.stderr:Note: checking out '1351c819e1a9518cde4c8b12d645782009028360'. 2019-12-09T09:42:15.627 INFO:tasks.workunit.client.0.smithi121.stderr: 2019-12-09T09:42:15.627 INFO:tasks.workunit.client.0.smithi121.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2019-12-09T09:42:15.627 INFO:tasks.workunit.client.0.smithi121.stderr:changes and commit them, and you can discard any commits you make in this 2019-12-09T09:42:15.627 INFO:tasks.workunit.client.0.smithi121.stderr:state without impacting any branches by performing another checkout. 2019-12-09T09:42:15.628 INFO:tasks.workunit.client.0.smithi121.stderr: 2019-12-09T09:42:15.628 INFO:tasks.workunit.client.0.smithi121.stderr:If you want to create a new branch to retain commits you create, you may 2019-12-09T09:42:15.628 INFO:tasks.workunit.client.0.smithi121.stderr:do so (now or later) by using -b with the checkout command again. Example: 2019-12-09T09:42:15.628 INFO:tasks.workunit.client.0.smithi121.stderr: 2019-12-09T09:42:15.628 INFO:tasks.workunit.client.0.smithi121.stderr: git checkout -b new_branch_name 2019-12-09T09:42:15.628 INFO:tasks.workunit.client.0.smithi121.stderr: 2019-12-09T09:42:15.629 INFO:tasks.workunit.client.0.smithi121.stderr:HEAD is now at 1351c81... rgw: Fix dynamic resharding not working for empty zonegroup in period 2019-12-09T09:42:15.630 INFO:teuthology.orchestra.run.smithi121:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2019-12-09T09:42:15.741 INFO:tasks.workunit.client.0.smithi121.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2019-12-09T09:42:15.745 INFO:tasks.workunit.client.0.smithi121.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-12-09T09:42:15.745 INFO:tasks.workunit.client.0.smithi121.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2019-12-09T09:42:16.231 INFO:tasks.workunit.client.0.smithi121.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2019-12-09T09:42:16.295 INFO:tasks.workunit.client.0.smithi121.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2019-12-09T09:42:16.338 INFO:tasks.workunit.client.0.smithi121.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-12-09T09:42:16.339 INFO:tasks.workunit.client.0.smithi121.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-12-09T09:42:16.339 INFO:tasks.workunit.client.0.smithi121.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2019-12-09T09:42:16.383 INFO:tasks.workunit.client.0.smithi121.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-12-09T09:42:16.438 DEBUG:teuthology.orchestra.remote:smithi121:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2019-12-09T09:42:16.493 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2019-12-09T09:42:16.493 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2019-12-09T09:42:16.493 INFO:teuthology.orchestra.run.smithi121:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1351c819e1a9518cde4c8b12d645782009028360 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2019-12-09T09:42:16.548 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2019-12-09T09:42:16.549 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 11 tests from 1 test suite. 2019-12-09T09:42:16.549 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2019-12-09T09:42:16.549 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 11 tests from ClsLock 2019-12-09T09:42:16.549 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] ClsLock.TestMultiLocking 2019-12-09T09:42:18.681 INFO:tasks.workunit.client.0.smithi121.stdout:lock: mylock 2019-12-09T09:42:18.682 INFO:tasks.workunit.client.0.smithi121.stdout: lock_type: exclusive 2019-12-09T09:42:18.682 INFO:tasks.workunit.client.0.smithi121.stdout: tag: 2019-12-09T09:42:18.682 INFO:tasks.workunit.client.0.smithi121.stdout: lockers: 2019-12-09T09:42:18.682 INFO:tasks.workunit.client.0.smithi121.stdout: client.4364 expiration=2019-12-09T09:44:18.473941+0000 addr=v1:172.21.15.121:0/2999247419 cookie= 2019-12-09T09:42:18.832 INFO:tasks.workunit.client.0.smithi121.stdout:lock: mylock 2019-12-09T09:42:18.832 INFO:tasks.workunit.client.0.smithi121.stdout: lock_type: shared 2019-12-09T09:42:18.832 INFO:tasks.workunit.client.0.smithi121.stdout: tag: 2019-12-09T09:42:18.832 INFO:tasks.workunit.client.0.smithi121.stdout: lockers: 2019-12-09T09:42:18.832 INFO:tasks.workunit.client.0.smithi121.stdout: client.4364 expiration=2019-12-09T09:44:18.763176+0000 addr=v1:172.21.15.121:0/2999247419 cookie= 2019-12-09T09:42:18.833 INFO:tasks.workunit.client.0.smithi121.stdout: client.4367 expiration=0.000000 addr=v1:172.21.15.121:0/214760078 cookie= 2019-12-09T09:42:18.887 INFO:tasks.workunit.client.0.smithi121.stdout:lock: mylock 2019-12-09T09:42:18.887 INFO:tasks.workunit.client.0.smithi121.stdout: lock_type: shared 2019-12-09T09:42:18.887 INFO:tasks.workunit.client.0.smithi121.stdout: tag: 2019-12-09T09:42:18.887 INFO:tasks.workunit.client.0.smithi121.stdout: lockers: 2019-12-09T09:42:18.887 INFO:tasks.workunit.client.0.smithi121.stdout: client.4367 expiration=0.000000 addr=v1:172.21.15.121:0/214760078 cookie= 2019-12-09T09:42:20.094 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] ClsLock.TestMultiLocking (3546 ms) 2019-12-09T09:42:20.094 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] ClsLock.TestMeta 2019-12-09T09:42:23.153 INFO:tasks.workunit.client.0.smithi121.stdout:lock: mylock 2019-12-09T09:42:23.153 INFO:tasks.workunit.client.0.smithi121.stdout: lock_type: shared 2019-12-09T09:42:23.154 INFO:tasks.workunit.client.0.smithi121.stdout: tag: 2019-12-09T09:42:23.154 INFO:tasks.workunit.client.0.smithi121.stdout: lockers: 2019-12-09T09:42:23.154 INFO:tasks.workunit.client.0.smithi121.stdout: client.4522 expiration=0.000000 addr=v1:172.21.15.121:0/4265942988 cookie= 2019-12-09T09:42:23.228 INFO:tasks.workunit.client.0.smithi121.stdout:lock: mylock 2019-12-09T09:42:23.228 INFO:tasks.workunit.client.0.smithi121.stdout: lock_type: exclusive 2019-12-09T09:42:23.228 INFO:tasks.workunit.client.0.smithi121.stdout: tag: new_tag 2019-12-09T09:42:23.228 INFO:tasks.workunit.client.0.smithi121.stdout: lockers: 2019-12-09T09:42:23.228 INFO:tasks.workunit.client.0.smithi121.stdout: client.4551 expiration=0.000000 addr=v1:172.21.15.121:0/4201930081 cookie= 2019-12-09T09:42:23.674 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] ClsLock.TestMeta (3581 ms) 2019-12-09T09:42:23.675 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] ClsLock.TestCookie 2019-12-09T09:42:26.541 INFO:tasks.workunit.client.0.smithi121.stdout:lock: mylock 2019-12-09T09:42:26.541 INFO:tasks.workunit.client.0.smithi121.stdout: lock_type: exclusive 2019-12-09T09:42:26.541 INFO:tasks.workunit.client.0.smithi121.stdout: tag: 2019-12-09T09:42:26.541 INFO:tasks.workunit.client.0.smithi121.stdout: lockers: 2019-12-09T09:42:26.609 INFO:tasks.workunit.client.0.smithi121.stdout:lock: mylock 2019-12-09T09:42:26.609 INFO:tasks.workunit.client.0.smithi121.stdout: lock_type: shared 2019-12-09T09:42:26.609 INFO:tasks.workunit.client.0.smithi121.stdout: tag: 2019-12-09T09:42:26.609 INFO:tasks.workunit.client.0.smithi121.stdout: lockers: 2019-12-09T09:42:26.610 INFO:tasks.workunit.client.0.smithi121.stdout: client.4525 expiration=0.000000 addr=v1:172.21.15.121:0/3390090593 cookie= 2019-12-09T09:42:26.610 INFO:tasks.workunit.client.0.smithi121.stdout: client.4525 expiration=0.000000 addr=v1:172.21.15.121:0/3390090593 cookie=new cookie 2019-12-09T09:42:27.078 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] ClsLock.TestCookie (3403 ms) 2019-12-09T09:42:27.078 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] ClsLock.TestMultipleLocks 2019-12-09T09:42:30.691 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] ClsLock.TestMultipleLocks (3613 ms) 2019-12-09T09:42:30.691 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] ClsLock.TestLockDuration 2019-12-09T09:42:39.030 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] ClsLock.TestLockDuration (8340 ms) 2019-12-09T09:42:39.031 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] ClsLock.TestAssertLocked 2019-12-09T09:42:42.288 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] ClsLock.TestAssertLocked (3257 ms) 2019-12-09T09:42:42.288 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] ClsLock.TestSetCookie 2019-12-09T09:42:45.631 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] ClsLock.TestSetCookie (3343 ms) 2019-12-09T09:42:45.631 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] ClsLock.TestRenew 2019-12-09T09:43:07.997 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] ClsLock.TestRenew (22365 ms) 2019-12-09T09:43:07.997 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2019-12-09T09:43:15.094 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7099 ms) 2019-12-09T09:43:15.170 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2019-12-09T09:43:23.707 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8613 ms) 2019-12-09T09:43:23.707 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2019-12-09T09:43:32.371 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8664 ms) 2019-12-09T09:43:32.371 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 11 tests from ClsLock (75824 ms total) 2019-12-09T09:43:32.371 INFO:tasks.workunit.client.0.smithi121.stdout: 2019-12-09T09:43:32.371 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2019-12-09T09:43:32.372 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 11 tests from 1 test suite ran. (75824 ms total) 2019-12-09T09:43:32.372 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 11 tests. 2019-12-09T09:43:32.373 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-09T09:43:32.373 INFO:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-09T09:43:32.483 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2019-12-09T09:43:32.484 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2019-12-09T09:43:32.484 INFO:teuthology.orchestra.run.smithi121:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1351c819e1a9518cde4c8b12d645782009028360 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2019-12-09T09:43:32.540 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2019-12-09T09:43:32.540 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 4 tests from 1 test suite. 2019-12-09T09:43:32.541 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2019-12-09T09:43:32.541 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from cls_log 2019-12-09T09:43:32.541 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_log.test_log_add_same_time 2019-12-09T09:43:35.977 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_log.test_log_add_same_time (3437 ms) 2019-12-09T09:43:35.977 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_log.test_log_add_different_time 2019-12-09T09:43:39.578 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_log.test_log_add_different_time (3601 ms) 2019-12-09T09:43:39.578 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_log.trim_by_time 2019-12-09T09:43:44.036 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_log.trim_by_time (4458 ms) 2019-12-09T09:43:44.036 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_log.trim_by_marker 2019-12-09T09:43:48.559 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_log.trim_by_marker (4522 ms) 2019-12-09T09:43:48.559 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 4 tests from cls_log (16018 ms total) 2019-12-09T09:43:48.560 INFO:tasks.workunit.client.0.smithi121.stdout: 2019-12-09T09:43:48.560 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2019-12-09T09:43:48.560 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 4 tests from 1 test suite ran. (16018 ms total) 2019-12-09T09:43:48.560 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 4 tests. 2019-12-09T09:43:48.561 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-09T09:43:48.561 INFO:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-09T09:43:48.687 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2019-12-09T09:43:48.687 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2019-12-09T09:43:48.687 INFO:teuthology.orchestra.run.smithi121:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1351c819e1a9518cde4c8b12d645782009028360 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2019-12-09T09:43:48.749 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2019-12-09T09:43:48.749 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 5 tests from 1 test suite. 2019-12-09T09:43:48.749 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2019-12-09T09:43:48.750 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 5 tests from cls_rgw 2019-12-09T09:43:48.750 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.test_implicit 2019-12-09T09:43:52.221 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.test_implicit (3472 ms) 2019-12-09T09:43:52.222 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.test_implicit_idempotent 2019-12-09T09:43:55.548 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.test_implicit_idempotent (3324 ms) 2019-12-09T09:43:55.549 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.test_put_snap 2019-12-09T09:44:04.304 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T09:44:04.257+0000 36a79700 -1 osd.5 pg_epoch: 104 pg[25.6( v 103'4 (0'0,103'4] local-lis/les=100/101 n=2 ec=100/100 lis/c=100/100 les/c/f=101/101/0 sis=100) [5,1] r=0 lpr=100 crt=102'3 lcod 102'3 mlcod 102'3 active+clean+snaptrim trimq=[1~1]] removing snap head 2019-12-09T09:44:05.957 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.test_put_snap (10412 ms) 2019-12-09T09:44:05.957 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.test_explicit 2019-12-09T09:44:09.483 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.test_explicit (3526 ms) 2019-12-09T09:44:09.483 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.set 2019-12-09T09:44:13.110 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.set (3628 ms) 2019-12-09T09:44:13.111 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 5 tests from cls_rgw (24362 ms total) 2019-12-09T09:44:13.111 INFO:tasks.workunit.client.0.smithi121.stdout: 2019-12-09T09:44:13.111 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2019-12-09T09:44:13.111 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 5 tests from 1 test suite ran. (24362 ms total) 2019-12-09T09:44:13.111 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 5 tests. 2019-12-09T09:44:13.113 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-09T09:44:13.113 INFO:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-09T09:44:13.182 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2019-12-09T09:44:13.182 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2019-12-09T09:44:13.183 INFO:teuthology.orchestra.run.smithi121:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1351c819e1a9518cde4c8b12d645782009028360 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2019-12-09T09:44:13.236 INFO:tasks.workunit.client.0.smithi121.stdout:Running main() from gmock_main.cc 2019-12-09T09:44:13.236 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 13 tests from 1 test suite. 2019-12-09T09:44:13.237 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2019-12-09T09:44:13.237 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 13 tests from cls_rgw 2019-12-09T09:44:15.286 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.index_basic 2019-12-09T09:44:16.923 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.index_basic (1637 ms) 2019-12-09T09:44:16.924 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2019-12-09T09:44:18.187 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (1263 ms) 2019-12-09T09:44:18.187 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.index_remove_object 2019-12-09T09:44:20.037 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.index_remove_object (1851 ms) 2019-12-09T09:44:20.038 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.index_suggest 2019-12-09T09:44:45.258 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.index_suggest (25221 ms) 2019-12-09T09:44:45.259 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.index_list 2019-12-09T09:44:46.348 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.index_list (1090 ms) 2019-12-09T09:44:46.348 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.bi_list 2019-12-09T09:44:49.229 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.bi_list (2881 ms) 2019-12-09T09:44:49.230 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.gc_set 2019-12-09T09:44:49.732 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.gc_set (503 ms) 2019-12-09T09:44:49.732 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.gc_list 2019-12-09T09:44:50.259 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.gc_list (527 ms) 2019-12-09T09:44:50.260 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.gc_defer 2019-12-09T09:44:57.978 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.gc_defer (7718 ms) 2019-12-09T09:44:57.978 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.usage_basic 2019-12-09T09:45:06.022 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.usage_basic (8043 ms) 2019-12-09T09:45:06.022 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2019-12-09T09:45:06.057 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.usage_clear_no_obj (36 ms) 2019-12-09T09:45:06.058 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.usage_clear 2019-12-09T09:45:13.628 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.usage_clear (7570 ms) 2019-12-09T09:45:13.628 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] cls_rgw.bi_log_trim 2019-12-09T09:45:15.827 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] cls_rgw.bi_log_trim (2200 ms) 2019-12-09T09:45:16.441 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 13 tests from cls_rgw (60541 ms total) 2019-12-09T09:45:16.442 INFO:tasks.workunit.client.0.smithi121.stdout: 2019-12-09T09:45:16.442 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2019-12-09T09:45:16.442 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 13 tests from 1 test suite ran. (63206 ms total) 2019-12-09T09:45:16.442 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 13 tests. 2019-12-09T09:45:16.444 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-09T09:45:16.444 INFO:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-09T09:45:16.511 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2019-12-09T09:45:16.511 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2019-12-09T09:45:16.512 INFO:teuthology.orchestra.run.smithi121:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1351c819e1a9518cde4c8b12d645782009028360 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2019-12-09T09:45:16.574 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] Running 6 tests from 1 test suite. 2019-12-09T09:45:16.574 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment set-up. 2019-12-09T09:45:18.782 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 6 tests from rgw_gc_log 2019-12-09T09:45:18.783 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2019-12-09T09:45:19.298 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] rgw_gc_log.init_existing_queue (516 ms) 2019-12-09T09:45:19.298 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2019-12-09T09:45:19.426 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] rgw_gc_log.init_existing_omap (128 ms) 2019-12-09T09:45:19.426 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2019-12-09T09:45:19.533 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (107 ms) 2019-12-09T09:45:19.533 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2019-12-09T09:45:19.590 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (57 ms) 2019-12-09T09:45:19.590 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2019-12-09T09:45:19.716 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] rgw_gc_log.defer1_after_init (126 ms) 2019-12-09T09:45:19.717 INFO:tasks.workunit.client.0.smithi121.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2019-12-09T09:45:20.036 INFO:tasks.workunit.client.0.smithi121.stdout:[ OK ] rgw_gc_log.defer2_before_init (320 ms) 2019-12-09T09:45:20.037 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] 6 tests from rgw_gc_log (1255 ms total) 2019-12-09T09:45:20.037 INFO:tasks.workunit.client.0.smithi121.stdout: 2019-12-09T09:45:20.037 INFO:tasks.workunit.client.0.smithi121.stdout:[----------] Global test environment tear-down 2019-12-09T09:45:21.078 INFO:tasks.workunit.client.0.smithi121.stdout:[==========] 6 tests from 1 test suite ran. (4504 ms total) 2019-12-09T09:45:21.078 INFO:tasks.workunit.client.0.smithi121.stdout:[ PASSED ] 6 tests. 2019-12-09T09:45:21.081 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-09T09:45:21.081 INFO:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-09T09:45:21.151 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh'] on client.0... 2019-12-09T09:45:21.151 INFO:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2019-12-09T09:45:21.407 DEBUG:teuthology.parallel:result is None 2019-12-09T09:45:21.407 INFO:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2019-12-09T09:45:21.463 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2019-12-09T09:45:21.463 INFO:teuthology.orchestra.run.smithi121:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-12-09T09:45:21.509 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2019-12-09T09:45:21.510 INFO:teuthology.run_tasks:Running task ragweed... 2019-12-09T09:45:21.524 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}} 2019-12-09T09:45:21.525 INFO:tasks.ragweed:Downloading ragweed... 2019-12-09T09:45:21.525 INFO:tasks.ragweed:Using branch 'wip-ofriedma-dynamic-disable' for ragweed 2019-12-09T09:45:21.525 INFO:teuthology.orchestra.run.smithi121:> git clone -b wip-ofriedma-dynamic-disable git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-12-09T09:45:21.576 INFO:teuthology.orchestra.run.smithi121.stderr:fatal: Remote branch wip-ofriedma-dynamic-disable not found in upstream origin 2019-12-09T09:45:21.577 INFO:teuthology.orchestra.run.smithi121.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-12-09T09:45:21.577 DEBUG:teuthology.orchestra.run:got remote process result: 128 2019-12-09T09:45:21.578 INFO:teuthology.orchestra.run.smithi121:> git clone -b ceph-master git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-12-09T09:45:21.667 INFO:teuthology.orchestra.run.smithi121.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-12-09T09:45:21.777 INFO:tasks.ragweed:Creating rgw users... 2019-12-09T09:45:21.778 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2019-12-09T09:45:21.778 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key HSMFTDOVUQKUTGRNUZBT --secret jWlH8rl/oZT7ag1+tG2VsB7K3vMEOxP2mNh8apFbuSoL9wNP7kkgIg== --email sysuser.client.0+test@test.test --system true 2019-12-09T09:45:21.922 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:21.925+0000 7f076162aec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:21.958 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:21.961+0000 7f076162aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:45:21.958 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:21.961+0000 7f076162aec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:21.969 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:21.972+0000 7f076162aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:45:21.969 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:21.972+0000 7f076162aec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:21.979 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:21.982+0000 7f076162aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:45:21.979 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:21.982+0000 7f076162aec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:22.297 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:22.300+0000 7f076162aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:45:23.176 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.179+0000 7f076162aec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T09:45:23.176 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.179+0000 7f076162aec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T09:45:23.177 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.179+0000 7f076162aec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T09:45:23.177 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.179+0000 7f076162aec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T09:45:23.177 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.179+0000 7f076162aec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:23.188 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.190+0000 7f076162aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:45:23.188 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.190+0000 7f076162aec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:23.201 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.204+0000 7f076162aec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T09:45:23.201 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.204+0000 7f076162aec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:23.220 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.223+0000 7f076162aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:45:23.221 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.223+0000 7f076162aec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:23.237 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.240+0000 7f076162aec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T09:45:23.237 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.240+0000 7f076162aec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:23.244 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.247+0000 7f076162aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:45:23.244 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.247+0000 7f076162aec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T09:45:23.244 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.247+0000 7f076162aec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:23.249 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.252+0000 7f076162aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:45:23.249 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.252+0000 7f076162aec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:23.257 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.260+0000 7f076162aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:45:23.258 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.260+0000 7f076162aec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:23.266 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.269+0000 7f076162aec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T09:45:23.266 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.269+0000 7f076162aec0 20 zonegroup default 2019-12-09T09:45:23.266 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.269+0000 7f076162aec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:23.274 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.277+0000 7f076162aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:45:23.274 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.277+0000 7f076162aec0 10 Cannot find current period zone using local zone 2019-12-09T09:45:23.274 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.277+0000 7f076162aec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:23.279 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.282+0000 7f076162aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:45:23.279 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.282+0000 7f076162aec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:23.294 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.297+0000 7f076162aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:45:23.294 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.297+0000 7f076162aec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:23.305 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.308+0000 7f076162aec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T09:45:23.305 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.308+0000 7f076162aec0 20 zone default found 2019-12-09T09:45:23.305 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.308+0000 7f076162aec0 20 started sync module instance, tier type = 2019-12-09T09:45:23.306 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.308+0000 7f076162aec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T09:45:23.617 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.619+0000 7f076162aec0 20 add_watcher() i=0 2019-12-09T09:45:23.617 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.619+0000 7f076162aec0 20 add_watcher() i=1 2019-12-09T09:45:23.617 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.619+0000 7f076162aec0 20 add_watcher() i=2 2019-12-09T09:45:23.617 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.619+0000 7f076162aec0 20 add_watcher() i=3 2019-12-09T09:45:23.617 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.619+0000 7f076162aec0 20 add_watcher() i=4 2019-12-09T09:45:23.618 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.619+0000 7f076162aec0 20 add_watcher() i=5 2019-12-09T09:45:23.618 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.619+0000 7f076162aec0 20 add_watcher() i=6 2019-12-09T09:45:23.646 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.648+0000 7f076162aec0 20 add_watcher() i=7 2019-12-09T09:45:23.646 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.648+0000 7f076162aec0 2 all 8 watchers are set, enabling cache 2019-12-09T09:45:23.646 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.649+0000 7f071f7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T09:45:23.653 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.656+0000 7f074e854700 0 -- 172.21.15.121:0/3884897576 >> v2:172.21.15.132:3300/0 conn(0x55587cb9f570 msgr2=0x55587cba5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T09:45:23.692 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:23.695+0000 7f074e854700 0 -- 172.21.15.121:0/208247810 >> [v2:172.21.15.132:6800/8843,v1:172.21.15.132:6801/8843] conn(0x7f0690022490 msgr2=0x7f0690024960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T09:45:25.095 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.098+0000 7f068dffb700 20 reqs_thread_entry: start 2019-12-09T09:45:25.096 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.099+0000 7f06877fe700 20 reqs_thread_entry: start 2019-12-09T09:45:25.096 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.099+0000 7f076162aec0 20 init_complete bucket index max shards: 0 2019-12-09T09:45:25.097 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.100+0000 7f0685ffb700 20 reqs_thread_entry: start 2019-12-09T09:45:25.097 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.100+0000 7f076162aec0 20 get_system_obj_state: rctx=0x7ffc4ef3eea8 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x55587cc20db0 s->prefetch_data=0 2019-12-09T09:45:25.098 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.100+0000 7f076162aec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-12-09T09:45:25.118 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.121+0000 7f076162aec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2019-12-09T09:45:25.119 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.121+0000 7f076162aec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-09T09:45:25.119 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.121+0000 7f076162aec0 20 get_system_obj_state: rctx=0x7ffc4ef3eeb8 obj=default.rgw.meta:users.email:sysuser.client.0+test@test.test state=0x55587cc22b40 s->prefetch_data=0 2019-12-09T09:45:25.119 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.121+0000 7f076162aec0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2019-12-09T09:45:25.131 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.134+0000 7f076162aec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2019-12-09T09:45:25.131 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.134+0000 7f076162aec0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-12-09T09:45:25.131 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.134+0000 7f076162aec0 20 get_system_obj_state: rctx=0x7ffc4ef3eeb8 obj=default.rgw.meta:users.keys:HSMFTDOVUQKUTGRNUZBT state=0x55587cc22b40 s->prefetch_data=0 2019-12-09T09:45:25.131 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.134+0000 7f076162aec0 10 cache get: name=default.rgw.meta+users.keys+HSMFTDOVUQKUTGRNUZBT : miss 2019-12-09T09:45:25.148 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.149+0000 7f076162aec0 10 cache put: name=default.rgw.meta+users.keys+HSMFTDOVUQKUTGRNUZBT info.flags=0x0 2019-12-09T09:45:25.148 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.149+0000 7f076162aec0 10 adding default.rgw.meta+users.keys+HSMFTDOVUQKUTGRNUZBT to cache LRU end 2019-12-09T09:45:25.148 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.149+0000 7f076162aec0 20 get_system_obj_state: rctx=0x7ffc4ef3eac8 obj=default.rgw.meta:users.keys:HSMFTDOVUQKUTGRNUZBT state=0x55587cc22b40 s->prefetch_data=0 2019-12-09T09:45:25.148 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.149+0000 7f076162aec0 10 cache get: name=default.rgw.meta+users.keys+HSMFTDOVUQKUTGRNUZBT : type miss (requested=0x6, cached=0x0) 2019-12-09T09:45:25.156 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.159+0000 7f076162aec0 10 cache put: name=default.rgw.meta+users.keys+HSMFTDOVUQKUTGRNUZBT info.flags=0x0 2019-12-09T09:45:25.156 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.159+0000 7f076162aec0 10 moving default.rgw.meta+users.keys+HSMFTDOVUQKUTGRNUZBT to cache LRU end 2019-12-09T09:45:25.156 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.159+0000 7f076162aec0 20 get_system_obj_state: rctx=0x7ffc4ef3ec48 obj=default.rgw.meta:users.keys:HSMFTDOVUQKUTGRNUZBT state=0x55587cc22b40 s->prefetch_data=0 2019-12-09T09:45:25.156 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.159+0000 7f076162aec0 10 cache get: name=default.rgw.meta+users.keys+HSMFTDOVUQKUTGRNUZBT : type miss (requested=0x6, cached=0x0) 2019-12-09T09:45:25.164 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.167+0000 7f076162aec0 10 cache put: name=default.rgw.meta+users.keys+HSMFTDOVUQKUTGRNUZBT info.flags=0x0 2019-12-09T09:45:25.165 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.167+0000 7f076162aec0 10 moving default.rgw.meta+users.keys+HSMFTDOVUQKUTGRNUZBT to cache LRU end 2019-12-09T09:45:25.231 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.233+0000 7f076162aec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-12-09T09:45:25.231 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.233+0000 7f076162aec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-09T09:45:25.231 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.233+0000 7f076162aec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=637 2019-12-09T09:45:25.306 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.309+0000 7f072ffff700 10 RGWWatcher::handle_notify() notify_id 532575944704 cookie 93838537983088 notifier 4689 bl.length()=637 2019-12-09T09:45:25.306 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.309+0000 7f072ffff700 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-12-09T09:45:25.306 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.309+0000 7f072ffff700 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-09T09:45:25.421 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.424+0000 7f076162aec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-12-09T09:45:25.421 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.424+0000 7f076162aec0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-12-09T09:45:25.421 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.424+0000 7f076162aec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=202 2019-12-09T09:45:25.433 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.435+0000 7f072ffff700 10 RGWWatcher::handle_notify() notify_id 532575944705 cookie 93838537986912 notifier 4689 bl.length()=202 2019-12-09T09:45:25.433 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.435+0000 7f072ffff700 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-12-09T09:45:25.433 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.435+0000 7f072ffff700 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-12-09T09:45:25.633 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.636+0000 7f076162aec0 10 cache put: name=default.rgw.meta+users.keys+HSMFTDOVUQKUTGRNUZBT info.flags=0x7 2019-12-09T09:45:25.633 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.636+0000 7f076162aec0 10 moving default.rgw.meta+users.keys+HSMFTDOVUQKUTGRNUZBT to cache LRU end 2019-12-09T09:45:25.633 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.636+0000 7f076162aec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=190 2019-12-09T09:45:25.641 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.644+0000 7f072ffff700 10 RGWWatcher::handle_notify() notify_id 532575944706 cookie 93838537986912 notifier 4689 bl.length()=190 2019-12-09T09:45:25.641 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.644+0000 7f072ffff700 10 cache put: name=default.rgw.meta+users.keys+HSMFTDOVUQKUTGRNUZBT info.flags=0x7 2019-12-09T09:45:25.642 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.644+0000 7f072ffff700 10 moving default.rgw.meta+users.keys+HSMFTDOVUQKUTGRNUZBT to cache LRU end 2019-12-09T09:45:25.807 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2019-12-09T09:45:25.807 INFO:teuthology.orchestra.run.smithi121.stdout: "user_id": "sysuser.client.0", 2019-12-09T09:45:25.807 INFO:teuthology.orchestra.run.smithi121.stdout: "display_name": "Mr. sysuser.client.0", 2019-12-09T09:45:25.808 INFO:teuthology.orchestra.run.smithi121.stdout: "email": "sysuser.client.0+test@test.test", 2019-12-09T09:45:25.808 INFO:teuthology.orchestra.run.smithi121.stdout: "suspended": 0, 2019-12-09T09:45:25.808 INFO:teuthology.orchestra.run.smithi121.stdout: "max_buckets": 1000, 2019-12-09T09:45:25.808 INFO:teuthology.orchestra.run.smithi121.stdout: "subusers": [], 2019-12-09T09:45:25.808 INFO:teuthology.orchestra.run.smithi121.stdout: "keys": [ 2019-12-09T09:45:25.809 INFO:teuthology.orchestra.run.smithi121.stdout: { 2019-12-09T09:45:25.809 INFO:teuthology.orchestra.run.smithi121.stdout: "user": "sysuser.client.0", 2019-12-09T09:45:25.809 INFO:teuthology.orchestra.run.smithi121.stdout: "access_key": "HSMFTDOVUQKUTGRNUZBT", 2019-12-09T09:45:25.809 INFO:teuthology.orchestra.run.smithi121.stdout: "secret_key": "jWlH8rl/oZT7ag1+tG2VsB7K3vMEOxP2mNh8apFbuSoL9wNP7kkgIg==" 2019-12-09T09:45:25.809 INFO:teuthology.orchestra.run.smithi121.stdout: } 2019-12-09T09:45:25.809 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2019-12-09T09:45:25.810 INFO:teuthology.orchestra.run.smithi121.stdout: "swift_keys": [], 2019-12-09T09:45:25.810 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": [], 2019-12-09T09:45:25.810 INFO:teuthology.orchestra.run.smithi121.stdout: "op_mask": "read, write, delete", 2019-12-09T09:45:25.810 INFO:teuthology.orchestra.run.smithi121.stdout: "system": "true", 2019-12-09T09:45:25.810 INFO:teuthology.orchestra.run.smithi121.stdout: "default_placement": "", 2019-12-09T09:45:25.811 INFO:teuthology.orchestra.run.smithi121.stdout: "default_storage_class": "", 2019-12-09T09:45:25.811 INFO:teuthology.orchestra.run.smithi121.stdout: "placement_tags": [], 2019-12-09T09:45:25.811 INFO:teuthology.orchestra.run.smithi121.stdout: "bucket_quota": { 2019-12-09T09:45:25.811 INFO:teuthology.orchestra.run.smithi121.stdout: "enabled": false, 2019-12-09T09:45:25.811 INFO:teuthology.orchestra.run.smithi121.stdout: "check_on_raw": false, 2019-12-09T09:45:25.811 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size": -1, 2019-12-09T09:45:25.812 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size_kb": 0, 2019-12-09T09:45:25.812 INFO:teuthology.orchestra.run.smithi121.stdout: "max_objects": -1 2019-12-09T09:45:25.812 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2019-12-09T09:45:25.812 INFO:teuthology.orchestra.run.smithi121.stdout: "user_quota": { 2019-12-09T09:45:25.812 INFO:teuthology.orchestra.run.smithi121.stdout: "enabled": false, 2019-12-09T09:45:25.812 INFO:teuthology.orchestra.run.smithi121.stdout: "check_on_raw": false, 2019-12-09T09:45:25.813 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size": -1, 2019-12-09T09:45:25.813 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size_kb": 0, 2019-12-09T09:45:25.813 INFO:teuthology.orchestra.run.smithi121.stdout: "max_objects": -1 2019-12-09T09:45:25.813 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2019-12-09T09:45:25.813 INFO:teuthology.orchestra.run.smithi121.stdout: "temp_url_keys": [], 2019-12-09T09:45:25.813 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "rgw", 2019-12-09T09:45:25.814 INFO:teuthology.orchestra.run.smithi121.stdout: "mfa_ids": [] 2019-12-09T09:45:25.814 INFO:teuthology.orchestra.run.smithi121.stdout:} 2019-12-09T09:45:25.814 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:45:25.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.874+0000 7f076162aec0 20 remove_watcher() i=0 2019-12-09T09:45:25.872 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.874+0000 7f076162aec0 2 removed watcher, disabling cache 2019-12-09T09:45:25.940 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:25.943+0000 7f076162aec0 20 remove_watcher() i=1 2019-12-09T09:45:26.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.007+0000 7f076162aec0 20 remove_watcher() i=2 2019-12-09T09:45:26.063 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.066+0000 7f076162aec0 20 remove_watcher() i=3 2019-12-09T09:45:26.120 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.123+0000 7f076162aec0 20 remove_watcher() i=4 2019-12-09T09:45:26.174 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.177+0000 7f076162aec0 20 remove_watcher() i=5 2019-12-09T09:45:26.231 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.234+0000 7f076162aec0 20 remove_watcher() i=6 2019-12-09T09:45:26.286 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.289+0000 7f076162aec0 20 remove_watcher() i=7 2019-12-09T09:45:26.295 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2019-12-09T09:45:26.295 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key ZMTZVZSPMALOUKDPIJOA --secret vt30evrnzjBdncNx1mU1uDTOD6ZLQaw7vdU3UR7fvTB0a0kkUaSpvw== --email ragweed.client.0+test@test.test --system false 2019-12-09T09:45:26.448 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.451+0000 7fadb94a7ec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:26.482 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.485+0000 7fadb94a7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:45:26.482 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.485+0000 7fadb94a7ec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:26.494 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.497+0000 7fadb94a7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:45:26.494 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.497+0000 7fadb94a7ec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:26.500 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.503+0000 7fadb94a7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:45:26.501 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.503+0000 7fadb94a7ec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:26.522 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.525+0000 7fadb94a7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:45:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.759+0000 7fadb94a7ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T09:45:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.759+0000 7fadb94a7ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T09:45:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.759+0000 7fadb94a7ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T09:45:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.759+0000 7fadb94a7ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T09:45:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.759+0000 7fadb94a7ec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:26.769 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.772+0000 7fadb94a7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:45:26.769 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.772+0000 7fadb94a7ec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:26.783 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.786+0000 7fadb94a7ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T09:45:26.784 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.786+0000 7fadb94a7ec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:26.801 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.804+0000 7fadb94a7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:45:26.801 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.804+0000 7fadb94a7ec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:26.813 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.816+0000 7fadb94a7ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T09:45:26.813 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.816+0000 7fadb94a7ec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:26.820 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.823+0000 7fadb94a7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:45:26.820 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.823+0000 7fadb94a7ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T09:45:26.821 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.823+0000 7fadb94a7ec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:26.836 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.839+0000 7fadb94a7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:45:26.836 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.839+0000 7fadb94a7ec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:26.851 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.854+0000 7fadb94a7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:45:26.852 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.854+0000 7fadb94a7ec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:26.863 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.866+0000 7fadb94a7ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T09:45:26.863 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.866+0000 7fadb94a7ec0 20 zonegroup default 2019-12-09T09:45:26.864 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.866+0000 7fadb94a7ec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:26.870 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.873+0000 7fadb94a7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:45:26.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.873+0000 7fadb94a7ec0 10 Cannot find current period zone using local zone 2019-12-09T09:45:26.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.873+0000 7fadb94a7ec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:26.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.882+0000 7fadb94a7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T09:45:26.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.882+0000 7fadb94a7ec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:26.905 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.908+0000 7fadb94a7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T09:45:26.905 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.908+0000 7fadb94a7ec0 20 rados->read ofs=0 len=0 2019-12-09T09:45:26.919 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.922+0000 7fadb94a7ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T09:45:26.920 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.922+0000 7fadb94a7ec0 20 zone default found 2019-12-09T09:45:26.920 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.922+0000 7fadb94a7ec0 20 started sync module instance, tier type = 2019-12-09T09:45:26.920 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:26.922+0000 7fadb94a7ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T09:45:27.246 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:27.248+0000 7fadb94a7ec0 20 add_watcher() i=0 2019-12-09T09:45:27.246 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:27.248+0000 7fadb94a7ec0 20 add_watcher() i=1 2019-12-09T09:45:27.246 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:27.248+0000 7fadb94a7ec0 20 add_watcher() i=2 2019-12-09T09:45:27.246 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:27.249+0000 7fadb94a7ec0 20 add_watcher() i=3 2019-12-09T09:45:27.247 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:27.249+0000 7fadb94a7ec0 20 add_watcher() i=4 2019-12-09T09:45:27.247 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:27.249+0000 7fadb94a7ec0 20 add_watcher() i=5 2019-12-09T09:45:27.247 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:27.249+0000 7fadb94a7ec0 20 add_watcher() i=6 2019-12-09T09:45:27.281 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:27.283+0000 7fadb94a7ec0 20 add_watcher() i=7 2019-12-09T09:45:27.281 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:27.284+0000 7fadb94a7ec0 2 all 8 watchers are set, enabling cache 2019-12-09T09:45:27.281 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:27.284+0000 7fad76fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T09:45:27.282 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:27.284+0000 7fada6ed2700 0 -- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55e6ef171650 msgr2=0x55e6ef174920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T09:45:27.319 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:27.322+0000 7fada66d1700 0 -- 172.21.15.121:0/2613741436 >> [v2:172.21.15.132:6800/8843,v1:172.21.15.132:6801/8843] conn(0x7face8022480 msgr2=0x7face8024990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T09:45:28.825 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.828+0000 7face57fa700 20 reqs_thread_entry: start 2019-12-09T09:45:28.825 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.828+0000 7facdeffd700 20 reqs_thread_entry: start 2019-12-09T09:45:28.825 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.828+0000 7fadb94a7ec0 20 init_complete bucket index max shards: 0 2019-12-09T09:45:28.826 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.829+0000 7facdd7fa700 20 reqs_thread_entry: start 2019-12-09T09:45:28.826 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.829+0000 7fadb94a7ec0 20 get_system_obj_state: rctx=0x7fff9ac9d398 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x55e6ef1f0580 s->prefetch_data=0 2019-12-09T09:45:28.826 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.829+0000 7fadb94a7ec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-12-09T09:45:28.835 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.838+0000 7fadb94a7ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2019-12-09T09:45:28.836 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.838+0000 7fadb94a7ec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-09T09:45:28.836 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.838+0000 7fadb94a7ec0 20 get_system_obj_state: rctx=0x7fff9ac9d3a8 obj=default.rgw.meta:users.email:ragweed.client.0+test@test.test state=0x55e6ef1f2310 s->prefetch_data=0 2019-12-09T09:45:28.836 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.838+0000 7fadb94a7ec0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2019-12-09T09:45:28.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.850+0000 7fadb94a7ec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2019-12-09T09:45:28.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.850+0000 7fadb94a7ec0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-12-09T09:45:28.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.850+0000 7fadb94a7ec0 20 get_system_obj_state: rctx=0x7fff9ac9d3a8 obj=default.rgw.meta:users.keys:ZMTZVZSPMALOUKDPIJOA state=0x55e6ef1f2310 s->prefetch_data=0 2019-12-09T09:45:28.848 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.850+0000 7fadb94a7ec0 10 cache get: name=default.rgw.meta+users.keys+ZMTZVZSPMALOUKDPIJOA : miss 2019-12-09T09:45:28.859 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.862+0000 7fadb94a7ec0 10 cache put: name=default.rgw.meta+users.keys+ZMTZVZSPMALOUKDPIJOA info.flags=0x0 2019-12-09T09:45:28.860 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.862+0000 7fadb94a7ec0 10 adding default.rgw.meta+users.keys+ZMTZVZSPMALOUKDPIJOA to cache LRU end 2019-12-09T09:45:28.860 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.862+0000 7fadb94a7ec0 20 get_system_obj_state: rctx=0x7fff9ac9cfb8 obj=default.rgw.meta:users.keys:ZMTZVZSPMALOUKDPIJOA state=0x55e6ef1f2310 s->prefetch_data=0 2019-12-09T09:45:28.860 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.862+0000 7fadb94a7ec0 10 cache get: name=default.rgw.meta+users.keys+ZMTZVZSPMALOUKDPIJOA : type miss (requested=0x6, cached=0x0) 2019-12-09T09:45:28.886 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.888+0000 7fadb94a7ec0 10 cache put: name=default.rgw.meta+users.keys+ZMTZVZSPMALOUKDPIJOA info.flags=0x0 2019-12-09T09:45:28.886 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.888+0000 7fadb94a7ec0 10 moving default.rgw.meta+users.keys+ZMTZVZSPMALOUKDPIJOA to cache LRU end 2019-12-09T09:45:28.886 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.889+0000 7fadb94a7ec0 20 get_system_obj_state: rctx=0x7fff9ac9d138 obj=default.rgw.meta:users.keys:ZMTZVZSPMALOUKDPIJOA state=0x55e6ef1f2310 s->prefetch_data=0 2019-12-09T09:45:28.886 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.889+0000 7fadb94a7ec0 10 cache get: name=default.rgw.meta+users.keys+ZMTZVZSPMALOUKDPIJOA : type miss (requested=0x6, cached=0x0) 2019-12-09T09:45:28.901 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.904+0000 7fadb94a7ec0 10 cache put: name=default.rgw.meta+users.keys+ZMTZVZSPMALOUKDPIJOA info.flags=0x0 2019-12-09T09:45:28.901 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.904+0000 7fadb94a7ec0 10 moving default.rgw.meta+users.keys+ZMTZVZSPMALOUKDPIJOA to cache LRU end 2019-12-09T09:45:28.973 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.976+0000 7fadb94a7ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-12-09T09:45:28.973 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.976+0000 7fadb94a7ec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-09T09:45:28.973 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.976+0000 7fadb94a7ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=637 2019-12-09T09:45:28.987 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.990+0000 7fad877fe700 10 RGWWatcher::handle_notify() notify_id 532575944707 cookie 94450342048256 notifier 4710 bl.length()=637 2019-12-09T09:45:28.987 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.990+0000 7fad877fe700 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-12-09T09:45:28.987 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:28.990+0000 7fad877fe700 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-09T09:45:29.282 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:29.285+0000 7fadb94a7ec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-12-09T09:45:29.282 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:29.285+0000 7fadb94a7ec0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-12-09T09:45:29.283 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:29.285+0000 7fadb94a7ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=202 2019-12-09T09:45:29.295 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:29.298+0000 7fad877fe700 10 RGWWatcher::handle_notify() notify_id 532575944708 cookie 94450342044432 notifier 4710 bl.length()=202 2019-12-09T09:45:29.296 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:29.298+0000 7fad877fe700 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-12-09T09:45:29.296 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:29.298+0000 7fad877fe700 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-12-09T09:45:29.677 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:29.680+0000 7fadb94a7ec0 10 cache put: name=default.rgw.meta+users.keys+ZMTZVZSPMALOUKDPIJOA info.flags=0x7 2019-12-09T09:45:29.677 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:29.680+0000 7fadb94a7ec0 10 moving default.rgw.meta+users.keys+ZMTZVZSPMALOUKDPIJOA to cache LRU end 2019-12-09T09:45:29.677 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:29.680+0000 7fadb94a7ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=190 2019-12-09T09:45:29.750 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:29.753+0000 7fad877fe700 10 RGWWatcher::handle_notify() notify_id 532575944704 cookie 94450342056112 notifier 4710 bl.length()=190 2019-12-09T09:45:29.750 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:29.753+0000 7fad877fe700 10 cache put: name=default.rgw.meta+users.keys+ZMTZVZSPMALOUKDPIJOA info.flags=0x7 2019-12-09T09:45:29.750 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:29.753+0000 7fad877fe700 10 moving default.rgw.meta+users.keys+ZMTZVZSPMALOUKDPIJOA to cache LRU end 2019-12-09T09:45:30.221 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2019-12-09T09:45:30.222 INFO:teuthology.orchestra.run.smithi121.stdout: "user_id": "ragweed.client.0", 2019-12-09T09:45:30.222 INFO:teuthology.orchestra.run.smithi121.stdout: "display_name": "Mr. ragweed.client.0", 2019-12-09T09:45:30.222 INFO:teuthology.orchestra.run.smithi121.stdout: "email": "ragweed.client.0+test@test.test", 2019-12-09T09:45:30.222 INFO:teuthology.orchestra.run.smithi121.stdout: "suspended": 0, 2019-12-09T09:45:30.222 INFO:teuthology.orchestra.run.smithi121.stdout: "max_buckets": 1000, 2019-12-09T09:45:30.222 INFO:teuthology.orchestra.run.smithi121.stdout: "subusers": [], 2019-12-09T09:45:30.222 INFO:teuthology.orchestra.run.smithi121.stdout: "keys": [ 2019-12-09T09:45:30.223 INFO:teuthology.orchestra.run.smithi121.stdout: { 2019-12-09T09:45:30.223 INFO:teuthology.orchestra.run.smithi121.stdout: "user": "ragweed.client.0", 2019-12-09T09:45:30.223 INFO:teuthology.orchestra.run.smithi121.stdout: "access_key": "ZMTZVZSPMALOUKDPIJOA", 2019-12-09T09:45:30.223 INFO:teuthology.orchestra.run.smithi121.stdout: "secret_key": "vt30evrnzjBdncNx1mU1uDTOD6ZLQaw7vdU3UR7fvTB0a0kkUaSpvw==" 2019-12-09T09:45:30.223 INFO:teuthology.orchestra.run.smithi121.stdout: } 2019-12-09T09:45:30.223 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2019-12-09T09:45:30.223 INFO:teuthology.orchestra.run.smithi121.stdout: "swift_keys": [], 2019-12-09T09:45:30.224 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": [], 2019-12-09T09:45:30.224 INFO:teuthology.orchestra.run.smithi121.stdout: "op_mask": "read, write, delete", 2019-12-09T09:45:30.224 INFO:teuthology.orchestra.run.smithi121.stdout: "system": "true", 2019-12-09T09:45:30.224 INFO:teuthology.orchestra.run.smithi121.stdout: "default_placement": "", 2019-12-09T09:45:30.224 INFO:teuthology.orchestra.run.smithi121.stdout: "default_storage_class": "", 2019-12-09T09:45:30.224 INFO:teuthology.orchestra.run.smithi121.stdout: "placement_tags": [], 2019-12-09T09:45:30.225 INFO:teuthology.orchestra.run.smithi121.stdout: "bucket_quota": { 2019-12-09T09:45:30.225 INFO:teuthology.orchestra.run.smithi121.stdout: "enabled": false, 2019-12-09T09:45:30.225 INFO:teuthology.orchestra.run.smithi121.stdout: "check_on_raw": false, 2019-12-09T09:45:30.225 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size": -1, 2019-12-09T09:45:30.225 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size_kb": 0, 2019-12-09T09:45:30.225 INFO:teuthology.orchestra.run.smithi121.stdout: "max_objects": -1 2019-12-09T09:45:30.225 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2019-12-09T09:45:30.225 INFO:teuthology.orchestra.run.smithi121.stdout: "user_quota": { 2019-12-09T09:45:30.226 INFO:teuthology.orchestra.run.smithi121.stdout: "enabled": false, 2019-12-09T09:45:30.226 INFO:teuthology.orchestra.run.smithi121.stdout: "check_on_raw": false, 2019-12-09T09:45:30.226 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size": -1, 2019-12-09T09:45:30.226 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size_kb": 0, 2019-12-09T09:45:30.226 INFO:teuthology.orchestra.run.smithi121.stdout: "max_objects": -1 2019-12-09T09:45:30.226 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2019-12-09T09:45:30.226 INFO:teuthology.orchestra.run.smithi121.stdout: "temp_url_keys": [], 2019-12-09T09:45:30.227 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "rgw", 2019-12-09T09:45:30.227 INFO:teuthology.orchestra.run.smithi121.stdout: "mfa_ids": [] 2019-12-09T09:45:30.227 INFO:teuthology.orchestra.run.smithi121.stdout:} 2019-12-09T09:45:30.227 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:45:30.291 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:30.294+0000 7fadb94a7ec0 20 remove_watcher() i=0 2019-12-09T09:45:30.291 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:30.294+0000 7fadb94a7ec0 2 removed watcher, disabling cache 2019-12-09T09:45:30.356 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:30.359+0000 7fadb94a7ec0 20 remove_watcher() i=1 2019-12-09T09:45:30.416 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:30.419+0000 7fadb94a7ec0 20 remove_watcher() i=2 2019-12-09T09:45:30.480 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:30.483+0000 7fadb94a7ec0 20 remove_watcher() i=3 2019-12-09T09:45:30.550 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:30.553+0000 7fadb94a7ec0 20 remove_watcher() i=4 2019-12-09T09:45:30.606 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:30.609+0000 7fadb94a7ec0 20 remove_watcher() i=5 2019-12-09T09:45:30.668 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:30.670+0000 7fadb94a7ec0 20 remove_watcher() i=6 2019-12-09T09:45:30.709 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T09:45:30.712+0000 7fadb94a7ec0 20 remove_watcher() i=7 2019-12-09T09:45:30.717 INFO:tasks.ragweed:Configuring ragweed... 2019-12-09T09:45:30.718 INFO:teuthology.orchestra.run.smithi121:> cd /home/ubuntu/cephtest/ragweed && ./bootstrap 2019-12-09T09:45:37.158 INFO:teuthology.orchestra.run.smithi121.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-12-09T09:45:37.263 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T09:45:37.300 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T09:45:37.301 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T09:45:37.301 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T09:45:37.302 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T09:45:37.302 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T09:45:37.927 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T09:45:38.277 INFO:teuthology.orchestra.run.smithi121.stdout:Package python2-pip-8.1.2-10.el7.noarch already installed and latest version 2019-12-09T09:45:39.422 INFO:teuthology.orchestra.run.smithi121.stdout:Resolving Dependencies 2019-12-09T09:45:39.423 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:45:39.423 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package libevent-devel.x86_64 0:2.0.21-4.el7 will be installed 2019-12-09T09:45:39.425 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 will be installed 2019-12-09T09:45:39.428 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: xz-devel for package: libxml2-devel-2.9.1-6.el7_2.3.x86_64 2019-12-09T09:45:39.463 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package libxslt-devel.x86_64 0:1.1.28-5.el7 will be installed 2019-12-09T09:45:39.463 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: libgcrypt-devel for package: libxslt-devel-1.1.28-5.el7.x86_64 2019-12-09T09:45:39.466 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed 2019-12-09T09:45:39.467 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:45:39.467 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package libgcrypt-devel.x86_64 0:1.5.3-14.el7 will be installed 2019-12-09T09:45:39.469 INFO:teuthology.orchestra.run.smithi121.stdout:--> Processing Dependency: libgpg-error-devel for package: libgcrypt-devel-1.5.3-14.el7.x86_64 2019-12-09T09:45:39.472 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package xz-devel.x86_64 0:5.2.2-1.el7 will be installed 2019-12-09T09:45:39.473 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T09:45:39.473 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package libgpg-error-devel.x86_64 0:1.12-3.el7 will be installed 2019-12-09T09:45:39.893 INFO:teuthology.orchestra.run.smithi121.stdout:--> Finished Dependency Resolution 2019-12-09T09:45:40.095 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:45:40.095 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies Resolved 2019-12-09T09:45:40.096 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:45:40.096 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:45:40.096 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2019-12-09T09:45:40.096 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:45:40.096 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2019-12-09T09:45:40.096 INFO:teuthology.orchestra.run.smithi121.stdout: libevent-devel x86_64 2.0.21-4.el7 base 85 k 2019-12-09T09:45:40.097 INFO:teuthology.orchestra.run.smithi121.stdout: libxml2-devel x86_64 2.9.1-6.el7_2.3 base 1.0 M 2019-12-09T09:45:40.097 INFO:teuthology.orchestra.run.smithi121.stdout: libxslt-devel x86_64 1.1.28-5.el7 base 309 k 2019-12-09T09:45:40.097 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel x86_64 1.2.7-18.el7 base 50 k 2019-12-09T09:45:40.097 INFO:teuthology.orchestra.run.smithi121.stdout:Installing for dependencies: 2019-12-09T09:45:40.097 INFO:teuthology.orchestra.run.smithi121.stdout: libgcrypt-devel x86_64 1.5.3-14.el7 base 129 k 2019-12-09T09:45:40.097 INFO:teuthology.orchestra.run.smithi121.stdout: libgpg-error-devel x86_64 1.12-3.el7 base 16 k 2019-12-09T09:45:40.097 INFO:teuthology.orchestra.run.smithi121.stdout: xz-devel x86_64 5.2.2-1.el7 base 46 k 2019-12-09T09:45:40.098 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:45:40.098 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2019-12-09T09:45:40.098 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T09:45:40.098 INFO:teuthology.orchestra.run.smithi121.stdout:Install 4 Packages (+3 Dependent packages) 2019-12-09T09:45:40.098 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:45:40.099 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 1.7 M 2019-12-09T09:45:40.099 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 12 M 2019-12-09T09:45:40.099 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading packages: 2019-12-09T09:45:40.380 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2019-12-09T09:45:40.380 INFO:teuthology.orchestra.run.smithi121.stdout:Total 5.9 MB/s | 1.7 MB 00:00 2019-12-09T09:45:40.388 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2019-12-09T09:45:40.402 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2019-12-09T09:45:40.459 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded 2019-12-09T09:45:40.459 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2019-12-09T09:45:41.079 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgpg-error-devel-1.12-3.el7.x86_64 1/7 2019-12-09T09:45:41.403 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgcrypt-devel-1.5.3-14.el7.x86_64 2/7 2019-12-09T09:45:41.665 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-12-09T09:45:42.210 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xz-devel-5.2.2-1.el7.x86_64 4/7 2019-12-09T09:45:42.687 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libxml2-devel-2.9.1-6.el7_2.3.x86_64 5/7 2019-12-09T09:45:43.039 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libxslt-devel-1.1.28-5.el7.x86_64 6/7 2019-12-09T09:45:43.329 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libevent-devel-2.0.21-4.el7.x86_64 7/7 2019-12-09T09:45:43.461 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xz-devel-5.2.2-1.el7.x86_64 1/7 2019-12-09T09:45:43.578 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libxml2-devel-2.9.1-6.el7_2.3.x86_64 2/7 2019-12-09T09:45:43.662 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-12-09T09:45:43.738 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libxslt-devel-1.1.28-5.el7.x86_64 4/7 2019-12-09T09:45:43.846 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgpg-error-devel-1.12-3.el7.x86_64 5/7 2019-12-09T09:45:43.964 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libevent-devel-2.0.21-4.el7.x86_64 6/7 2019-12-09T09:45:44.456 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgcrypt-devel-1.5.3-14.el7.x86_64 7/7 2019-12-09T09:45:44.456 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:45:44.456 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2019-12-09T09:45:44.457 INFO:teuthology.orchestra.run.smithi121.stdout: libevent-devel.x86_64 0:2.0.21-4.el7 libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 2019-12-09T09:45:44.457 INFO:teuthology.orchestra.run.smithi121.stdout: libxslt-devel.x86_64 0:1.1.28-5.el7 zlib-devel.x86_64 0:1.2.7-18.el7 2019-12-09T09:45:44.457 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:45:44.457 INFO:teuthology.orchestra.run.smithi121.stdout:Dependency Installed: 2019-12-09T09:45:44.457 INFO:teuthology.orchestra.run.smithi121.stdout: libgcrypt-devel.x86_64 0:1.5.3-14.el7 libgpg-error-devel.x86_64 0:1.12-3.el7 2019-12-09T09:45:44.457 INFO:teuthology.orchestra.run.smithi121.stdout: xz-devel.x86_64 0:5.2.2-1.el7 2019-12-09T09:45:44.458 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:45:44.458 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2019-12-09T09:45:44.677 INFO:teuthology.orchestra.run.smithi121.stdout:New python executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python 2019-12-09T09:45:46.076 INFO:teuthology.orchestra.run.smithi121.stdout:Installing setuptools, pip, wheel...done. 2019-12-09T09:45:46.656 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting pip 2019-12-09T09:45:46.771 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl (1.4MB) 2019-12-09T09:45:47.013 INFO:teuthology.orchestra.run.smithi121.stdout:Installing collected packages: pip 2019-12-09T09:45:47.013 INFO:teuthology.orchestra.run.smithi121.stdout: Found existing installation: pip 9.0.1 2019-12-09T09:45:47.076 INFO:teuthology.orchestra.run.smithi121.stdout: Uninstalling pip-9.0.1: 2019-12-09T09:45:47.120 INFO:teuthology.orchestra.run.smithi121.stdout: Successfully uninstalled pip-9.0.1 2019-12-09T09:45:47.705 INFO:teuthology.orchestra.run.smithi121.stdout:Successfully installed pip-19.3.1 2019-12-09T09:45:48.666 INFO:teuthology.orchestra.run.smithi121.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-09T09:45:48.744 INFO:teuthology.orchestra.run.smithi121.stdout:Requirement already satisfied: six in /usr/lib/python2.7/site-packages (1.9.0) 2019-12-09T09:45:49.679 INFO:teuthology.orchestra.run.smithi121.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-09T09:45:49.912 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting nose 2019-12-09T09:45:49.969 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl (154kB) 2019-12-09T09:45:50.108 INFO:teuthology.orchestra.run.smithi121.stdout:Installing collected packages: nose 2019-12-09T09:45:50.221 INFO:teuthology.orchestra.run.smithi121.stdout:Successfully installed nose-1.3.7 2019-12-09T09:45:50.827 INFO:teuthology.orchestra.run.smithi121.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-09T09:45:51.386 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting setuptools==32.3.1 2019-12-09T09:45:51.428 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl (479kB) 2019-12-09T09:45:51.608 INFO:teuthology.orchestra.run.smithi121.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-12-09T09:45:51.608 INFO:teuthology.orchestra.run.smithi121.stdout:Installing collected packages: setuptools 2019-12-09T09:45:51.608 INFO:teuthology.orchestra.run.smithi121.stdout: Found existing installation: setuptools 28.8.0 2019-12-09T09:45:51.627 INFO:teuthology.orchestra.run.smithi121.stdout: Uninstalling setuptools-28.8.0: 2019-12-09T09:45:51.639 INFO:teuthology.orchestra.run.smithi121.stdout: Successfully uninstalled setuptools-28.8.0 2019-12-09T09:45:51.776 INFO:teuthology.orchestra.run.smithi121.stdout:Successfully installed setuptools-32.3.1 2019-12-09T09:45:52.315 INFO:teuthology.orchestra.run.smithi121.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-09T09:45:52.669 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting PyYAML 2019-12-09T09:45:52.722 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/8d/c9/e5be955a117a1ac548cdd31e37e8fd7b02ce987f9655f5c7563c656d5dcb/PyYAML-5.2.tar.gz (265kB) 2019-12-09T09:45:53.343 INFO:teuthology.orchestra.run.smithi121.stdout:Requirement already up-to-date: nose>=1.0.0 in ./virtualenv/lib/python2.7/site-packages (from -r requirements.txt (line 2)) (1.3.7) 2019-12-09T09:45:53.462 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting boto!=2.46.0,>=2.6.0 2019-12-09T09:45:53.473 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl (1.4MB) 2019-12-09T09:45:53.728 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting bunch>=1.0.0 2019-12-09T09:45:53.738 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/ef/bf/a4cf1779a4ffb4f610903fa08e15d1f4a8a2f4e3353a02afbe097c5bf4a8/bunch-1.0.1.tar.gz 2019-12-09T09:45:54.384 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting gevent>=1.0 2019-12-09T09:45:54.401 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl (5.0MB) 2019-12-09T09:45:54.854 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting httplib2 2019-12-09T09:45:54.864 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/ce/2e/87461bfbb7e561203b759b3f7f639e2144226604372830d00a8279960ae1/httplib2-0.14.0.tar.gz (219kB) 2019-12-09T09:45:56.088 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting lxml 2019-12-09T09:45:56.104 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl (5.7MB) 2019-12-09T09:45:56.568 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-12-09T09:45:56.578 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-09T09:45:56.682 INFO:teuthology.orchestra.run.smithi121.stdout:Building wheels for collected packages: PyYAML, bunch, httplib2 2019-12-09T09:45:56.682 INFO:teuthology.orchestra.run.smithi121.stdout: Building wheel for PyYAML (setup.py): started 2019-12-09T09:45:57.390 INFO:teuthology.orchestra.run.smithi121.stdout: Building wheel for PyYAML (setup.py): finished with status 'done' 2019-12-09T09:45:57.391 INFO:teuthology.orchestra.run.smithi121.stdout: Created wheel for PyYAML: filename=PyYAML-5.2-cp27-cp27mu-linux_x86_64.whl size=46299 sha256=f724f792a9b2f38537dc6737995d2a418da3e674c7bafe65efa275202acabbe9 2019-12-09T09:45:57.391 INFO:teuthology.orchestra.run.smithi121.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/54/b7/c7/2ada654ee54483c9329871665aaf4a6056c3ce36f29cf66e67 2019-12-09T09:45:57.405 INFO:teuthology.orchestra.run.smithi121.stdout: Building wheel for bunch (setup.py): started 2019-12-09T09:45:57.725 INFO:teuthology.orchestra.run.smithi121.stdout: Building wheel for bunch (setup.py): finished with status 'done' 2019-12-09T09:45:57.725 INFO:teuthology.orchestra.run.smithi121.stdout: Created wheel for bunch: filename=bunch-1.0.1-cp27-none-any.whl size=8347 sha256=ce6851ffca52732f22378fce3cec6386376d5e17b393499693a1082b5d308bfe 2019-12-09T09:45:57.726 INFO:teuthology.orchestra.run.smithi121.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c 2019-12-09T09:45:57.730 INFO:teuthology.orchestra.run.smithi121.stdout: Building wheel for httplib2 (setup.py): started 2019-12-09T09:45:58.094 INFO:teuthology.orchestra.run.smithi121.stdout: Building wheel for httplib2 (setup.py): finished with status 'done' 2019-12-09T09:45:58.095 INFO:teuthology.orchestra.run.smithi121.stdout: Created wheel for httplib2: filename=httplib2-0.14.0-cp27-none-any.whl size=96742 sha256=53427fc85243e5fb7e3a1872b0fc8254d49a5746e410afcd41cf89d5bf32d740 2019-12-09T09:45:58.095 INFO:teuthology.orchestra.run.smithi121.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488 2019-12-09T09:45:58.103 INFO:teuthology.orchestra.run.smithi121.stdout:Successfully built PyYAML bunch httplib2 2019-12-09T09:45:58.222 INFO:teuthology.orchestra.run.smithi121.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-12-09T09:45:58.222 INFO:teuthology.orchestra.run.smithi121.stdout:Installing collected packages: PyYAML, boto, bunch, greenlet, gevent, httplib2, lxml 2019-12-09T09:45:58.222 INFO:teuthology.orchestra.run.smithi121.stdout: Found existing installation: PyYAML 3.10 2019-12-09T09:45:58.222 INFO:teuthology.orchestra.run.smithi121.stdout: Not uninstalling pyyaml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-12-09T09:45:58.223 INFO:teuthology.orchestra.run.smithi121.stdout: Can't uninstall 'PyYAML'. No files were found to uninstall. 2019-12-09T09:45:59.260 INFO:teuthology.orchestra.run.smithi121.stdout: Found existing installation: lxml 3.2.1 2019-12-09T09:45:59.261 INFO:teuthology.orchestra.run.smithi121.stdout: Not uninstalling lxml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-12-09T09:45:59.261 INFO:teuthology.orchestra.run.smithi121.stdout: Can't uninstall 'lxml'. No files were found to uninstall. 2019-12-09T09:45:59.331 INFO:teuthology.orchestra.run.smithi121.stdout:Successfully installed PyYAML-5.2 boto-2.49.0 bunch-1.0.1 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 lxml-4.4.2 2019-12-09T09:45:59.702 INFO:teuthology.orchestra.run.smithi121.stdout:running develop 2019-12-09T09:45:59.765 INFO:teuthology.orchestra.run.smithi121.stdout:running egg_info 2019-12-09T09:45:59.765 INFO:teuthology.orchestra.run.smithi121.stdout:creating ragweed.egg-info 2019-12-09T09:45:59.766 INFO:teuthology.orchestra.run.smithi121.stdout:writing requirements to ragweed.egg-info/requires.txt 2019-12-09T09:45:59.766 INFO:teuthology.orchestra.run.smithi121.stdout:writing ragweed.egg-info/PKG-INFO 2019-12-09T09:45:59.766 INFO:teuthology.orchestra.run.smithi121.stdout:writing top-level names to ragweed.egg-info/top_level.txt 2019-12-09T09:45:59.766 INFO:teuthology.orchestra.run.smithi121.stdout:writing dependency_links to ragweed.egg-info/dependency_links.txt 2019-12-09T09:45:59.766 INFO:teuthology.orchestra.run.smithi121.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-12-09T09:45:59.767 INFO:teuthology.orchestra.run.smithi121.stdout:reading manifest file 'ragweed.egg-info/SOURCES.txt' 2019-12-09T09:45:59.767 INFO:teuthology.orchestra.run.smithi121.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-12-09T09:45:59.768 INFO:teuthology.orchestra.run.smithi121.stdout:running build_ext 2019-12-09T09:45:59.768 INFO:teuthology.orchestra.run.smithi121.stdout:Creating /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/ragweed.egg-link (link to .) 2019-12-09T09:45:59.769 INFO:teuthology.orchestra.run.smithi121.stdout:Adding ragweed 0.0.1 to easy-install.pth file 2019-12-09T09:45:59.769 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:45:59.769 INFO:teuthology.orchestra.run.smithi121.stdout:Installed /home/ubuntu/cephtest/ragweed 2019-12-09T09:45:59.770 INFO:teuthology.orchestra.run.smithi121.stdout:Processing dependencies for ragweed==0.0.1 2019-12-09T09:45:59.773 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for isodate>=0.4.4 2019-12-09T09:45:59.773 INFO:teuthology.orchestra.run.smithi121.stdout:Reading https://pypi.python.org/simple/isodate/ 2019-12-09T09:45:59.881 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading https://files.pythonhosted.org/packages/b1/80/fb8c13a4cd38eb5021dc3741a9e588e4d1de88d895c1910c6fc8a08b7a70/isodate-0.6.0.tar.gz#sha256=2e364a3d5759479cdb2d37cce6b9376ea504db2ff90252a2e5b7cc89cc9ff2d8 2019-12-09T09:45:59.930 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: isodate 0.6.0 2019-12-09T09:45:59.930 INFO:teuthology.orchestra.run.smithi121.stdout:Processing isodate-0.6.0.tar.gz 2019-12-09T09:45:59.941 INFO:teuthology.orchestra.run.smithi121.stdout:Writing /tmp/easy_install-xRCzqN/isodate-0.6.0/setup.cfg 2019-12-09T09:45:59.941 INFO:teuthology.orchestra.run.smithi121.stdout:Running isodate-0.6.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-xRCzqN/isodate-0.6.0/egg-dist-tmp-TqxN79 2019-12-09T09:46:00.253 INFO:teuthology.orchestra.run.smithi121.stderr:zip_safe flag not set; analyzing archive contents... 2019-12-09T09:46:00.268 INFO:teuthology.orchestra.run.smithi121.stdout:Moving isodate-0.6.0-py2.7.egg to /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-09T09:46:00.270 INFO:teuthology.orchestra.run.smithi121.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-12-09T09:46:00.271 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:46:00.271 INFO:teuthology.orchestra.run.smithi121.stdout:Installed /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/isodate-0.6.0-py2.7.egg 2019-12-09T09:46:00.295 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for gevent==1.4.0 2019-12-09T09:46:00.295 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: gevent 1.4.0 2019-12-09T09:46:00.295 INFO:teuthology.orchestra.run.smithi121.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-12-09T09:46:00.296 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:46:00.296 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-09T09:46:00.296 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for bunch==1.0.1 2019-12-09T09:46:00.296 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: bunch 1.0.1 2019-12-09T09:46:00.296 INFO:teuthology.orchestra.run.smithi121.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-12-09T09:46:00.297 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:46:00.297 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-09T09:46:00.298 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for PyYAML==5.2 2019-12-09T09:46:00.298 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: PyYAML 5.2 2019-12-09T09:46:00.298 INFO:teuthology.orchestra.run.smithi121.stdout:Adding PyYAML 5.2 to easy-install.pth file 2019-12-09T09:46:00.298 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:46:00.298 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-09T09:46:00.299 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for boto==2.49.0 2019-12-09T09:46:00.299 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: boto 2.49.0 2019-12-09T09:46:00.300 INFO:teuthology.orchestra.run.smithi121.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-12-09T09:46:00.300 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:46:00.300 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-09T09:46:00.300 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for six==1.9.0 2019-12-09T09:46:00.300 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: six 1.9.0 2019-12-09T09:46:00.300 INFO:teuthology.orchestra.run.smithi121.stdout:Adding six 1.9.0 to easy-install.pth file 2019-12-09T09:46:00.301 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:46:00.301 INFO:teuthology.orchestra.run.smithi121.stdout:Using /usr/lib/python2.7/site-packages 2019-12-09T09:46:00.309 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for greenlet==0.4.15 2019-12-09T09:46:00.310 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: greenlet 0.4.15 2019-12-09T09:46:00.310 INFO:teuthology.orchestra.run.smithi121.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-12-09T09:46:00.310 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T09:46:00.311 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-09T09:46:00.311 INFO:teuthology.orchestra.run.smithi121.stdout:Finished processing dependencies for ragweed==0.0.1 2019-12-09T09:46:00.333 INFO:teuthology.orchestra.run.smithi121:> cat > /home/ubuntu/cephtest/archive/ragweed.client.0.conf 2019-12-09T09:46:00.406 INFO:tasks.ragweed:Configuring boto... 2019-12-09T09:46:00.406 INFO:teuthology.orchestra.run.smithi121:> cat > /home/ubuntu/cephtest/boto.cfg 2019-12-09T09:46:00.521 INFO:teuthology.orchestra.run.smithi121:ragweed tests against rgw> RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw' 2019-12-09T09:47:17.650 INFO:teuthology.orchestra.run.smithi121.stderr:ragweed.tests.tests.r_test_multipart_defer_complete.test ... ok 2019-12-09T09:48:08.657 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:09:06.692 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T09:48:08.742 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:09:06.776 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T09:48:08.769 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:09:06.804 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T09:48:08.827 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:09:06.815 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T09:48:08.881 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:09:06.915 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T09:48:08.903 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:09:06.890 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T09:48:09.300 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:09:07.334 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T09:48:09.435 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:09:07.470 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T09:48:09.548 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:09:07.536 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T09:48:22.670 INFO:teuthology.orchestra.run.smithi121.stderr:ragweed.tests.tests.r_test_multipart_defer_update_complete.test ... ok 2019-12-09T09:49:22.503 INFO:teuthology.orchestra.run.smithi121.stderr:ragweed.tests.tests.r_test_multipart_index_versioning.test ... ok 2019-12-09T09:50:30.683 INFO:teuthology.orchestra.run.smithi121.stderr:ragweed.tests.tests.r_test_multipart_simple.test ... ok 2019-12-09T09:50:33.878 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:11:31.914 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T09:50:33.884 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:11:31.921 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T09:50:33.905 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:11:31.883 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T09:50:33.905 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:11:31.941 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T09:50:33.912 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:11:31.948 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T09:50:33.912 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:11:31.890 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T09:50:34.000 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:11:32.036 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T09:50:34.017 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:11:32.053 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T09:50:34.079 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:11:32.057 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T09:52:05.880 INFO:teuthology.orchestra.run.smithi121.stderr:ragweed.tests.tests.r_test_obj_storage_class.test ... ok 2019-12-09T09:55:03.671 INFO:teuthology.orchestra.run.smithi121.stderr:ragweed.tests.tests.r_test_obj_storage_class_copy.test ... ok 2019-12-09T09:55:36.308 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:16:34.349 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T09:55:36.321 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:16:34.361 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T09:55:36.347 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:16:34.387 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T09:55:36.364 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:16:34.404 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T09:55:36.375 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:16:34.335 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T09:55:36.378 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:16:34.338 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T09:55:36.522 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:16:34.562 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T09:55:36.572 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:16:34.531 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T09:55:36.638 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:16:34.679 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T09:56:30.468 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:17:28.509 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T09:56:30.529 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:17:28.570 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T09:56:30.534 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:17:28.575 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T09:56:30.536 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:17:28.577 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T09:56:30.550 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:17:28.509 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T09:56:30.553 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:17:28.513 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T09:56:30.596 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:17:28.637 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T09:56:30.598 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:17:28.638 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T09:56:30.637 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:17:28.596 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T09:57:29.705 INFO:teuthology.orchestra.run.smithi121.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart.test ... ok 2019-12-09T10:00:46.456 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:21:44.499 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:00:46.461 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:21:44.505 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:00:46.505 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:21:44.548 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:00:46.507 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:21:44.550 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:00:46.544 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:21:44.502 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:00:46.546 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:21:44.505 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:00:46.603 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:21:44.646 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:00:46.697 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:21:44.740 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:00:46.708 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:21:44.667 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:02:45.374 INFO:teuthology.orchestra.run.smithi121.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart_copy.test ... ok 2019-12-09T10:03:52.559 INFO:teuthology.orchestra.run.smithi121.stderr:ragweed.tests.tests.r_test_small_obj_data.test ... ok 2019-12-09T10:03:52.561 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T10:03:52.561 INFO:teuthology.orchestra.run.smithi121.stderr:---------------------------------------------------------------------- 2019-12-09T10:03:52.561 INFO:teuthology.orchestra.run.smithi121.stderr:Ran 9 tests in 1071.564s 2019-12-09T10:03:52.561 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T10:03:52.561 INFO:teuthology.orchestra.run.smithi121.stderr:OK 2019-12-09T10:03:52.582 INFO:tasks.ragweed:Cleaning up boto... 2019-12-09T10:03:52.582 INFO:teuthology.orchestra.run.smithi121:> rm /home/ubuntu/cephtest/boto.cfg 2019-12-09T10:03:52.672 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2019-12-09T10:03:52.922 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:52.936+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:52.957 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:52.971+0000 7fadc3b5aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:03:52.958 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:52.971+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:52.965 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:52.978+0000 7fadc3b5aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:03:52.965 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:52.978+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:52.973 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:52.987+0000 7fadc3b5aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:03:52.974 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:52.987+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:52.993 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.006+0000 7fadc3b5aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:03:53.235 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.248+0000 7fadc3b5aec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T10:03:53.235 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.248+0000 7fadc3b5aec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T10:03:53.236 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.248+0000 7fadc3b5aec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T10:03:53.236 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.249+0000 7fadc3b5aec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T10:03:53.236 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.249+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:53.253 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.266+0000 7fadc3b5aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:03:53.253 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.266+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:53.268 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.281+0000 7fadc3b5aec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:03:53.268 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.281+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:53.282 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.296+0000 7fadc3b5aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:03:53.283 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.296+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:53.297 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.311+0000 7fadc3b5aec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:03:53.297 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.311+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:53.309 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.323+0000 7fadc3b5aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:03:53.309 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.323+0000 7fadc3b5aec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T10:03:53.310 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.323+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:53.318 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.332+0000 7fadc3b5aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:03:53.318 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.332+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:53.333 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.346+0000 7fadc3b5aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:03:53.333 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.346+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:53.348 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.361+0000 7fadc3b5aec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:03:53.348 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.361+0000 7fadc3b5aec0 20 zonegroup default 2019-12-09T10:03:53.348 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.361+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:53.356 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.369+0000 7fadc3b5aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:03:53.356 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.369+0000 7fadc3b5aec0 10 Cannot find current period zone using local zone 2019-12-09T10:03:53.356 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.369+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:53.365 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.379+0000 7fadc3b5aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:03:53.366 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.379+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:53.378 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.392+0000 7fadc3b5aec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:03:53.378 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.392+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:53.395 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.408+0000 7fadc3b5aec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:03:53.395 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.408+0000 7fadc3b5aec0 20 zone default found 2019-12-09T10:03:53.395 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.408+0000 7fadc3b5aec0 20 started sync module instance, tier type = 2019-12-09T10:03:53.395 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.408+0000 7fadc3b5aec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T10:03:53.738 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.751+0000 7fadc3b5aec0 20 add_watcher() i=0 2019-12-09T10:03:53.738 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.751+0000 7fadc3b5aec0 20 add_watcher() i=1 2019-12-09T10:03:53.739 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.751+0000 7fadc3b5aec0 20 add_watcher() i=2 2019-12-09T10:03:53.739 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.751+0000 7fadc3b5aec0 20 add_watcher() i=3 2019-12-09T10:03:53.739 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.751+0000 7fadc3b5aec0 20 add_watcher() i=4 2019-12-09T10:03:53.739 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.751+0000 7fadc3b5aec0 20 add_watcher() i=5 2019-12-09T10:03:53.747 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.760+0000 7fadc3b5aec0 20 add_watcher() i=6 2019-12-09T10:03:53.777 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.791+0000 7fadc3b5aec0 20 add_watcher() i=7 2019-12-09T10:03:53.778 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.791+0000 7fadc3b5aec0 2 all 8 watchers are set, enabling cache 2019-12-09T10:03:53.778 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.791+0000 7fad80fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T10:03:53.786 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.799+0000 7fada3fff700 0 -- 172.21.15.121:0/375094785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562044d7c850 msgr2=0x562044d7ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T10:03:53.830 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:53.843+0000 7fadb1585700 0 -- 172.21.15.121:0/958180327 >> [v2:172.21.15.132:6800/8843,v1:172.21.15.132:6801/8843] conn(0x7facf4022490 msgr2=0x7facf4024960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T10:03:55.462 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.476+0000 7facf2ffd700 20 reqs_thread_entry: start 2019-12-09T10:03:55.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.476+0000 7facf0ff9700 20 reqs_thread_entry: start 2019-12-09T10:03:55.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.476+0000 7fadc3b5aec0 20 init_complete bucket index max shards: 0 2019-12-09T10:03:55.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.477+0000 7face6ffd700 20 reqs_thread_entry: start 2019-12-09T10:03:55.464 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.477+0000 7fadc3b5aec0 20 get_system_obj_state: rctx=0x7fffe8dda708 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x562044df5f90 s->prefetch_data=0 2019-12-09T10:03:55.464 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.477+0000 7fadc3b5aec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-12-09T10:03:55.475 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.489+0000 7fadc3b5aec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x16 2019-12-09T10:03:55.475 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.489+0000 7fadc3b5aec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-09T10:03:55.475 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.489+0000 7fadc3b5aec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:03:55.476 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.489+0000 7fadc3b5aec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:03:55.476 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.489+0000 7fadc3b5aec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-09T10:03:55.476 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.489+0000 7fadc3b5aec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:55.488 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.501+0000 7fadc3b5aec0 20 rados_obj.operate() r=0 bl.length=448 2019-12-09T10:03:55.488 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.501+0000 7fadc3b5aec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x11 2019-12-09T10:03:55.488 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.501+0000 7fadc3b5aec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-09T10:03:55.499 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.513+0000 7fadc3b5aec0 10 removing key index: HSMFTDOVUQKUTGRNUZBT 2019-12-09T10:03:55.499 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.513+0000 7fadc3b5aec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=170 2019-12-09T10:03:55.513 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:55.527+0000 7fad99ffb700 10 RGWWatcher::handle_notify() notify_id 571230650373 cookie 94696593848320 notifier 4454 bl.length()=170 2019-12-09T10:03:56.048 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:56.061+0000 7fadc3b5aec0 10 removing email index: sysuser.client.0+test@test.test 2019-12-09T10:03:56.048 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:56.061+0000 7fadc3b5aec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=182 2019-12-09T10:03:56.069 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:56.083+0000 7fad99ffb700 10 RGWWatcher::handle_notify() notify_id 571230650374 cookie 94696593848320 notifier 4454 bl.length()=182 2019-12-09T10:03:56.297 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:56.301+0000 7fadc3b5aec0 10 removing user buckets index 2019-12-09T10:03:56.297 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:56.301+0000 7fadc3b5aec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=173 2019-12-09T10:03:56.346 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:56.359+0000 7fad99ffb700 10 RGWWatcher::handle_notify() notify_id 571230650368 cookie 94696593845136 notifier 4454 bl.length()=173 2019-12-09T10:03:56.500 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:56.514+0000 7fadc3b5aec0 10 removing user index: sysuser.client.0 2019-12-09T10:03:56.501 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:56.514+0000 7fadc3b5aec0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2019-12-09T10:03:56.501 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:56.514+0000 7fadc3b5aec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=165 2019-12-09T10:03:56.516 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:56.530+0000 7fad99ffb700 10 RGWWatcher::handle_notify() notify_id 571230650375 cookie 94696593843104 notifier 4454 bl.length()=165 2019-12-09T10:03:56.889 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:56.902+0000 7fadc3b5aec0 20 remove_watcher() i=0 2019-12-09T10:03:56.889 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:56.902+0000 7fadc3b5aec0 2 removed watcher, disabling cache 2019-12-09T10:03:56.927 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:56.940+0000 7fadc3b5aec0 20 remove_watcher() i=1 2019-12-09T10:03:56.966 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:56.980+0000 7fadc3b5aec0 20 remove_watcher() i=2 2019-12-09T10:03:57.013 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.027+0000 7fadc3b5aec0 20 remove_watcher() i=3 2019-12-09T10:03:57.067 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.081+0000 7fadc3b5aec0 20 remove_watcher() i=4 2019-12-09T10:03:57.126 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.140+0000 7fadc3b5aec0 20 remove_watcher() i=5 2019-12-09T10:03:57.184 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.198+0000 7fadc3b5aec0 20 remove_watcher() i=6 2019-12-09T10:03:57.228 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.241+0000 7fadc3b5aec0 20 remove_watcher() i=7 2019-12-09T10:03:57.238 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2019-12-09T10:03:57.370 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.383+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:57.403 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.417+0000 7fa65eac8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:03:57.403 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.417+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:57.415 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.428+0000 7fa65eac8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:03:57.415 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.428+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:57.425 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.438+0000 7fa65eac8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:03:57.425 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.438+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.463+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:03:57.684 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.697+0000 7fa65eac8ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T10:03:57.684 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.697+0000 7fa65eac8ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T10:03:57.685 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.697+0000 7fa65eac8ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T10:03:57.685 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.697+0000 7fa65eac8ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T10:03:57.685 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.698+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:57.700 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.714+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:03:57.701 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.714+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:57.746 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.760+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:03:57.747 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.760+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:57.759 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.773+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:03:57.760 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.773+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:57.778 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.791+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:03:57.778 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.792+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:57.786 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.799+0000 7fa65eac8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:03:57.786 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.799+0000 7fa65eac8ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T10:03:57.786 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.799+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:57.794 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.808+0000 7fa65eac8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:03:57.794 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.808+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:57.814 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.827+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:03:57.814 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.827+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:57.823 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.837+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:03:57.824 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.837+0000 7fa65eac8ec0 20 zonegroup default 2019-12-09T10:03:57.824 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.837+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:57.830 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.843+0000 7fa65eac8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:03:57.830 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.843+0000 7fa65eac8ec0 10 Cannot find current period zone using local zone 2019-12-09T10:03:57.830 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.843+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:57.835 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.849+0000 7fa65eac8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:03:57.835 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.849+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:57.845 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.858+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:03:57.845 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.858+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:03:57.870 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.884+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:03:57.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.884+0000 7fa65eac8ec0 20 zone default found 2019-12-09T10:03:57.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.884+0000 7fa65eac8ec0 20 started sync module instance, tier type = 2019-12-09T10:03:57.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:57.884+0000 7fa65eac8ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T10:03:58.187 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:58.201+0000 7fa65eac8ec0 20 add_watcher() i=0 2019-12-09T10:03:58.188 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:58.201+0000 7fa65eac8ec0 20 add_watcher() i=1 2019-12-09T10:03:58.188 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:58.201+0000 7fa65eac8ec0 20 add_watcher() i=2 2019-12-09T10:03:58.188 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:58.201+0000 7fa65eac8ec0 20 add_watcher() i=3 2019-12-09T10:03:58.188 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:58.201+0000 7fa65eac8ec0 20 add_watcher() i=4 2019-12-09T10:03:58.188 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:58.201+0000 7fa65eac8ec0 20 add_watcher() i=5 2019-12-09T10:03:58.188 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:58.201+0000 7fa65eac8ec0 20 add_watcher() i=6 2019-12-09T10:03:58.212 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:58.225+0000 7fa65eac8ec0 20 add_watcher() i=7 2019-12-09T10:03:58.212 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:58.225+0000 7fa65eac8ec0 2 all 8 watchers are set, enabling cache 2019-12-09T10:03:58.212 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:58.226+0000 7fa59ffff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T10:03:58.219 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:58.232+0000 7fa64bcf2700 0 -- 172.21.15.121:0/3814498281 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55e055cd8d50 msgr2=0x55e055cdb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T10:03:58.259 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:03:58.273+0000 7fa64c4f3700 0 -- 172.21.15.121:0/2397009973 >> [v2:172.21.15.132:6800/8843,v1:172.21.15.132:6801/8843] conn(0x7fa58c022470 msgr2=0x7fa58c024960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T10:04:00.003 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.016+0000 7fa58a7fc700 20 reqs_thread_entry: start 2019-12-09T10:04:00.003 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.017+0000 7fa583fff700 20 reqs_thread_entry: start 2019-12-09T10:04:00.003 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.017+0000 7fa65eac8ec0 20 init_complete bucket index max shards: 0 2019-12-09T10:04:00.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.017+0000 7fa5827fc700 20 reqs_thread_entry: start 2019-12-09T10:04:00.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.017+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff358 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x55e055d57640 s->prefetch_data=0 2019-12-09T10:04:00.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.017+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-12-09T10:04:00.025 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.038+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x16 2019-12-09T10:04:00.025 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.038+0000 7fa65eac8ec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-09T10:04:00.025 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.038+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:00.025 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.038+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:00.025 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.038+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-09T10:04:00.026 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.038+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:00.046 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.060+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=448 2019-12-09T10:04:00.046 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.060+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x11 2019-12-09T10:04:00.047 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.060+0000 7fa65eac8ec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-09T10:04:00.062 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.075+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:test-client.0-conf state=0x55e055d58f60 s->prefetch_data=0 2019-12-09T10:04:00.072 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.075+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2019-12-09T10:04:00.086 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.100+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x6 2019-12-09T10:04:00.087 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.100+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-12-09T10:04:00.087 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.100+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:00.087 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.100+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:00.087 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.100+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x1, cached=0x6) 2019-12-09T10:04:00.087 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.100+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:00.106 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.119+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=200 2019-12-09T10:04:00.106 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.119+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x1 2019-12-09T10:04:00.106 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.119+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-12-09T10:04:00.106 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.119+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:.bucket.meta.test-client.0-conf:a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 state=0x55e055d5d7a0 s->prefetch_data=0 2019-12-09T10:04:00.106 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.119+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 : miss 2019-12-09T10:04:00.119 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.132+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 info.flags=0x16 2019-12-09T10:04:00.119 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.132+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 to cache LRU end 2019-12-09T10:04:00.119 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.132+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:00.119 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.132+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:00.119 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.132+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:00.120 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.132+0000 7fa65eac8ec0 20 Read xattr: user.rgw.acl 2019-12-09T10:04:00.120 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.132+0000 7fa65eac8ec0 20 Read xattr: user.rgw.idtag 2019-12-09T10:04:00.120 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.132+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 : type miss (requested=0x13, cached=0x16) 2019-12-09T10:04:00.120 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.133+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:00.140 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.154+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=292 2019-12-09T10:04:00.140 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.154+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 info.flags=0x13 2019-12-09T10:04:00.140 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.154+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-conf:a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 to cache LRU end 2019-12-09T10:04:00.141 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.154+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:00.141 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.154+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:00.141 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.154+0000 7fa65eac8ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 2019-12-09T10:04:00.161 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.175+0000 7fa65eac8ec0 10 cls_bucket_list_unordered :test-client.0-conf[a55fd90f-db62-40cd-9264-5916c91f1695.4358.1]) start [] num_entries 1100 2019-12-09T10:04:00.193 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.206+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete[] 2019-12-09T10:04:00.193 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.206+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete[] 2019-12-09T10:04:00.193 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.206+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning[] 2019-12-09T10:04:00.193 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.206+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_simple[] 2019-12-09T10:04:00.193 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.206+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class[] 2019-12-09T10:04:00.193 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.206+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy[] 2019-12-09T10:04:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.206+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart[] 2019-12-09T10:04:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.206+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy[] 2019-12-09T10:04:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.206+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_small_obj_data[] 2019-12-09T10:04:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.206+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:00.202 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.216+0000 7fa65eac8ec0 10 manifest: total_size = 3871 2019-12-09T10:04:00.202 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.216+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.13 2019-12-09T10:04:00.203 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.216+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:00.203 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.216+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d60758 2019-12-09T10:04:00.203 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.216+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 2019-12-09T10:04:00.318 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.332+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:00.341 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.354+0000 7fa65eac8ec0 10 manifest: total_size = 3880 2019-12-09T10:04:00.341 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.354+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.30 2019-12-09T10:04:00.341 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.354+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:00.341 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.354+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d60758 2019-12-09T10:04:00.342 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.354+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 2019-12-09T10:04:00.518 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.532+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:00.535 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.549+0000 7fa65eac8ec0 10 manifest: total_size = 3800 2019-12-09T10:04:00.535 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.549+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.56 2019-12-09T10:04:00.536 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.549+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:00.536 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.549+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d60758 2019-12-09T10:04:00.536 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.549+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 2019-12-09T10:04:00.712 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.725+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:00.751 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.765+0000 7fa65eac8ec0 10 manifest: total_size = 5726 2019-12-09T10:04:00.751 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.765+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.72 2019-12-09T10:04:00.751 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.765+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:00.752 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.765+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d60758 2019-12-09T10:04:00.752 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.765+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 2019-12-09T10:04:00.958 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.972+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:00.980 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.994+0000 7fa65eac8ec0 10 manifest: total_size = 5878 2019-12-09T10:04:00.980 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.994+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.87 2019-12-09T10:04:00.981 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.994+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:00.981 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.994+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d60758 2019-12-09T10:04:00.981 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:00.994+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 2019-12-09T10:04:01.158 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.172+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:01.174 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.187+0000 7fa65eac8ec0 10 manifest: total_size = 12920 2019-12-09T10:04:01.174 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.187+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.120 2019-12-09T10:04:01.174 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.187+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:01.175 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.188+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d60758 2019-12-09T10:04:01.175 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.188+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 2019-12-09T10:04:01.351 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.364+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:01.378 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.392+0000 7fa65eac8ec0 10 manifest: total_size = 6123 2019-12-09T10:04:01.378 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.392+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.190 2019-12-09T10:04:01.378 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.392+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:01.379 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.392+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d60758 2019-12-09T10:04:01.379 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.392+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 2019-12-09T10:04:01.641 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.654+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:01.660 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.673+0000 7fa65eac8ec0 10 manifest: total_size = 3988 2019-12-09T10:04:01.660 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.673+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.247 2019-12-09T10:04:01.660 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.673+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:01.660 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.673+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d60758 2019-12-09T10:04:01.660 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.673+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 2019-12-09T10:04:01.804 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.817+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:01.855 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.869+0000 7fa65eac8ec0 10 manifest: total_size = 3998 2019-12-09T10:04:01.855 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.869+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.323 2019-12-09T10:04:01.856 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.869+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55e055d60758 s->prefetch_data=0 2019-12-09T10:04:01.856 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.869+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d60758 2019-12-09T10:04:01.856 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.869+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 2019-12-09T10:04:01.962 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.976+0000 7fa65eac8ec0 10 cls_bucket_list_ordered :test-client.0-conf[a55fd90f-db62-40cd-9264-5916c91f1695.4358.1]) start _multipart_[] num_entries 1001 2019-12-09T10:04:01.962 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:01.976+0000 7fa65eac8ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T10:04:02.033 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:02.047+0000 7fa65eac8ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[a55fd90f-db62-40cd-9264-5916c91f1695.4358.1])"; objs.size()=0; is_truncated=0 2019-12-09T10:04:02.112 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:02.125+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987fead8 obj=default.rgw.meta:root:test-client.0-conf state=0x55e055d5d7a0 s->prefetch_data=0 2019-12-09T10:04:02.112 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:02.125+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x16, cached=0x3) 2019-12-09T10:04:02.125 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:02.138+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x16 2019-12-09T10:04:02.125 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:02.138+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-12-09T10:04:02.125 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:02.138+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:02.125 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:02.138+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:02.126 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:02.138+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : hit (requested=0x11, cached=0x17) 2019-12-09T10:04:02.126 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:02.138+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2019-12-09T10:04:02.126 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:02.138+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=162 2019-12-09T10:04:02.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:02.173+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650368 cookie 94422000489232 notifier 4460 bl.length()=162 2019-12-09T10:04:02.983 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:02.997+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:a55fd90f-db62-40cd-9264-5916c91f1695.4358.1 from cache 2019-12-09T10:04:02.984 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:02.997+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=219 2019-12-09T10:04:02.995 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.009+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650369 cookie 94422000492560 notifier 4460 bl.length()=219 2019-12-09T10:04:03.443 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.456+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55e055d60270 s->prefetch_data=0 2019-12-09T10:04:03.443 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.456+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2019-12-09T10:04:03.462 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.476+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x6 2019-12-09T10:04:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.476+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-12-09T10:04:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.476+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.476+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.476+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T10:04:03.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.476+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:03.480 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.494+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=229 2019-12-09T10:04:03.480 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.494+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x1 2019-12-09T10:04:03.481 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.494+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-12-09T10:04:03.481 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.494+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.2 state=0x55e055d5b4b0 s->prefetch_data=0 2019-12-09T10:04:03.481 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.494+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.2 : miss 2019-12-09T10:04:03.507 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.521+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.2 info.flags=0x16 2019-12-09T10:04:03.507 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.521+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.2 to cache LRU end 2019-12-09T10:04:03.507 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.521+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:03.507 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.521+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:03.508 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.521+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:03.508 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.521+0000 7fa65eac8ec0 20 Read xattr: user.rgw.acl 2019-12-09T10:04:03.508 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.521+0000 7fa65eac8ec0 20 Read xattr: user.rgw.idtag 2019-12-09T10:04:03.508 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.521+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.2 : type miss (requested=0x13, cached=0x16) 2019-12-09T10:04:03.508 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.521+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:03.525 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.539+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=321 2019-12-09T10:04:03.525 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.539+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.2 info.flags=0x13 2019-12-09T10:04:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.539+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.2 to cache LRU end 2019-12-09T10:04:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.539+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.539+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:03.526 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.539+0000 7fa65eac8ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.2 2019-12-09T10:04:03.543 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.556+0000 7fa65eac8ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-complete.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.2]) start [] num_entries 1100 2019-12-09T10:04:03.559 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.572+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-12-09T10:04:03.559 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.572+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55e055d610f8 s->prefetch_data=0 2019-12-09T10:04:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.590+0000 7fa65eac8ec0 10 manifest: total_size = 1848 2019-12-09T10:04:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.590+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.20 2019-12-09T10:04:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.590+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55e055d610f8 s->prefetch_data=0 2019-12-09T10:04:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.590+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d610f8 2019-12-09T10:04:03.577 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.590+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.2 2019-12-09T10:04:03.714 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.728+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-09T10:04:03.715 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.728+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=515 2019-12-09T10:04:03.715 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.728+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-12-09T10:04:03.715 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.728+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-09T10:04:03.715 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.728+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194819 part_ofs=515 rule->part_size=515 2019-12-09T10:04:03.715 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.728+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=515 2019-12-09T10:04:03.716 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.728+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-09T10:04:03.716 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.728+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4195334 part_ofs=1030 rule->part_size=515 2019-12-09T10:04:03.716 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.728+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=1545 stripe_ofs=1545 part_ofs=1545 rule->part_size=303 2019-12-09T10:04:03.716 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.728+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=303 rules.size()=2 2019-12-09T10:04:03.716 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.728+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4195849 part_ofs=1545 rule->part_size=303 2019-12-09T10:04:03.716 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.728+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=1848 stripe_ofs=1848 part_ofs=1848 rule->part_size=303 2019-12-09T10:04:03.716 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.728+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.20 2019-12-09T10:04:03.814 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.828+0000 7fa65eac8ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-complete.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.2]) start _multipart_[] num_entries 1001 2019-12-09T10:04:03.814 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.828+0000 7fa65eac8ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T10:04:03.827 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.840+0000 7fa65eac8ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.2])"; objs.size()=0; is_truncated=0 2019-12-09T10:04:03.899 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.913+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987fead8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55e055d60270 s->prefetch_data=0 2019-12-09T10:04:03.899 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.913+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T10:04:03.909 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.923+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x16 2019-12-09T10:04:03.910 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.923+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-12-09T10:04:03.910 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.923+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:03.910 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.923+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:03.910 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.923+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : hit (requested=0x11, cached=0x17) 2019-12-09T10:04:03.910 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.923+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2019-12-09T10:04:03.910 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.923+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=191 2019-12-09T10:04:03.927 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:03.941+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650370 cookie 94422000492560 notifier 4460 bl.length()=191 2019-12-09T10:04:04.158 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.172+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.2 from cache 2019-12-09T10:04:04.158 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.172+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=248 2019-12-09T10:04:04.176 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.190+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650376 cookie 94422000499056 notifier 4460 bl.length()=248 2019-12-09T10:04:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.404+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55e055d5b4b0 s->prefetch_data=0 2019-12-09T10:04:04.391 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.404+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2019-12-09T10:04:04.404 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.417+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x6 2019-12-09T10:04:04.404 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.417+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-12-09T10:04:04.404 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.417+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:04.404 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.417+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:04.405 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.417+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T10:04:04.405 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.417+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:04.414 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.428+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=236 2019-12-09T10:04:04.414 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.428+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x1 2019-12-09T10:04:04.414 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.428+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-12-09T10:04:04.415 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.428+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.3 state=0x55e055d5b0f0 s->prefetch_data=0 2019-12-09T10:04:04.415 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.428+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.3 : miss 2019-12-09T10:04:04.425 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.438+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.3 info.flags=0x16 2019-12-09T10:04:04.425 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.438+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.3 to cache LRU end 2019-12-09T10:04:04.425 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.438+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:04.425 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.438+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:04.425 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.438+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:04.425 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.438+0000 7fa65eac8ec0 20 Read xattr: user.rgw.acl 2019-12-09T10:04:04.426 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.438+0000 7fa65eac8ec0 20 Read xattr: user.rgw.idtag 2019-12-09T10:04:04.426 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.438+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.3 : type miss (requested=0x13, cached=0x16) 2019-12-09T10:04:04.426 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.438+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:04.437 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.451+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=328 2019-12-09T10:04:04.437 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.451+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.3 info.flags=0x13 2019-12-09T10:04:04.438 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.451+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.3 to cache LRU end 2019-12-09T10:04:04.438 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.451+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:04.438 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.451+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:04.438 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.451+0000 7fa65eac8ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.3 2019-12-09T10:04:04.459 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.473+0000 7fa65eac8ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-update-complete.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.3]) start [] num_entries 1100 2019-12-09T10:04:04.486 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.500+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-12-09T10:04:04.487 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.500+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55e055d60748 s->prefetch_data=0 2019-12-09T10:04:04.528 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.541+0000 7fa65eac8ec0 10 manifest: total_size = 74198 2019-12-09T10:04:04.528 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.541+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.40 2019-12-09T10:04:04.528 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.541+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55e055d60748 s->prefetch_data=0 2019-12-09T10:04:04.528 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.541+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d60748 2019-12-09T10:04:04.529 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.541+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.3 2019-12-09T10:04:04.662 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.676+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-12-09T10:04:04.663 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.676+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2019-12-09T10:04:04.663 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.676+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2019-12-09T10:04:04.663 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.676+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-12-09T10:04:04.663 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.676+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2019-12-09T10:04:04.663 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.676+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2019-12-09T10:04:04.663 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.676+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-12-09T10:04:04.663 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.676+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2019-12-09T10:04:04.664 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.676+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2019-12-09T10:04:04.664 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.676+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2019-12-09T10:04:04.664 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.676+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2019-12-09T10:04:04.664 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.676+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2019-12-09T10:04:04.664 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.676+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.40 2019-12-09T10:04:04.750 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.764+0000 7fa65eac8ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-update-complete.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.3]) start _multipart_[] num_entries 1001 2019-12-09T10:04:04.751 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.764+0000 7fa65eac8ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T10:04:04.764 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.778+0000 7fa65eac8ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.3])"; objs.size()=0; is_truncated=0 2019-12-09T10:04:04.844 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.858+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987fead8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55e055d5feb0 s->prefetch_data=0 2019-12-09T10:04:04.845 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.858+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T10:04:04.864 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.877+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x16 2019-12-09T10:04:04.864 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.877+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-12-09T10:04:04.864 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.877+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:04.864 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.877+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:04.865 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.877+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : hit (requested=0x11, cached=0x17) 2019-12-09T10:04:04.865 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.877+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2019-12-09T10:04:04.865 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.877+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=198 2019-12-09T10:04:04.882 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:04.895+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650377 cookie 94422000494432 notifier 4460 bl.length()=198 2019-12-09T10:04:05.089 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.103+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.3 from cache 2019-12-09T10:04:05.090 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.103+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=255 2019-12-09T10:04:05.105 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.119+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650369 cookie 94422000496064 notifier 4460 bl.length()=255 2019-12-09T10:04:05.716 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.731+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55e055d5feb0 s->prefetch_data=0 2019-12-09T10:04:05.716 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.731+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2019-12-09T10:04:05.731 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.745+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x6 2019-12-09T10:04:05.731 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.745+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-12-09T10:04:05.731 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.745+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:05.731 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.745+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:05.731 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.745+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T10:04:05.731 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.745+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:05.741 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.756+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=231 2019-12-09T10:04:05.742 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.756+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x1 2019-12-09T10:04:05.742 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.756+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-12-09T10:04:05.742 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.756+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 state=0x55e055d5b4b0 s->prefetch_data=0 2019-12-09T10:04:05.742 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.756+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 : miss 2019-12-09T10:04:05.756 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.770+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 info.flags=0x16 2019-12-09T10:04:05.756 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.770+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 to cache LRU end 2019-12-09T10:04:05.756 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.770+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:05.756 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.770+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:05.756 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.770+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:05.757 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.770+0000 7fa65eac8ec0 20 Read xattr: user.rgw.acl 2019-12-09T10:04:05.757 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.770+0000 7fa65eac8ec0 20 Read xattr: user.rgw.idtag 2019-12-09T10:04:05.757 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.770+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 : type miss (requested=0x13, cached=0x16) 2019-12-09T10:04:05.757 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.770+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:05.776 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.787+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=323 2019-12-09T10:04:05.776 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.787+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 info.flags=0x13 2019-12-09T10:04:05.777 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.787+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 to cache LRU end 2019-12-09T10:04:05.777 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.787+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:05.777 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.787+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:05.777 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.787+0000 7fa65eac8ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 2019-12-09T10:04:05.793 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.807+0000 7fa65eac8ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-index-versioning.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.4]) start [] num_entries 1100 2019-12-09T10:04:05.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.886+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo[saLobmNZYKut7zL38AGzR8KAVlZTv4m] 2019-12-09T10:04:05.872 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.886+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 2019-12-09T10:04:05.920 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.934+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:05.943 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.957+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to d5wf0h4hs87fots9kpaivgvosd53p66s 2019-12-09T10:04:05.943 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.957+0000 7fa65eac8ec0 20 get_obj_state_impl: setting s->olh_tag to uljpa00ikf54913q2kdu710rdyzf60s0 2019-12-09T10:04:05.943 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:05.957+0000 7fa65eac8ec0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=uljpa00ikf54913q2kdu710rdyzf60s0 2019-12-09T10:04:06.001 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.016+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 2019-12-09T10:04:06.074 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.089+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 2019-12-09T10:04:06.075 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.089+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 2019-12-09T10:04:06.098 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.113+0000 7fa65eac8ec0 20 olh_log_entry: epoch=3 op=2 key=[] 2019-12-09T10:04:06.099 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.113+0000 7fa65eac8ec0 20 olh_log_entry: epoch=3 op=3 key=foo[saLobmNZYKut7zL38AGzR8KAVlZTv4m] 2019-12-09T10:04:06.099 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.113+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-multipart-index-versioning.1:_:saLobmNZYKut7zL38AGzR8KAVlZTv4m_foo state=0x55e055cabfc8 s->prefetch_data=0 2019-12-09T10:04:06.117 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.131+0000 7fa65eac8ec0 10 manifest: total_size = 26086 2019-12-09T10:04:06.117 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.131+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.55 2019-12-09T10:04:06.117 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.131+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-multipart-index-versioning.1:_:saLobmNZYKut7zL38AGzR8KAVlZTv4m_foo state=0x55e055cabfc8 s->prefetch_data=0 2019-12-09T10:04:06.117 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.131+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cabfc8 2019-12-09T10:04:06.117 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.132+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 2019-12-09T10:04:06.240 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.254+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=4 2019-12-09T10:04:06.240 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.254+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7674 2019-12-09T10:04:06.240 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.254+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=7674 stripe_ofs=7674 part_ofs=7674 rule->part_size=7673 2019-12-09T10:04:06.240 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.254+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=4 2019-12-09T10:04:06.240 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.254+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4201978 part_ofs=7674 rule->part_size=7673 2019-12-09T10:04:06.240 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.254+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=15347 stripe_ofs=15347 part_ofs=15347 rule->part_size=7672 2019-12-09T10:04:06.241 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.254+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2019-12-09T10:04:06.241 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.254+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4209651 part_ofs=15347 rule->part_size=7672 2019-12-09T10:04:06.241 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.254+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=23019 stripe_ofs=23019 part_ofs=23019 rule->part_size=3067 2019-12-09T10:04:06.241 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.254+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2019-12-09T10:04:06.241 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.254+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4217323 part_ofs=23019 rule->part_size=3067 2019-12-09T10:04:06.241 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.254+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=26086 stripe_ofs=26086 part_ofs=26086 rule->part_size=3067 2019-12-09T10:04:06.242 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.254+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.55 2019-12-09T10:04:06.349 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.363+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 2019-12-09T10:04:06.349 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.363+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 2019-12-09T10:04:06.471 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.485+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 2019-12-09T10:04:06.535 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.549+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 2019-12-09T10:04:06.535 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.549+0000 7fa65eac8ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-index-versioning.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.4]) start _multipart_[] num_entries 1001 2019-12-09T10:04:06.535 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.549+0000 7fa65eac8ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T10:04:06.546 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.561+0000 7fa65eac8ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.4])"; objs.size()=0; is_truncated=0 2019-12-09T10:04:06.603 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.618+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987fead8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55e055d5feb0 s->prefetch_data=0 2019-12-09T10:04:06.604 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.618+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T10:04:06.619 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.633+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x16 2019-12-09T10:04:06.619 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.633+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-12-09T10:04:06.619 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.633+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:06.620 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.633+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:06.620 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.633+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : hit (requested=0x11, cached=0x17) 2019-12-09T10:04:06.620 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.633+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2019-12-09T10:04:06.620 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.633+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=193 2019-12-09T10:04:06.632 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:06.646+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650378 cookie 94422000494432 notifier 4460 bl.length()=193 2019-12-09T10:04:07.029 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.044+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.4 from cache 2019-12-09T10:04:07.030 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.044+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=250 2019-12-09T10:04:07.047 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.062+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650371 cookie 94422000501040 notifier 4460 bl.length()=250 2019-12-09T10:04:07.399 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.414+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55e055d5feb0 s->prefetch_data=0 2019-12-09T10:04:07.400 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.414+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2019-12-09T10:04:07.420 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.434+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x6 2019-12-09T10:04:07.420 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.434+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-12-09T10:04:07.420 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.434+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:07.420 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.434+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:07.420 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.434+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T10:04:07.420 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.434+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:07.427 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.442+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=221 2019-12-09T10:04:07.427 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.442+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x1 2019-12-09T10:04:07.427 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.442+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-12-09T10:04:07.427 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.442+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.5 state=0x55e055d5b4b0 s->prefetch_data=0 2019-12-09T10:04:07.428 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.442+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.5 : miss 2019-12-09T10:04:07.441 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.456+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.5 info.flags=0x16 2019-12-09T10:04:07.442 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.456+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.5 to cache LRU end 2019-12-09T10:04:07.442 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.456+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:07.442 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.456+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:07.442 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.456+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:07.442 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.456+0000 7fa65eac8ec0 20 Read xattr: user.rgw.acl 2019-12-09T10:04:07.442 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.456+0000 7fa65eac8ec0 20 Read xattr: user.rgw.idtag 2019-12-09T10:04:07.443 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.456+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.5 : type miss (requested=0x13, cached=0x16) 2019-12-09T10:04:07.443 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.456+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:07.456 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.471+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=313 2019-12-09T10:04:07.456 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.471+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.5 info.flags=0x13 2019-12-09T10:04:07.456 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.471+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.5 to cache LRU end 2019-12-09T10:04:07.456 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.471+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:07.457 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.471+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:07.457 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.471+0000 7fa65eac8ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.5 2019-12-09T10:04:07.467 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.482+0000 7fa65eac8ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-simple.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.5]) start [] num_entries 1100 2019-12-09T10:04:07.477 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.492+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-12-09T10:04:07.478 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.492+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:07.486 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.501+0000 7fa65eac8ec0 10 manifest: total_size = 1848 2019-12-09T10:04:07.486 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.501+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.71 2019-12-09T10:04:07.487 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.501+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:07.487 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.501+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:07.487 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.501+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.5 2019-12-09T10:04:07.575 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.589+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-09T10:04:07.575 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.589+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=515 2019-12-09T10:04:07.575 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.589+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-12-09T10:04:07.576 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.589+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-09T10:04:07.576 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.589+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194819 part_ofs=515 rule->part_size=515 2019-12-09T10:04:07.576 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.589+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=515 2019-12-09T10:04:07.576 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.589+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-09T10:04:07.576 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.589+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4195334 part_ofs=1030 rule->part_size=515 2019-12-09T10:04:07.576 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.589+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=1545 stripe_ofs=1545 part_ofs=1545 rule->part_size=303 2019-12-09T10:04:07.576 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.589+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=303 rules.size()=2 2019-12-09T10:04:07.577 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.589+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4195849 part_ofs=1545 rule->part_size=303 2019-12-09T10:04:07.577 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.589+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=1848 stripe_ofs=1848 part_ofs=1848 rule->part_size=303 2019-12-09T10:04:07.577 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.589+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.71 2019-12-09T10:04:07.643 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.658+0000 7fa65eac8ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-simple.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.5]) start _multipart_[] num_entries 1001 2019-12-09T10:04:07.643 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.658+0000 7fa65eac8ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T10:04:07.653 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.668+0000 7fa65eac8ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.5])"; objs.size()=0; is_truncated=0 2019-12-09T10:04:07.725 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.740+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987fead8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55e055d60730 s->prefetch_data=0 2019-12-09T10:04:07.726 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.740+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T10:04:07.742 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.757+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x16 2019-12-09T10:04:07.743 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.757+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-12-09T10:04:07.743 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.757+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:07.743 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.757+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:07.743 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.757+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : hit (requested=0x11, cached=0x17) 2019-12-09T10:04:07.743 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.757+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2019-12-09T10:04:07.743 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.757+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=183 2019-12-09T10:04:07.757 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.772+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650379 cookie 94422000499056 notifier 4460 bl.length()=183 2019-12-09T10:04:07.867 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.882+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.5 from cache 2019-12-09T10:04:07.867 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.882+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=240 2019-12-09T10:04:07.881 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:07.895+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650369 cookie 94422000506448 notifier 4460 bl.length()=240 2019-12-09T10:04:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.363+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55e055d5feb0 s->prefetch_data=0 2019-12-09T10:04:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.363+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2019-12-09T10:04:08.365 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.379+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x6 2019-12-09T10:04:08.365 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.379+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-12-09T10:04:08.365 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.379+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:08.365 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.379+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:08.365 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.379+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T10:04:08.365 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.379+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:08.381 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.395+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=227 2019-12-09T10:04:08.381 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.395+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x1 2019-12-09T10:04:08.381 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.395+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-12-09T10:04:08.381 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.395+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 state=0x55e055d618a0 s->prefetch_data=0 2019-12-09T10:04:08.381 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.395+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 : miss 2019-12-09T10:04:08.405 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.420+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 info.flags=0x16 2019-12-09T10:04:08.405 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.420+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 to cache LRU end 2019-12-09T10:04:08.406 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.420+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:08.406 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.420+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:08.406 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.420+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:08.406 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.420+0000 7fa65eac8ec0 20 Read xattr: user.rgw.acl 2019-12-09T10:04:08.406 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.420+0000 7fa65eac8ec0 20 Read xattr: user.rgw.idtag 2019-12-09T10:04:08.406 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.420+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 : type miss (requested=0x13, cached=0x16) 2019-12-09T10:04:08.407 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.420+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:08.420 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.435+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=319 2019-12-09T10:04:08.420 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.435+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 info.flags=0x13 2019-12-09T10:04:08.420 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.435+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 to cache LRU end 2019-12-09T10:04:08.420 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.435+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:08.421 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.435+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:08.421 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.435+0000 7fa65eac8ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 2019-12-09T10:04:08.431 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.446+0000 7fa65eac8ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-copy.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.7]) start [] num_entries 1100 2019-12-09T10:04:08.460 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.474+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-12-09T10:04:08.460 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.474+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-12-09T10:04:08.460 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.474+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-12-09T10:04:08.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.474+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-12-09T10:04:08.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.474+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-12-09T10:04:08.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.474+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-12-09T10:04:08.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.474+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-12-09T10:04:08.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.474+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-12-09T10:04:08.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.474+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-12-09T10:04:08.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.474+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-12-09T10:04:08.462 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.474+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-12-09T10:04:08.462 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.474+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-12-09T10:04:08.462 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.474+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:08.474 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.488+0000 7fa65eac8ec0 10 manifest: total_size = 5242880 2019-12-09T10:04:08.474 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.488+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.108 2019-12-09T10:04:08.474 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.488+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:08.474 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.488+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:08.474 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.488+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 2019-12-09T10:04:08.618 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.633+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:08.618 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.633+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-09T10:04:08.619 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.633+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:08.619 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.633+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T10:04:08.619 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.633+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.108 2019-12-09T10:04:08.707 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.722+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:08.725 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.739+0000 7fa65eac8ec0 10 manifest: total_size = 5242880 2019-12-09T10:04:08.725 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.739+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.109 2019-12-09T10:04:08.725 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.739+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:08.725 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.739+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:08.725 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.739+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 2019-12-09T10:04:08.840 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.854+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:08.840 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.854+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-09T10:04:08.840 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.854+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:08.840 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.854+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T10:04:08.841 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.854+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.109 2019-12-09T10:04:08.914 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.929+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:08.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.940+0000 7fa65eac8ec0 10 manifest: total_size = 5242880 2019-12-09T10:04:08.926 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.940+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to _V_LYSzb6g5ykuNWX9lhtMKFDbqabz5C 2019-12-09T10:04:08.926 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.940+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:08.926 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.940+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:08.926 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:08.940+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 2019-12-09T10:04:09.060 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.075+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:09.061 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.075+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-09T10:04:09.061 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.075+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:09.061 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.075+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T10:04:09.061 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.075+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _V_LYSzb6g5ykuNWX9lhtMKFDbqabz5C 2019-12-09T10:04:09.109 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.124+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:09.118 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.132+0000 7fa65eac8ec0 10 manifest: total_size = 5242880 2019-12-09T10:04:09.118 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.132+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to _KuxecBV-63nhFoX_5zMk-2Hr7z4RIHx 2019-12-09T10:04:09.118 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.132+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:09.118 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.132+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:09.118 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.132+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 2019-12-09T10:04:09.202 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.217+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:09.203 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.217+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T10:04:09.203 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.217+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _KuxecBV-63nhFoX_5zMk-2Hr7z4RIHx 2019-12-09T10:04:09.291 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.305+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:09.301 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.316+0000 7fa65eac8ec0 10 manifest: total_size = 5242880 2019-12-09T10:04:09.301 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.316+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.112 2019-12-09T10:04:09.302 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.316+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:09.302 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.316+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:09.302 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.316+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 2019-12-09T10:04:09.387 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.401+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:09.387 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.401+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-09T10:04:09.387 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.401+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:09.387 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.401+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T10:04:09.387 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.401+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.112 2019-12-09T10:04:09.454 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.469+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:09.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.477+0000 7fa65eac8ec0 10 manifest: total_size = 5242880 2019-12-09T10:04:09.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.478+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to _TlvdcOOzZQf73R8x4YbIiaCHfN_MjwV 2019-12-09T10:04:09.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.478+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:09.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.478+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:09.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.478+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 2019-12-09T10:04:09.553 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.567+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:09.553 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.567+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-09T10:04:09.553 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.567+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:09.553 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.567+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T10:04:09.553 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.567+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _TlvdcOOzZQf73R8x4YbIiaCHfN_MjwV 2019-12-09T10:04:09.583 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.598+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:09.596 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.611+0000 7fa65eac8ec0 10 manifest: total_size = 5242880 2019-12-09T10:04:09.596 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.611+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.114 2019-12-09T10:04:09.596 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.611+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:09.596 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.611+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:09.597 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.611+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 2019-12-09T10:04:09.761 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.775+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:09.761 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.775+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-09T10:04:09.761 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.775+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:09.761 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.775+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T10:04:09.761 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.775+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.114 2019-12-09T10:04:09.852 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.867+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:09.864 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.879+0000 7fa65eac8ec0 10 manifest: total_size = 5242880 2019-12-09T10:04:09.865 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.879+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to _RgN6fdpIqRNa5ID3Z8-yNJpZLAZffxV 2019-12-09T10:04:09.865 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.879+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:09.865 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.879+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:09.865 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:09.879+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 2019-12-09T10:04:10.008 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.022+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:10.008 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.022+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T10:04:10.009 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.022+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _RgN6fdpIqRNa5ID3Z8-yNJpZLAZffxV 2019-12-09T10:04:10.076 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.090+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:10.091 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.105+0000 7fa65eac8ec0 10 manifest: total_size = 5242880 2019-12-09T10:04:10.091 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.105+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.116 2019-12-09T10:04:10.091 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.105+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:10.091 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.105+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:10.091 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.105+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 2019-12-09T10:04:10.198 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.213+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:10.199 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.213+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T10:04:10.199 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.213+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.116 2019-12-09T10:04:10.242 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.257+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:10.255 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.270+0000 7fa65eac8ec0 10 manifest: total_size = 5242880 2019-12-09T10:04:10.255 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.270+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to _9jblPwC6Oznpc8vy9ZNi27J4toJs3m3 2019-12-09T10:04:10.256 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.270+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:10.256 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.270+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:10.256 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.270+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 2019-12-09T10:04:10.404 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.418+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:10.404 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.418+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-09T10:04:10.404 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.418+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:10.404 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.418+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T10:04:10.404 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.418+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _9jblPwC6Oznpc8vy9ZNi27J4toJs3m3 2019-12-09T10:04:10.445 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.460+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:10.455 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.469+0000 7fa65eac8ec0 10 manifest: total_size = 5242880 2019-12-09T10:04:10.455 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.469+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to _a61aV3WeRNrgMgFKuQT576nK1MQizUf 2019-12-09T10:04:10.455 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.469+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:10.455 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.469+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:10.455 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.469+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 2019-12-09T10:04:10.604 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.618+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:10.604 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.618+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-09T10:04:10.604 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.618+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:10.605 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.618+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T10:04:10.605 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.618+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _a61aV3WeRNrgMgFKuQT576nK1MQizUf 2019-12-09T10:04:10.689 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.704+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:10.700 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.714+0000 7fa65eac8ec0 10 manifest: total_size = 5242880 2019-12-09T10:04:10.700 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.714+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.119 2019-12-09T10:04:10.700 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.714+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:10.700 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.714+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:10.701 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.714+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 2019-12-09T10:04:10.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.862+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:10.848 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.862+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-09T10:04:10.848 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.862+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.119 2019-12-09T10:04:10.917 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.932+0000 7fa65eac8ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-copy.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.7]) start _multipart_[] num_entries 1001 2019-12-09T10:04:10.917 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.932+0000 7fa65eac8ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T10:04:10.928 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:10.943+0000 7fa65eac8ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.7])"; objs.size()=0; is_truncated=0 2019-12-09T10:04:11.002 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:11.016+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987fead8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55e055d609d0 s->prefetch_data=0 2019-12-09T10:04:11.002 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:11.016+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T10:04:11.018 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:11.031+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x16 2019-12-09T10:04:11.019 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:11.031+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-12-09T10:04:11.019 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:11.031+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:11.019 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:11.031+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:11.019 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:11.031+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : hit (requested=0x11, cached=0x17) 2019-12-09T10:04:11.019 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:11.031+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2019-12-09T10:04:11.019 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:11.031+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=189 2019-12-09T10:04:11.036 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:11.051+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650380 cookie 94422000494432 notifier 4460 bl.length()=189 2019-12-09T10:04:11.652 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:11.666+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7 from cache 2019-12-09T10:04:11.652 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:11.666+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=246 2019-12-09T10:04:11.669 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:11.684+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650372 cookie 94422000501040 notifier 4460 bl.length()=246 2019-12-09T10:04:12.008 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.023+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55e055d60670 s->prefetch_data=0 2019-12-09T10:04:12.008 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.023+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2019-12-09T10:04:12.025 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.040+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x6 2019-12-09T10:04:12.025 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.040+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-12-09T10:04:12.025 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.040+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:12.026 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.040+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:12.026 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.040+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T10:04:12.026 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.040+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:12.041 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.056+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=237 2019-12-09T10:04:12.042 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.056+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x1 2019-12-09T10:04:12.042 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.056+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-12-09T10:04:12.042 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.056+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 state=0x55e055d609d0 s->prefetch_data=0 2019-12-09T10:04:12.042 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.056+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 : miss 2019-12-09T10:04:12.059 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.073+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 info.flags=0x16 2019-12-09T10:04:12.059 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.073+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 to cache LRU end 2019-12-09T10:04:12.059 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.073+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:12.060 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.073+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:12.060 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.073+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:12.060 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.073+0000 7fa65eac8ec0 20 Read xattr: user.rgw.acl 2019-12-09T10:04:12.060 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.073+0000 7fa65eac8ec0 20 Read xattr: user.rgw.idtag 2019-12-09T10:04:12.060 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.073+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 : type miss (requested=0x13, cached=0x16) 2019-12-09T10:04:12.060 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.073+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:12.079 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.093+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=329 2019-12-09T10:04:12.079 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.093+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 info.flags=0x13 2019-12-09T10:04:12.079 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.093+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 to cache LRU end 2019-12-09T10:04:12.079 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.093+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:12.080 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.093+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:12.080 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.094+0000 7fa65eac8ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 2019-12-09T10:04:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.133+0000 7fa65eac8ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.9]) start [] num_entries 1100 2019-12-09T10:04:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.165+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-12-09T10:04:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.165+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-12-09T10:04:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.165+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-12-09T10:04:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.165+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-12-09T10:04:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.165+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-12-09T10:04:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.165+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-12-09T10:04:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.165+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-12-09T10:04:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.165+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-12-09T10:04:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.165+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-12-09T10:04:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.165+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-12-09T10:04:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.165+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-12-09T10:04:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.165+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-12-09T10:04:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.165+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.182+0000 7fa65eac8ec0 10 manifest: total_size = 11534336 2019-12-09T10:04:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.182+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.225 2019-12-09T10:04:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.182+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:12.168 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.182+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab938 2019-12-09T10:04:12.168 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.182+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 2019-12-09T10:04:12.300 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.309+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:12.300 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.309+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:12.301 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.309+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:12.301 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.309+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:12.301 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.309+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:12.301 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.309+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:12.301 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.309+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:12.301 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.309+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:12.302 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.309+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:12.302 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.309+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:12.302 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.309+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:12.302 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.309+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-09T10:04:12.302 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.309+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-09T10:04:12.302 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.309+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-09T10:04:12.302 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.309+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-09T10:04:12.303 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.310+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.225 2019-12-09T10:04:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.367+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:12.369 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.384+0000 7fa65eac8ec0 10 manifest: total_size = 11534336 2019-12-09T10:04:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.384+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.226 2019-12-09T10:04:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.384+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.384+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab938 2019-12-09T10:04:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.384+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 2019-12-09T10:04:12.467 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.482+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.482+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.482+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.482+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:12.468 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.482+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.482+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.482+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.482+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.482+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:12.469 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.482+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:12.470 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.482+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:12.470 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.482+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-09T10:04:12.470 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.482+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-09T10:04:12.470 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.482+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-09T10:04:12.471 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.482+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-09T10:04:12.471 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.482+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.226 2019-12-09T10:04:12.541 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.556+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:12.553 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.567+0000 7fa65eac8ec0 10 manifest: total_size = 11534336 2019-12-09T10:04:12.553 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.567+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to _30-bccb5US_W4-S9ptyqhP224kp1GHg 2019-12-09T10:04:12.553 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.567+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:12.553 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.567+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab938 2019-12-09T10:04:12.553 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.567+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 2019-12-09T10:04:12.644 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.658+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:12.644 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.658+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-09T10:04:12.644 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.658+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:12.645 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.658+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-12-09T10:04:12.645 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.659+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:12.645 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.659+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-09T10:04:12.645 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.659+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _30-bccb5US_W4-S9ptyqhP224kp1GHg 2019-12-09T10:04:12.693 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.707+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:12.702 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.715+0000 7fa65eac8ec0 10 manifest: total_size = 11534336 2019-12-09T10:04:12.702 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.715+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to _hydaSHy8S_Po22RSCEsuY8WocuyFyn2 2019-12-09T10:04:12.702 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.715+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:12.702 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.715+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab938 2019-12-09T10:04:12.703 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.715+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 2019-12-09T10:04:12.793 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.806+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:12.793 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.806+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-12-09T10:04:12.793 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.806+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:12.793 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.806+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-09T10:04:12.793 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.806+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _hydaSHy8S_Po22RSCEsuY8WocuyFyn2 2019-12-09T10:04:12.843 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.857+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.865+0000 7fa65eac8ec0 10 manifest: total_size = 11534336 2019-12-09T10:04:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.865+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.234 2019-12-09T10:04:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.865+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.865+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab938 2019-12-09T10:04:12.853 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.865+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 2019-12-09T10:04:12.931 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.944+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:12.931 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.944+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:12.931 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.944+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:12.932 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.944+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:12.932 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.944+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:12.932 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.944+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:12.932 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.944+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:12.932 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.944+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:12.932 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.944+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:12.932 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.944+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.944+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.944+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-09T10:04:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.944+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-09T10:04:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.944+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-09T10:04:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.944+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-09T10:04:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:12.944+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.234 2019-12-09T10:04:13.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.017+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:13.012 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.026+0000 7fa65eac8ec0 10 manifest: total_size = 11534336 2019-12-09T10:04:13.013 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.026+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to _CAYivDzGgveju4hfnaptF1SXjorAyfR 2019-12-09T10:04:13.013 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.026+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:13.013 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.026+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab938 2019-12-09T10:04:13.013 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.026+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 2019-12-09T10:04:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.108+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.108+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-09T10:04:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.108+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.108+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-12-09T10:04:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.108+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.108+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-09T10:04:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.108+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _CAYivDzGgveju4hfnaptF1SXjorAyfR 2019-12-09T10:04:13.158 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.172+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:13.170 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.183+0000 7fa65eac8ec0 10 manifest: total_size = 11534336 2019-12-09T10:04:13.170 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.183+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.236 2019-12-09T10:04:13.170 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.183+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:13.170 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.183+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab938 2019-12-09T10:04:13.170 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.183+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 2019-12-09T10:04:13.267 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.280+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:13.267 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.280+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:13.267 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.280+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:13.267 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.280+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:13.267 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.280+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:13.267 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.280+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:13.268 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.280+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:13.268 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.280+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:13.268 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.280+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:13.268 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.280+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:13.268 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.280+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:13.268 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.280+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-09T10:04:13.268 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.280+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-09T10:04:13.269 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.280+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-09T10:04:13.269 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.280+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-09T10:04:13.269 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.280+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.236 2019-12-09T10:04:13.349 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.363+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:13.358 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.371+0000 7fa65eac8ec0 10 manifest: total_size = 11534336 2019-12-09T10:04:13.358 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.371+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to _CboP3y8NVETfguNSUUkW3pLuhOKDDVf 2019-12-09T10:04:13.358 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.371+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:13.358 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.371+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab938 2019-12-09T10:04:13.358 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.371+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 2019-12-09T10:04:13.446 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.460+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:13.446 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.460+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-12-09T10:04:13.447 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.460+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:13.447 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.460+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-09T10:04:13.447 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.460+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _CboP3y8NVETfguNSUUkW3pLuhOKDDVf 2019-12-09T10:04:13.504 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.518+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:13.518 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.531+0000 7fa65eac8ec0 10 manifest: total_size = 541681 2019-12-09T10:04:13.518 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.531+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.243 2019-12-09T10:04:13.518 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.531+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:13.518 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.531+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab938 2019-12-09T10:04:13.518 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.532+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 2019-12-09T10:04:13.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.638+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-09T10:04:13.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.638+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2019-12-09T10:04:13.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.638+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2019-12-09T10:04:13.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.638+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-09T10:04:13.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.638+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2019-12-09T10:04:13.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.638+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2019-12-09T10:04:13.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.638+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2019-12-09T10:04:13.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.638+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2019-12-09T10:04:13.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.638+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2019-12-09T10:04:13.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.638+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.243 2019-12-09T10:04:13.683 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.697+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:13.695 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.709+0000 7fa65eac8ec0 10 manifest: total_size = 541681 2019-12-09T10:04:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.709+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to __wJr9UGtsYFYVJlj1q15SKkwvtN1Ioc 2019-12-09T10:04:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.709+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.709+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab938 2019-12-09T10:04:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.709+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 2019-12-09T10:04:13.799 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.813+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:13.800 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.813+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2019-12-09T10:04:13.800 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.813+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: __wJr9UGtsYFYVJlj1q15SKkwvtN1Ioc 2019-12-09T10:04:13.865 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.878+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:13.877 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.891+0000 7fa65eac8ec0 10 manifest: total_size = 541681 2019-12-09T10:04:13.877 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.891+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to _WqXCXGgG-tLAIv2Nc3_xKnUXGc6jLlf 2019-12-09T10:04:13.878 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.891+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:13.878 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.891+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab938 2019-12-09T10:04:13.878 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:13.891+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 2019-12-09T10:04:14.005 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.019+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:14.005 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.019+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2019-12-09T10:04:14.006 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.019+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _WqXCXGgG-tLAIv2Nc3_xKnUXGc6jLlf 2019-12-09T10:04:14.104 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.117+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:14.114 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.127+0000 7fa65eac8ec0 10 manifest: total_size = 541681 2019-12-09T10:04:14.114 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.127+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.246 2019-12-09T10:04:14.114 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.127+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55e055cab938 s->prefetch_data=0 2019-12-09T10:04:14.114 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.127+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab938 2019-12-09T10:04:14.114 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.127+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 2019-12-09T10:04:14.243 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.257+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-09T10:04:14.243 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.257+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2019-12-09T10:04:14.244 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.257+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2019-12-09T10:04:14.244 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.257+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-09T10:04:14.244 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.257+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2019-12-09T10:04:14.244 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.257+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2019-12-09T10:04:14.244 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.257+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2019-12-09T10:04:14.244 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.257+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2019-12-09T10:04:14.244 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.257+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2019-12-09T10:04:14.245 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.257+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.246 2019-12-09T10:04:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.292+0000 7fa65eac8ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.9]) start _multipart_[] num_entries 1001 2019-12-09T10:04:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.292+0000 7fa65eac8ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T10:04:14.303 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.316+0000 7fa65eac8ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.9])"; objs.size()=0; is_truncated=0 2019-12-09T10:04:14.353 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.366+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987fead8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55e055d609d0 s->prefetch_data=0 2019-12-09T10:04:14.353 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.366+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T10:04:14.364 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.377+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x16 2019-12-09T10:04:14.364 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.377+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-12-09T10:04:14.364 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.377+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:14.364 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.377+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:14.364 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.377+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : hit (requested=0x11, cached=0x17) 2019-12-09T10:04:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.377+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2019-12-09T10:04:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.377+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=199 2019-12-09T10:04:14.375 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.389+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650370 cookie 94422000496064 notifier 4460 bl.length()=199 2019-12-09T10:04:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.714+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9 from cache 2019-12-09T10:04:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.714+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=256 2019-12-09T10:04:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:14.729+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650369 cookie 94422000502912 notifier 4460 bl.length()=256 2019-12-09T10:04:15.253 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.267+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55e055d60670 s->prefetch_data=0 2019-12-09T10:04:15.254 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.267+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2019-12-09T10:04:15.270 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.284+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x6 2019-12-09T10:04:15.270 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.284+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-12-09T10:04:15.270 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.284+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:15.271 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.284+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:15.271 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.284+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T10:04:15.271 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.284+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:15.285 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.299+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=232 2019-12-09T10:04:15.286 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.299+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x1 2019-12-09T10:04:15.286 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.299+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-12-09T10:04:15.286 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.299+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8 state=0x55e055d66570 s->prefetch_data=0 2019-12-09T10:04:15.286 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.299+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8 : miss 2019-12-09T10:04:15.306 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.319+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8 info.flags=0x16 2019-12-09T10:04:15.306 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.319+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8 to cache LRU end 2019-12-09T10:04:15.306 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.319+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:15.307 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.319+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:15.307 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.319+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:15.307 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.319+0000 7fa65eac8ec0 20 Read xattr: user.rgw.acl 2019-12-09T10:04:15.307 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.319+0000 7fa65eac8ec0 20 Read xattr: user.rgw.idtag 2019-12-09T10:04:15.307 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.319+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8 : type miss (requested=0x13, cached=0x16) 2019-12-09T10:04:15.307 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.319+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:15.335 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.349+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=324 2019-12-09T10:04:15.336 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.349+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8 info.flags=0x13 2019-12-09T10:04:15.336 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.349+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8 to cache LRU end 2019-12-09T10:04:15.336 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.349+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:15.336 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.349+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:15.336 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.349+0000 7fa65eac8ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8 2019-12-09T10:04:15.356 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.370+0000 7fa65eac8ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.8]) start [] num_entries 1100 2019-12-09T10:04:15.380 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.393+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-12-09T10:04:15.380 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.393+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-12-09T10:04:15.380 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.393+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-12-09T10:04:15.380 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.393+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:15.399 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.412+0000 7fa65eac8ec0 10 manifest: total_size = 11534336 2019-12-09T10:04:15.399 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.412+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.197 2019-12-09T10:04:15.399 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.412+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:15.399 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.412+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:15.399 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.412+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.8 2019-12-09T10:04:15.561 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.574+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:15.561 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.574+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:15.561 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.574+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:15.562 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.574+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:15.562 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.574+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:15.562 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.574+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:15.562 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.574+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:15.562 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.574+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:15.562 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.574+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:15.562 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.574+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:15.563 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.574+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:15.563 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.574+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-09T10:04:15.563 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.574+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-09T10:04:15.563 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.574+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-09T10:04:15.563 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.574+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-09T10:04:15.563 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.574+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.197 2019-12-09T10:04:15.627 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.640+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:15.636 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.649+0000 7fa65eac8ec0 10 manifest: total_size = 11534336 2019-12-09T10:04:15.636 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.649+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.204 2019-12-09T10:04:15.636 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.649+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:15.636 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.649+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:15.636 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.649+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.8 2019-12-09T10:04:15.754 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.767+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:15.754 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.767+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:15.754 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.767+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:15.754 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.767+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:15.754 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.767+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-09T10:04:15.754 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.767+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:15.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.767+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:15.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.767+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:15.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.767+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:15.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.767+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-09T10:04:15.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.767+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-09T10:04:15.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.767+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-09T10:04:15.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.767+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-09T10:04:15.756 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.767+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-09T10:04:15.756 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.767+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-09T10:04:15.756 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.767+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.204 2019-12-09T10:04:15.820 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.833+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:15.830 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.844+0000 7fa65eac8ec0 10 manifest: total_size = 541681 2019-12-09T10:04:15.830 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.844+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.211 2019-12-09T10:04:15.830 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.844+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:15.830 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.844+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:15.831 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.844+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.8 2019-12-09T10:04:15.938 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.951+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-09T10:04:15.938 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.951+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2019-12-09T10:04:15.938 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.951+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2019-12-09T10:04:15.939 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.951+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-09T10:04:15.939 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.951+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2019-12-09T10:04:15.939 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.951+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2019-12-09T10:04:15.939 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.951+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2019-12-09T10:04:15.939 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.951+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2019-12-09T10:04:15.939 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.951+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2019-12-09T10:04:15.940 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:15.951+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.211 2019-12-09T10:04:16.014 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.028+0000 7fa65eac8ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.8]) start _multipart_[] num_entries 1001 2019-12-09T10:04:16.014 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.028+0000 7fa65eac8ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T10:04:16.026 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.040+0000 7fa65eac8ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.8])"; objs.size()=0; is_truncated=0 2019-12-09T10:04:16.088 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.101+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987fead8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55e055d66570 s->prefetch_data=0 2019-12-09T10:04:16.088 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.101+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T10:04:16.107 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.121+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x16 2019-12-09T10:04:16.108 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.121+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-12-09T10:04:16.108 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.121+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:16.108 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.121+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:16.108 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.121+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : hit (requested=0x11, cached=0x17) 2019-12-09T10:04:16.108 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.121+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2019-12-09T10:04:16.108 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.121+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=194 2019-12-09T10:04:16.123 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.137+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650373 cookie 94422000501040 notifier 4460 bl.length()=194 2019-12-09T10:04:16.344 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.358+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8 from cache 2019-12-09T10:04:16.344 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.358+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=251 2019-12-09T10:04:16.354 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.368+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650370 cookie 94422000502912 notifier 4460 bl.length()=251 2019-12-09T10:04:16.867 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.880+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55e055d60670 s->prefetch_data=0 2019-12-09T10:04:16.867 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.880+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2019-12-09T10:04:16.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.893+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x6 2019-12-09T10:04:16.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.893+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-12-09T10:04:16.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.893+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:16.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.893+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:16.880 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.893+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T10:04:16.880 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.893+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:16.889 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.903+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=222 2019-12-09T10:04:16.890 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.903+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x1 2019-12-09T10:04:16.890 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.903+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-12-09T10:04:16.890 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.903+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.6 state=0x55e055cac3e0 s->prefetch_data=0 2019-12-09T10:04:16.890 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.903+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.6 : miss 2019-12-09T10:04:16.915 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.929+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.6 info.flags=0x16 2019-12-09T10:04:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.929+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.6 to cache LRU end 2019-12-09T10:04:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.929+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.929+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.929+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.929+0000 7fa65eac8ec0 20 Read xattr: user.rgw.acl 2019-12-09T10:04:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.929+0000 7fa65eac8ec0 20 Read xattr: user.rgw.idtag 2019-12-09T10:04:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.929+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.6 : type miss (requested=0x13, cached=0x16) 2019-12-09T10:04:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.929+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:16.941 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.954+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=314 2019-12-09T10:04:16.941 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.955+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.6 info.flags=0x13 2019-12-09T10:04:16.941 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.955+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.6 to cache LRU end 2019-12-09T10:04:16.941 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.955+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:16.942 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.955+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:16.942 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.955+0000 7fa65eac8ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.6 2019-12-09T10:04:16.963 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.976+0000 7fa65eac8ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.6]) start [] num_entries 1100 2019-12-09T10:04:16.983 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.997+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-12-09T10:04:16.983 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.997+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-12-09T10:04:16.983 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.997+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-12-09T10:04:16.984 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:16.997+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:17.001 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.014+0000 7fa65eac8ec0 10 manifest: total_size = 10485760 2019-12-09T10:04:17.001 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.014+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.84 2019-12-09T10:04:17.001 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.014+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:17.001 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.014+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:17.001 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.014+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.6 2019-12-09T10:04:17.142 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.156+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:17.142 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.156+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-09T10:04:17.142 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.156+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.156+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-12-09T10:04:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.156+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.156+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-12-09T10:04:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.156+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.84 2019-12-09T10:04:17.251 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.264+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:17.259 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.273+0000 7fa65eac8ec0 10 manifest: total_size = 10485760 2019-12-09T10:04:17.259 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.273+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.85 2019-12-09T10:04:17.260 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.273+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:17.260 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.273+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:17.260 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.273+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.6 2019-12-09T10:04:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.375+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.375+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-12-09T10:04:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.375+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.375+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-12-09T10:04:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.375+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-09T10:04:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.375+0000 7fa65eac8ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-12-09T10:04:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.375+0000 7fa65eac8ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: a55fd90f-db62-40cd-9264-5916c91f1695.4530.85 2019-12-09T10:04:17.427 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.441+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:17.444 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.458+0000 7fa65eac8ec0 10 manifest: total_size = 44258 2019-12-09T10:04:17.444 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.458+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.86 2019-12-09T10:04:17.445 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.458+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:17.445 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.458+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:17.445 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.458+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.6 2019-12-09T10:04:17.547 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.560+0000 7fa65eac8ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.6]) start _multipart_[] num_entries 1001 2019-12-09T10:04:17.547 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.560+0000 7fa65eac8ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T10:04:17.632 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.645+0000 7fa65eac8ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.6])"; objs.size()=0; is_truncated=0 2019-12-09T10:04:17.719 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.732+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987fead8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55e055d60670 s->prefetch_data=0 2019-12-09T10:04:17.719 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.732+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T10:04:17.740 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.753+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x16 2019-12-09T10:04:17.740 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.753+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-12-09T10:04:17.740 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.753+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:17.740 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.753+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:17.740 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.753+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : hit (requested=0x11, cached=0x17) 2019-12-09T10:04:17.741 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.753+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2019-12-09T10:04:17.741 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.753+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=184 2019-12-09T10:04:17.756 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:17.770+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650381 cookie 94422000494432 notifier 4460 bl.length()=184 2019-12-09T10:04:18.093 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.106+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.6 from cache 2019-12-09T10:04:18.093 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.106+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=241 2019-12-09T10:04:18.108 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.122+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650371 cookie 94422000496064 notifier 4460 bl.length()=241 2019-12-09T10:04:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.406+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55e055d60670 s->prefetch_data=0 2019-12-09T10:04:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.406+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2019-12-09T10:04:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.418+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x6 2019-12-09T10:04:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.418+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-12-09T10:04:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.418+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.418+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.418+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x1, cached=0x6) 2019-12-09T10:04:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.418+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:18.422 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.436+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=221 2019-12-09T10:04:18.422 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.436+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x1 2019-12-09T10:04:18.422 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.436+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-12-09T10:04:18.423 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.436+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.10 state=0x55e055cac3e0 s->prefetch_data=0 2019-12-09T10:04:18.423 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.436+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.10 : miss 2019-12-09T10:04:18.441 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.454+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.10 info.flags=0x16 2019-12-09T10:04:18.441 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.454+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.10 to cache LRU end 2019-12-09T10:04:18.441 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.454+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:18.441 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.454+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:18.441 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.454+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.454+0000 7fa65eac8ec0 20 Read xattr: user.rgw.acl 2019-12-09T10:04:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.454+0000 7fa65eac8ec0 20 Read xattr: user.rgw.idtag 2019-12-09T10:04:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.454+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.10 : type miss (requested=0x13, cached=0x16) 2019-12-09T10:04:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.454+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:18.458 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.471+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=313 2019-12-09T10:04:18.458 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.471+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.10 info.flags=0x13 2019-12-09T10:04:18.459 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.471+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.10 to cache LRU end 2019-12-09T10:04:18.459 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.471+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:18.459 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.471+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:18.459 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.471+0000 7fa65eac8ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.10 2019-12-09T10:04:18.474 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.488+0000 7fa65eac8ec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.10]) start [] num_entries 1100 2019-12-09T10:04:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.529+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-12-09T10:04:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.529+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-12-09T10:04:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.529+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-12-09T10:04:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.529+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-12-09T10:04:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.529+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:18.535 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.549+0000 7fa65eac8ec0 10 manifest: total_size = 4134 2019-12-09T10:04:18.535 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.549+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.306 2019-12-09T10:04:18.535 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.549+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:18.536 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.549+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:18.536 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.549+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.10 2019-12-09T10:04:18.637 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.650+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:18.652 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.665+0000 7fa65eac8ec0 10 manifest: total_size = 4134 2019-12-09T10:04:18.652 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.665+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.308 2019-12-09T10:04:18.652 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.665+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:18.652 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.665+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:18.653 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.665+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.10 2019-12-09T10:04:18.790 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.803+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55e055cab758 s->prefetch_data=0 2019-12-09T10:04:18.811 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.824+0000 7fa65eac8ec0 10 manifest: total_size = 110 2019-12-09T10:04:18.811 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.824+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.307 2019-12-09T10:04:18.811 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.824+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55e055cab758 s->prefetch_data=0 2019-12-09T10:04:18.811 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.824+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab758 2019-12-09T10:04:18.812 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.824+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.10 2019-12-09T10:04:18.954 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.967+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:18.973 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.986+0000 7fa65eac8ec0 10 manifest: total_size = 1048576 2019-12-09T10:04:18.973 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.986+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.305 2019-12-09T10:04:18.973 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.986+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55e055d65ec8 s->prefetch_data=0 2019-12-09T10:04:18.973 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.986+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055d65ec8 2019-12-09T10:04:18.973 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:18.986+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.10 2019-12-09T10:04:19.138 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:19.152+0000 7fa65eac8ec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.10]) start _multipart_[] num_entries 1001 2019-12-09T10:04:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:19.152+0000 7fa65eac8ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T10:04:19.234 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:19.248+0000 7fa65eac8ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[a55fd90f-db62-40cd-9264-5916c91f1695.4358.10])"; objs.size()=0; is_truncated=0 2019-12-09T10:04:19.323 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:19.337+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987fead8 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55e055cac3e0 s->prefetch_data=0 2019-12-09T10:04:19.324 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:19.337+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x16, cached=0x3) 2019-12-09T10:04:19.355 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:19.368+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x16 2019-12-09T10:04:19.355 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:19.368+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-12-09T10:04:19.355 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:19.368+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:19.355 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:19.368+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:19.355 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:19.368+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : hit (requested=0x11, cached=0x17) 2019-12-09T10:04:19.356 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:19.368+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2019-12-09T10:04:19.356 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:19.368+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-12-09T10:04:19.371 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:19.385+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650374 cookie 94422000492560 notifier 4460 bl.length()=181 2019-12-09T10:04:19.920 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:19.933+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a55fd90f-db62-40cd-9264-5916c91f1695.4358.10 from cache 2019-12-09T10:04:19.920 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:19.933+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=239 2019-12-09T10:04:19.929 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:19.943+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650375 cookie 94422000501040 notifier 4460 bl.length()=239 2019-12-09T10:04:20.212 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.226+0000 7fa59ffff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T10:04:20.372 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.386+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55e055d60670 s->prefetch_data=0 2019-12-09T10:04:20.373 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.386+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2019-12-09T10:04:20.381 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.395+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x6 2019-12-09T10:04:20.382 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.395+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-12-09T10:04:20.382 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.395+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:20.382 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.395+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:20.382 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.395+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x1, cached=0x6) 2019-12-09T10:04:20.382 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.395+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:20.389 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.403+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=221 2019-12-09T10:04:20.389 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.403+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x1 2019-12-09T10:04:20.389 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.403+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-12-09T10:04:20.389 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.403+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:a55fd90f-db62-40cd-9264-5916c91f1695.4358.11 state=0x55e055cac3e0 s->prefetch_data=0 2019-12-09T10:04:20.390 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.403+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a55fd90f-db62-40cd-9264-5916c91f1695.4358.11 : miss 2019-12-09T10:04:20.400 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.413+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a55fd90f-db62-40cd-9264-5916c91f1695.4358.11 info.flags=0x16 2019-12-09T10:04:20.400 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.413+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a55fd90f-db62-40cd-9264-5916c91f1695.4358.11 to cache LRU end 2019-12-09T10:04:20.400 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.413+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:20.400 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.413+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:20.401 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.413+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:20.401 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.413+0000 7fa65eac8ec0 20 Read xattr: user.rgw.acl 2019-12-09T10:04:20.401 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.413+0000 7fa65eac8ec0 20 Read xattr: user.rgw.idtag 2019-12-09T10:04:20.401 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.413+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a55fd90f-db62-40cd-9264-5916c91f1695.4358.11 : type miss (requested=0x13, cached=0x16) 2019-12-09T10:04:20.401 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.413+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:20.413 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.426+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=313 2019-12-09T10:04:20.413 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.426+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a55fd90f-db62-40cd-9264-5916c91f1695.4358.11 info.flags=0x13 2019-12-09T10:04:20.413 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.426+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a55fd90f-db62-40cd-9264-5916c91f1695.4358.11 to cache LRU end 2019-12-09T10:04:20.413 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.426+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:20.413 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.426+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:20.414 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.426+0000 7fa65eac8ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a55fd90f-db62-40cd-9264-5916c91f1695.4358.11 2019-12-09T10:04:20.427 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.441+0000 7fa65eac8ec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.2[a55fd90f-db62-40cd-9264-5916c91f1695.4358.11]) start [] num_entries 1100 2019-12-09T10:04:20.471 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.484+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-12-09T10:04:20.471 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.484+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-12-09T10:04:20.471 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.484+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-12-09T10:04:20.471 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.484+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-12-09T10:04:20.471 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.484+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55e055cab158 s->prefetch_data=0 2019-12-09T10:04:20.488 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.501+0000 7fa65eac8ec0 10 manifest: total_size = 62 2019-12-09T10:04:20.488 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.501+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.313 2019-12-09T10:04:20.488 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.501+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55e055cab158 s->prefetch_data=0 2019-12-09T10:04:20.488 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.501+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab158 2019-12-09T10:04:20.488 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.501+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.11 2019-12-09T10:04:20.639 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.652+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55e055cab158 s->prefetch_data=0 2019-12-09T10:04:20.651 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.664+0000 7fa65eac8ec0 10 manifest: total_size = 524288 2019-12-09T10:04:20.651 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.664+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.315 2019-12-09T10:04:20.651 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.664+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55e055cab158 s->prefetch_data=0 2019-12-09T10:04:20.651 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.664+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab158 2019-12-09T10:04:20.651 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.664+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.11 2019-12-09T10:04:20.802 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.816+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55e055cab158 s->prefetch_data=0 2019-12-09T10:04:20.816 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.830+0000 7fa65eac8ec0 10 manifest: total_size = 524288 2019-12-09T10:04:20.816 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.830+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.314 2019-12-09T10:04:20.817 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.830+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55e055cab158 s->prefetch_data=0 2019-12-09T10:04:20.817 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.830+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab158 2019-12-09T10:04:20.817 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.830+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.11 2019-12-09T10:04:20.983 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:20.997+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55e055cab158 s->prefetch_data=0 2019-12-09T10:04:20.993 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.007+0000 7fa65eac8ec0 10 manifest: total_size = 527 2019-12-09T10:04:20.993 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.007+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.312 2019-12-09T10:04:20.993 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.007+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55e055cab158 s->prefetch_data=0 2019-12-09T10:04:20.994 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.007+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab158 2019-12-09T10:04:20.994 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.007+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.11 2019-12-09T10:04:21.182 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.195+0000 7fa65eac8ec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.2[a55fd90f-db62-40cd-9264-5916c91f1695.4358.11]) start _multipart_[] num_entries 1001 2019-12-09T10:04:21.182 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.195+0000 7fa65eac8ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T10:04:21.241 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.255+0000 7fa65eac8ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[a55fd90f-db62-40cd-9264-5916c91f1695.4358.11])"; objs.size()=0; is_truncated=0 2019-12-09T10:04:21.297 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.310+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987fead8 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55e055d610e0 s->prefetch_data=0 2019-12-09T10:04:21.297 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.310+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x16, cached=0x3) 2019-12-09T10:04:21.323 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.336+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x16 2019-12-09T10:04:21.323 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.336+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-12-09T10:04:21.323 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.336+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:21.323 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.336+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:21.323 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.336+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : hit (requested=0x11, cached=0x17) 2019-12-09T10:04:21.323 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.336+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2019-12-09T10:04:21.324 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.336+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-12-09T10:04:21.336 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.349+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650376 cookie 94422000492560 notifier 4460 bl.length()=181 2019-12-09T10:04:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.570+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a55fd90f-db62-40cd-9264-5916c91f1695.4358.11 from cache 2019-12-09T10:04:21.557 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.570+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=239 2019-12-09T10:04:21.570 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.583+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650377 cookie 94422000501040 notifier 4460 bl.length()=239 2019-12-09T10:04:21.822 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.836+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55e055d60670 s->prefetch_data=0 2019-12-09T10:04:21.823 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.836+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2019-12-09T10:04:21.844 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.857+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x6 2019-12-09T10:04:21.844 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.857+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-12-09T10:04:21.844 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.857+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:21.844 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.857+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:21.844 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.857+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x1, cached=0x6) 2019-12-09T10:04:21.845 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.857+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:21.855 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.868+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=221 2019-12-09T10:04:21.855 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.868+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x1 2019-12-09T10:04:21.855 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.868+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-12-09T10:04:21.855 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.868+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987ff120 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:a55fd90f-db62-40cd-9264-5916c91f1695.4358.12 state=0x55e055caac40 s->prefetch_data=0 2019-12-09T10:04:21.856 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.868+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a55fd90f-db62-40cd-9264-5916c91f1695.4358.12 : miss 2019-12-09T10:04:21.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.884+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a55fd90f-db62-40cd-9264-5916c91f1695.4358.12 info.flags=0x16 2019-12-09T10:04:21.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.884+0000 7fa65eac8ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a55fd90f-db62-40cd-9264-5916c91f1695.4358.12 to cache LRU end 2019-12-09T10:04:21.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.884+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:21.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.884+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:21.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.884+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:21.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.884+0000 7fa65eac8ec0 20 Read xattr: user.rgw.acl 2019-12-09T10:04:21.872 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.884+0000 7fa65eac8ec0 20 Read xattr: user.rgw.idtag 2019-12-09T10:04:21.872 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.884+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a55fd90f-db62-40cd-9264-5916c91f1695.4358.12 : type miss (requested=0x13, cached=0x16) 2019-12-09T10:04:21.872 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.884+0000 7fa65eac8ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:21.905 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.918+0000 7fa65eac8ec0 20 rados_obj.operate() r=0 bl.length=313 2019-12-09T10:04:21.905 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.918+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a55fd90f-db62-40cd-9264-5916c91f1695.4358.12 info.flags=0x13 2019-12-09T10:04:21.905 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.918+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a55fd90f-db62-40cd-9264-5916c91f1695.4358.12 to cache LRU end 2019-12-09T10:04:21.905 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.918+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:21.906 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.918+0000 7fa65eac8ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-09T10:04:21.906 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.918+0000 7fa65eac8ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a55fd90f-db62-40cd-9264-5916c91f1695.4358.12 2019-12-09T10:04:21.936 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.949+0000 7fa65eac8ec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.3[a55fd90f-db62-40cd-9264-5916c91f1695.4358.12]) start [] num_entries 1100 2019-12-09T10:04:21.950 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.963+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-12-09T10:04:21.950 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.963+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-12-09T10:04:21.950 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.963+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-12-09T10:04:21.950 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.963+0000 7fa65eac8ec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-12-09T10:04:21.950 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.963+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55e055cab158 s->prefetch_data=0 2019-12-09T10:04:21.964 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.978+0000 7fa65eac8ec0 10 manifest: total_size = 0 2019-12-09T10:04:21.964 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.978+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.320 2019-12-09T10:04:21.965 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.978+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55e055cab158 s->prefetch_data=0 2019-12-09T10:04:21.965 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.978+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab158 2019-12-09T10:04:21.965 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:21.978+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.12 2019-12-09T10:04:22.053 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.067+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55e055cab158 s->prefetch_data=0 2019-12-09T10:04:22.063 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.077+0000 7fa65eac8ec0 10 manifest: total_size = 0 2019-12-09T10:04:22.064 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.077+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.322 2019-12-09T10:04:22.064 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.077+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55e055cab158 s->prefetch_data=0 2019-12-09T10:04:22.064 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.077+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab158 2019-12-09T10:04:22.064 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.077+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.12 2019-12-09T10:04:22.174 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.187+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55e055cab158 s->prefetch_data=0 2019-12-09T10:04:22.191 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.204+0000 7fa65eac8ec0 10 manifest: total_size = 0 2019-12-09T10:04:22.191 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.204+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.321 2019-12-09T10:04:22.191 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.204+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55e055cab158 s->prefetch_data=0 2019-12-09T10:04:22.191 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.204+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab158 2019-12-09T10:04:22.191 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.204+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.12 2019-12-09T10:04:22.350 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.364+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55e055cab158 s->prefetch_data=0 2019-12-09T10:04:22.370 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.380+0000 7fa65eac8ec0 10 manifest: total_size = 0 2019-12-09T10:04:22.370 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.380+0000 7fa65eac8ec0 20 get_obj_state: setting s->obj_tag to a55fd90f-db62-40cd-9264-5916c91f1695.4530.319 2019-12-09T10:04:22.371 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.380+0000 7fa65eac8ec0 20 get_obj_state: rctx=0x7ffd987ff140 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55e055cab158 s->prefetch_data=0 2019-12-09T10:04:22.371 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.380+0000 7fa65eac8ec0 20 prepare_atomic_modification: state is not atomic. state=0x55e055cab158 2019-12-09T10:04:22.371 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.380+0000 7fa65eac8ec0 20 bucket index object: default.rgw.buckets.index:.dir.a55fd90f-db62-40cd-9264-5916c91f1695.4358.12 2019-12-09T10:04:22.494 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.507+0000 7fa65eac8ec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.3[a55fd90f-db62-40cd-9264-5916c91f1695.4358.12]) start _multipart_[] num_entries 1001 2019-12-09T10:04:22.494 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.507+0000 7fa65eac8ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-09T10:04:22.580 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.594+0000 7fa65eac8ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[a55fd90f-db62-40cd-9264-5916c91f1695.4358.12])"; objs.size()=0; is_truncated=0 2019-12-09T10:04:22.645 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.659+0000 7fa65eac8ec0 20 get_system_obj_state: rctx=0x7ffd987fead8 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55e055caac40 s->prefetch_data=0 2019-12-09T10:04:22.645 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.659+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x16, cached=0x3) 2019-12-09T10:04:22.668 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.681+0000 7fa65eac8ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x16 2019-12-09T10:04:22.668 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.681+0000 7fa65eac8ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-12-09T10:04:22.668 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.681+0000 7fa65eac8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T10:04:22.668 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.681+0000 7fa65eac8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T10:04:22.668 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.681+0000 7fa65eac8ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : hit (requested=0x11, cached=0x17) 2019-12-09T10:04:22.669 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.681+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2019-12-09T10:04:22.669 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.681+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-12-09T10:04:22.683 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:22.697+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650378 cookie 94422000492560 notifier 4460 bl.length()=181 2019-12-09T10:04:23.178 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:23.192+0000 7fa65eac8ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a55fd90f-db62-40cd-9264-5916c91f1695.4358.12 from cache 2019-12-09T10:04:23.178 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:23.192+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=239 2019-12-09T10:04:23.196 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:23.209+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650379 cookie 94422000501040 notifier 4460 bl.length()=239 2019-12-09T10:04:23.787 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:23.801+0000 7fa65eac8ec0 10 removing key index: ZMTZVZSPMALOUKDPIJOA 2019-12-09T10:04:23.787 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:23.801+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=170 2019-12-09T10:04:23.799 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:23.812+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650371 cookie 94422000502912 notifier 4460 bl.length()=170 2019-12-09T10:04:24.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:24.207+0000 7fa65eac8ec0 10 removing email index: ragweed.client.0+test@test.test 2019-12-09T10:04:24.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:24.207+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=182 2019-12-09T10:04:24.212 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:24.225+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650382 cookie 94422000494432 notifier 4460 bl.length()=182 2019-12-09T10:04:24.326 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:24.340+0000 7fa65eac8ec0 10 removing user buckets index 2019-12-09T10:04:24.326 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:24.340+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=173 2019-12-09T10:04:24.336 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:24.350+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650380 cookie 94422000501040 notifier 4460 bl.length()=173 2019-12-09T10:04:24.527 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:24.540+0000 7fa65eac8ec0 10 removing user index: ragweed.client.0 2019-12-09T10:04:24.527 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:24.540+0000 7fa65eac8ec0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2019-12-09T10:04:24.527 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:24.540+0000 7fa65eac8ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=165 2019-12-09T10:04:24.548 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:24.561+0000 7fa6317fa700 10 RGWWatcher::handle_notify() notify_id 571230650383 cookie 94422000499056 notifier 4460 bl.length()=165 2019-12-09T10:04:25.510 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:25.523+0000 7fa65eac8ec0 20 remove_watcher() i=0 2019-12-09T10:04:25.510 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:25.523+0000 7fa65eac8ec0 2 removed watcher, disabling cache 2019-12-09T10:04:25.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:25.571+0000 7fa65eac8ec0 20 remove_watcher() i=1 2019-12-09T10:04:25.611 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:25.624+0000 7fa65eac8ec0 20 remove_watcher() i=2 2019-12-09T10:04:25.660 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:25.673+0000 7fa65eac8ec0 20 remove_watcher() i=3 2019-12-09T10:04:25.714 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:25.727+0000 7fa65eac8ec0 20 remove_watcher() i=4 2019-12-09T10:04:25.758 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:25.771+0000 7fa65eac8ec0 20 remove_watcher() i=5 2019-12-09T10:04:25.846 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:25.860+0000 7fa65eac8ec0 20 remove_watcher() i=6 2019-12-09T10:04:25.890 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:25.904+0000 7fa65eac8ec0 20 remove_watcher() i=7 2019-12-09T10:04:25.897 INFO:tasks.ragweed:Removing ragweed... 2019-12-09T10:04:25.898 INFO:teuthology.orchestra.run.smithi121:> rm -rf /home/ubuntu/cephtest/ragweed 2019-12-09T10:04:25.989 INFO:teuthology.run_tasks:Running task s3tests-java... 2019-12-09T10:04:26.005 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2019-12-09T10:04:26.005 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2019-12-09T10:04:26.005 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2019-12-09T10:04:26.006 INFO:teuthology.orchestra.run.smithi121:> git clone -b master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2019-12-09T10:04:26.052 INFO:teuthology.orchestra.run.smithi121.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2019-12-09T10:04:29.906 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2019-12-09T10:04:29.906 INFO:teuthology.orchestra.run.smithi121:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2019-12-09T10:04:32.195 INFO:teuthology.orchestra.run.smithi121.stdout: Gradle will be installed under /opt/gradle 2019-12-09T10:04:32.268 INFO:teuthology.orchestra.run.smithi121.stderr:--2019-12-09 10:04:32-- https://services.gradle.org/distributions/gradle-4.7-bin.zip 2019-12-09T10:04:32.275 INFO:teuthology.orchestra.run.smithi121.stderr:Resolving services.gradle.org (services.gradle.org)... 104.18.191.9, 104.18.190.9, 2606:4700::6812:be09, ... 2019-12-09T10:04:32.284 INFO:teuthology.orchestra.run.smithi121.stderr:Connecting to services.gradle.org (services.gradle.org)|104.18.191.9|:443... connected. 2019-12-09T10:04:32.318 INFO:teuthology.orchestra.run.smithi121.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2019-12-09T10:04:32.318 INFO:teuthology.orchestra.run.smithi121.stderr:Location: https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip [following] 2019-12-09T10:04:32.319 INFO:teuthology.orchestra.run.smithi121.stderr:--2019-12-09 10:04:32-- https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip 2019-12-09T10:04:32.319 INFO:teuthology.orchestra.run.smithi121.stderr:Resolving downloads.gradle-dn.com (downloads.gradle-dn.com)... 104.17.160.20, 104.17.159.20, 2606:4700::6811:a014, ... 2019-12-09T10:04:32.327 INFO:teuthology.orchestra.run.smithi121.stderr:Connecting to downloads.gradle-dn.com (downloads.gradle-dn.com)|104.17.160.20|:443... connected. 2019-12-09T10:04:32.364 INFO:teuthology.orchestra.run.smithi121.stderr:HTTP request sent, awaiting response... 200 OK 2019-12-09T10:04:32.364 INFO:teuthology.orchestra.run.smithi121.stderr:Length: 75323957 (72M) [application/zip] 2019-12-09T10:04:32.364 INFO:teuthology.orchestra.run.smithi121.stderr:Saving to: ‘gradle-4.7-bin.zip’ 2019-12-09T10:04:32.364 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T10:04:32.371 INFO:teuthology.orchestra.run.smithi121.stderr: 0K .......... .......... .......... .......... .......... 0% 6.55M 11s 2019-12-09T10:04:32.373 INFO:teuthology.orchestra.run.smithi121.stderr: 50K .......... .......... .......... .......... .......... 0% 119M 6s 2019-12-09T10:04:32.378 INFO:teuthology.orchestra.run.smithi121.stderr: 100K .......... .......... .......... .......... .......... 0% 7.11M 7s 2019-12-09T10:04:32.381 INFO:teuthology.orchestra.run.smithi121.stderr: 150K .......... .......... .......... .......... .......... 0% 143M 6s 2019-12-09T10:04:32.381 INFO:teuthology.orchestra.run.smithi121.stderr: 200K .......... .......... .......... .......... .......... 0% 113M 5s 2019-12-09T10:04:32.382 INFO:teuthology.orchestra.run.smithi121.stderr: 250K .......... .......... .......... .......... .......... 0% 136M 4s 2019-12-09T10:04:32.382 INFO:teuthology.orchestra.run.smithi121.stderr: 300K .......... .......... .......... .......... .......... 0% 123M 3s 2019-12-09T10:04:32.388 INFO:teuthology.orchestra.run.smithi121.stderr: 350K .......... .......... .......... .......... .......... 0% 7.78M 4s 2019-12-09T10:04:32.388 INFO:teuthology.orchestra.run.smithi121.stderr: 400K .......... .......... .......... .......... .......... 0% 135M 4s 2019-12-09T10:04:32.388 INFO:teuthology.orchestra.run.smithi121.stderr: 450K .......... .......... .......... .......... .......... 0% 127M 3s 2019-12-09T10:04:32.388 INFO:teuthology.orchestra.run.smithi121.stderr: 500K .......... .......... .......... .......... .......... 0% 118M 3s 2019-12-09T10:04:32.402 INFO:teuthology.orchestra.run.smithi121.stderr: 550K .......... .......... .......... .......... .......... 0% 114M 3s 2019-12-09T10:04:32.402 INFO:teuthology.orchestra.run.smithi121.stderr: 600K .......... .......... .......... .......... .......... 0% 121M 3s 2019-12-09T10:04:32.402 INFO:teuthology.orchestra.run.smithi121.stderr: 650K .......... .......... .......... .......... .......... 0% 123M 3s 2019-12-09T10:04:32.402 INFO:teuthology.orchestra.run.smithi121.stderr: 700K .......... .......... .......... .......... .......... 1% 136M 2s 2019-12-09T10:04:32.403 INFO:teuthology.orchestra.run.smithi121.stderr: 750K .......... .......... .......... .......... .......... 1% 10.5M 3s 2019-12-09T10:04:32.403 INFO:teuthology.orchestra.run.smithi121.stderr: 800K .......... .......... .......... .......... .......... 1% 143M 3s 2019-12-09T10:04:32.403 INFO:teuthology.orchestra.run.smithi121.stderr: 850K .......... .......... .......... .......... .......... 1% 147M 2s 2019-12-09T10:04:32.403 INFO:teuthology.orchestra.run.smithi121.stderr: 900K .......... .......... .......... .......... .......... 1% 151M 2s 2019-12-09T10:04:32.403 INFO:teuthology.orchestra.run.smithi121.stderr: 950K .......... .......... .......... .......... .......... 1% 93.0M 2s 2019-12-09T10:04:32.403 INFO:teuthology.orchestra.run.smithi121.stderr: 1000K .......... .......... .......... .......... .......... 1% 167M 2s 2019-12-09T10:04:32.403 INFO:teuthology.orchestra.run.smithi121.stderr: 1050K .......... .......... .......... .......... .......... 1% 121M 2s 2019-12-09T10:04:32.404 INFO:teuthology.orchestra.run.smithi121.stderr: 1100K .......... .......... .......... .......... .......... 1% 116M 2s 2019-12-09T10:04:32.404 INFO:teuthology.orchestra.run.smithi121.stderr: 1150K .......... .......... .......... .......... .......... 1% 113M 2s 2019-12-09T10:04:32.404 INFO:teuthology.orchestra.run.smithi121.stderr: 1200K .......... .......... .......... .......... .......... 1% 128M 2s 2019-12-09T10:04:32.404 INFO:teuthology.orchestra.run.smithi121.stderr: 1250K .......... .......... .......... .......... .......... 1% 148M 2s 2019-12-09T10:04:32.404 INFO:teuthology.orchestra.run.smithi121.stderr: 1300K .......... .......... .......... .......... .......... 1% 122M 2s 2019-12-09T10:04:32.404 INFO:teuthology.orchestra.run.smithi121.stderr: 1350K .......... .......... .......... .......... .......... 1% 125M 2s 2019-12-09T10:04:33.589 INFO:teuthology.orchestra.run.smithi121.stderr: 1400K .......... .......... .......... .......... .......... 1% 135M 2s 2019-12-09T10:04:33.590 INFO:teuthology.orchestra.run.smithi121.stderr: 1450K .......... .......... .......... .......... .......... 2% 127M 2s 2019-12-09T10:04:33.590 INFO:teuthology.orchestra.run.smithi121.stderr: 1500K .......... .......... .......... .......... .......... 2% 149M 2s 2019-12-09T10:04:33.590 INFO:teuthology.orchestra.run.smithi121.stderr: 1550K .......... .......... .......... .......... .......... 2% 119M 2s 2019-12-09T10:04:33.590 INFO:teuthology.orchestra.run.smithi121.stderr: 1600K .......... .......... .......... .......... .......... 2% 36.5M 2s 2019-12-09T10:04:33.590 INFO:teuthology.orchestra.run.smithi121.stderr: 1650K .......... .......... .......... .......... .......... 2% 226M 2s 2019-12-09T10:04:33.590 INFO:teuthology.orchestra.run.smithi121.stderr: 1700K .......... .......... .......... .......... .......... 2% 274M 2s 2019-12-09T10:04:33.590 INFO:teuthology.orchestra.run.smithi121.stderr: 1750K .......... .......... .......... .......... .......... 2% 214M 2s 2019-12-09T10:04:33.591 INFO:teuthology.orchestra.run.smithi121.stderr: 1800K .......... .......... .......... .......... .......... 2% 117M 1s 2019-12-09T10:04:33.591 INFO:teuthology.orchestra.run.smithi121.stderr: 1850K .......... .......... .......... .......... .......... 2% 168M 1s 2019-12-09T10:04:33.591 INFO:teuthology.orchestra.run.smithi121.stderr: 1900K .......... .......... .......... .......... .......... 2% 185M 1s 2019-12-09T10:04:33.591 INFO:teuthology.orchestra.run.smithi121.stderr: 1950K .......... .......... .......... .......... .......... 2% 169M 1s 2019-12-09T10:04:33.591 INFO:teuthology.orchestra.run.smithi121.stderr: 2000K .......... .......... .......... .......... .......... 2% 188M 1s 2019-12-09T10:04:33.591 INFO:teuthology.orchestra.run.smithi121.stderr: 2050K .......... .......... .......... .......... .......... 2% 181M 1s 2019-12-09T10:04:33.591 INFO:teuthology.orchestra.run.smithi121.stderr: 2100K .......... .......... .......... .......... .......... 2% 194M 1s 2019-12-09T10:04:33.592 INFO:teuthology.orchestra.run.smithi121.stderr: 2150K .......... .......... .......... .......... .......... 2% 164M 1s 2019-12-09T10:04:33.592 INFO:teuthology.orchestra.run.smithi121.stderr: 2200K .......... .......... .......... .......... .......... 3% 193M 1s 2019-12-09T10:04:33.592 INFO:teuthology.orchestra.run.smithi121.stderr: 2250K .......... .......... .......... .......... .......... 3% 196M 1s 2019-12-09T10:04:33.592 INFO:teuthology.orchestra.run.smithi121.stderr: 2300K .......... .......... .......... .......... .......... 3% 188M 1s 2019-12-09T10:04:33.592 INFO:teuthology.orchestra.run.smithi121.stderr: 2350K .......... .......... .......... .......... .......... 3% 165M 1s 2019-12-09T10:04:33.592 INFO:teuthology.orchestra.run.smithi121.stderr: 2400K .......... .......... .......... .......... .......... 3% 195M 1s 2019-12-09T10:04:33.592 INFO:teuthology.orchestra.run.smithi121.stderr: 2450K .......... .......... .......... .......... .......... 3% 185M 1s 2019-12-09T10:04:33.592 INFO:teuthology.orchestra.run.smithi121.stderr: 2500K .......... .......... .......... .......... .......... 3% 188M 1s 2019-12-09T10:04:33.593 INFO:teuthology.orchestra.run.smithi121.stderr: 2550K .......... .......... .......... .......... .......... 3% 165M 1s 2019-12-09T10:04:33.593 INFO:teuthology.orchestra.run.smithi121.stderr: 2600K .......... .......... .......... .......... .......... 3% 172M 1s 2019-12-09T10:04:33.593 INFO:teuthology.orchestra.run.smithi121.stderr: 2650K .......... .......... .......... .......... .......... 3% 180M 1s 2019-12-09T10:04:33.593 INFO:teuthology.orchestra.run.smithi121.stderr: 2700K .......... .......... .......... .......... .......... 3% 176M 1s 2019-12-09T10:04:33.593 INFO:teuthology.orchestra.run.smithi121.stderr: 2750K .......... .......... .......... .......... .......... 3% 144M 1s 2019-12-09T10:04:33.593 INFO:teuthology.orchestra.run.smithi121.stderr: 2800K .......... .......... .......... .......... .......... 3% 123M 1s 2019-12-09T10:04:33.593 INFO:teuthology.orchestra.run.smithi121.stderr: 2850K .......... .......... .......... .......... .......... 3% 191M 1s 2019-12-09T10:04:33.594 INFO:teuthology.orchestra.run.smithi121.stderr: 2900K .......... .......... .......... .......... .......... 4% 183M 1s 2019-12-09T10:04:33.594 INFO:teuthology.orchestra.run.smithi121.stderr: 2950K .......... .......... .......... .......... .......... 4% 161M 1s 2019-12-09T10:04:33.594 INFO:teuthology.orchestra.run.smithi121.stderr: 3000K .......... .......... .......... .......... .......... 4% 189M 1s 2019-12-09T10:04:33.594 INFO:teuthology.orchestra.run.smithi121.stderr: 3050K .......... .......... .......... .......... .......... 4% 169M 1s 2019-12-09T10:04:33.594 INFO:teuthology.orchestra.run.smithi121.stderr: 3100K .......... .......... .......... .......... .......... 4% 184M 1s 2019-12-09T10:04:33.594 INFO:teuthology.orchestra.run.smithi121.stderr: 3150K .......... .......... .......... .......... .......... 4% 167M 1s 2019-12-09T10:04:33.594 INFO:teuthology.orchestra.run.smithi121.stderr: 3200K .......... .......... .......... .......... .......... 4% 192M 1s 2019-12-09T10:04:33.595 INFO:teuthology.orchestra.run.smithi121.stderr: 3250K .......... .......... .......... .......... .......... 4% 194M 1s 2019-12-09T10:04:33.595 INFO:teuthology.orchestra.run.smithi121.stderr: 3300K .......... .......... .......... .......... .......... 4% 189M 1s 2019-12-09T10:04:33.595 INFO:teuthology.orchestra.run.smithi121.stderr: 3350K .......... .......... .......... .......... .......... 4% 164M 1s 2019-12-09T10:04:33.595 INFO:teuthology.orchestra.run.smithi121.stderr: 3400K .......... .......... .......... .......... .......... 4% 194M 1s 2019-12-09T10:04:33.595 INFO:teuthology.orchestra.run.smithi121.stderr: 3450K .......... .......... .......... .......... .......... 4% 198M 1s 2019-12-09T10:04:33.595 INFO:teuthology.orchestra.run.smithi121.stderr: 3500K .......... .......... .......... .......... .......... 4% 190M 1s 2019-12-09T10:04:33.595 INFO:teuthology.orchestra.run.smithi121.stderr: 3550K .......... .......... .......... .......... .......... 4% 161M 1s 2019-12-09T10:04:33.596 INFO:teuthology.orchestra.run.smithi121.stderr: 3600K .......... .......... .......... .......... .......... 4% 199M 1s 2019-12-09T10:04:33.596 INFO:teuthology.orchestra.run.smithi121.stderr: 3650K .......... .......... .......... .......... .......... 5% 208M 1s 2019-12-09T10:04:33.596 INFO:teuthology.orchestra.run.smithi121.stderr: 3700K .......... .......... .......... .......... .......... 5% 199M 1s 2019-12-09T10:04:33.596 INFO:teuthology.orchestra.run.smithi121.stderr: 3750K .......... .......... .......... .......... .......... 5% 171M 1s 2019-12-09T10:04:33.596 INFO:teuthology.orchestra.run.smithi121.stderr: 3800K .......... .......... .......... .......... .......... 5% 194M 1s 2019-12-09T10:04:33.596 INFO:teuthology.orchestra.run.smithi121.stderr: 3850K .......... .......... .......... .......... .......... 5% 195M 1s 2019-12-09T10:04:33.596 INFO:teuthology.orchestra.run.smithi121.stderr: 3900K .......... .......... .......... .......... .......... 5% 193M 1s 2019-12-09T10:04:33.596 INFO:teuthology.orchestra.run.smithi121.stderr: 3950K .......... .......... .......... .......... .......... 5% 175M 1s 2019-12-09T10:04:33.597 INFO:teuthology.orchestra.run.smithi121.stderr: 4000K .......... .......... .......... .......... .......... 5% 199M 1s 2019-12-09T10:04:33.597 INFO:teuthology.orchestra.run.smithi121.stderr: 4050K .......... .......... .......... .......... .......... 5% 181M 1s 2019-12-09T10:04:33.597 INFO:teuthology.orchestra.run.smithi121.stderr: 4100K .......... .......... .......... .......... .......... 5% 182M 1s 2019-12-09T10:04:33.597 INFO:teuthology.orchestra.run.smithi121.stderr: 4150K .......... .......... .......... .......... .......... 5% 164M 1s 2019-12-09T10:04:33.597 INFO:teuthology.orchestra.run.smithi121.stderr: 4200K .......... .......... .......... .......... .......... 5% 195M 1s 2019-12-09T10:04:33.597 INFO:teuthology.orchestra.run.smithi121.stderr: 4250K .......... .......... .......... .......... .......... 5% 196M 1s 2019-12-09T10:04:33.597 INFO:teuthology.orchestra.run.smithi121.stderr: 4300K .......... .......... .......... .......... .......... 5% 175M 1s 2019-12-09T10:04:33.598 INFO:teuthology.orchestra.run.smithi121.stderr: 4350K .......... .......... .......... .......... .......... 5% 160M 1s 2019-12-09T10:04:33.598 INFO:teuthology.orchestra.run.smithi121.stderr: 4400K .......... .......... .......... .......... .......... 6% 195M 1s 2019-12-09T10:04:33.598 INFO:teuthology.orchestra.run.smithi121.stderr: 4450K .......... .......... .......... .......... .......... 6% 200M 1s 2019-12-09T10:04:33.598 INFO:teuthology.orchestra.run.smithi121.stderr: 4500K .......... .......... .......... .......... .......... 6% 189M 1s 2019-12-09T10:04:33.598 INFO:teuthology.orchestra.run.smithi121.stderr: 4550K .......... .......... .......... .......... .......... 6% 167M 1s 2019-12-09T10:04:33.598 INFO:teuthology.orchestra.run.smithi121.stderr: 4600K .......... .......... .......... .......... .......... 6% 194M 1s 2019-12-09T10:04:33.598 INFO:teuthology.orchestra.run.smithi121.stderr: 4650K .......... .......... .......... .......... .......... 6% 200M 1s 2019-12-09T10:04:33.599 INFO:teuthology.orchestra.run.smithi121.stderr: 4700K .......... .......... .......... .......... .......... 6% 180M 1s 2019-12-09T10:04:33.599 INFO:teuthology.orchestra.run.smithi121.stderr: 4750K .......... .......... .......... .......... .......... 6% 163M 1s 2019-12-09T10:04:33.599 INFO:teuthology.orchestra.run.smithi121.stderr: 4800K .......... .......... .......... .......... .......... 6% 195M 1s 2019-12-09T10:04:33.599 INFO:teuthology.orchestra.run.smithi121.stderr: 4850K .......... .......... .......... .......... .......... 6% 188M 1s 2019-12-09T10:04:33.599 INFO:teuthology.orchestra.run.smithi121.stderr: 4900K .......... .......... .......... .......... .......... 6% 196M 1s 2019-12-09T10:04:33.599 INFO:teuthology.orchestra.run.smithi121.stderr: 4950K .......... .......... .......... .......... .......... 6% 173M 1s 2019-12-09T10:04:33.599 INFO:teuthology.orchestra.run.smithi121.stderr: 5000K .......... .......... .......... .......... .......... 6% 196M 1s 2019-12-09T10:04:33.599 INFO:teuthology.orchestra.run.smithi121.stderr: 5050K .......... .......... .......... .......... .......... 6% 187M 1s 2019-12-09T10:04:33.600 INFO:teuthology.orchestra.run.smithi121.stderr: 5100K .......... .......... .......... .......... .......... 7% 200M 1s 2019-12-09T10:04:33.600 INFO:teuthology.orchestra.run.smithi121.stderr: 5150K .......... .......... .......... .......... .......... 7% 166M 1s 2019-12-09T10:04:33.600 INFO:teuthology.orchestra.run.smithi121.stderr: 5200K .......... .......... .......... .......... .......... 7% 214M 1s 2019-12-09T10:04:33.600 INFO:teuthology.orchestra.run.smithi121.stderr: 5250K .......... .......... .......... .......... .......... 7% 208M 1s 2019-12-09T10:04:33.600 INFO:teuthology.orchestra.run.smithi121.stderr: 5300K .......... .......... .......... .......... .......... 7% 212M 1s 2019-12-09T10:04:33.600 INFO:teuthology.orchestra.run.smithi121.stderr: 5350K .......... .......... .......... .......... .......... 7% 189M 1s 2019-12-09T10:04:33.600 INFO:teuthology.orchestra.run.smithi121.stderr: 5400K .......... .......... .......... .......... .......... 7% 204M 1s 2019-12-09T10:04:33.601 INFO:teuthology.orchestra.run.smithi121.stderr: 5450K .......... .......... .......... .......... .......... 7% 191M 1s 2019-12-09T10:04:33.601 INFO:teuthology.orchestra.run.smithi121.stderr: 5500K .......... .......... .......... .......... .......... 7% 218M 1s 2019-12-09T10:04:33.601 INFO:teuthology.orchestra.run.smithi121.stderr: 5550K .......... .......... .......... .......... .......... 7% 172M 1s 2019-12-09T10:04:33.601 INFO:teuthology.orchestra.run.smithi121.stderr: 5600K .......... .......... .......... .......... .......... 7% 210M 1s 2019-12-09T10:04:33.601 INFO:teuthology.orchestra.run.smithi121.stderr: 5650K .......... .......... .......... .......... .......... 7% 205M 1s 2019-12-09T10:04:33.601 INFO:teuthology.orchestra.run.smithi121.stderr: 5700K .......... .......... .......... .......... .......... 7% 216M 1s 2019-12-09T10:04:33.601 INFO:teuthology.orchestra.run.smithi121.stderr: 5750K .......... .......... .......... .......... .......... 7% 191M 1s 2019-12-09T10:04:33.602 INFO:teuthology.orchestra.run.smithi121.stderr: 5800K .......... .......... .......... .......... .......... 7% 198M 1s 2019-12-09T10:04:33.602 INFO:teuthology.orchestra.run.smithi121.stderr: 5850K .......... .......... .......... .......... .......... 8% 189M 1s 2019-12-09T10:04:33.602 INFO:teuthology.orchestra.run.smithi121.stderr: 5900K .......... .......... .......... .......... .......... 8% 211M 1s 2019-12-09T10:04:33.602 INFO:teuthology.orchestra.run.smithi121.stderr: 5950K .......... .......... .......... .......... .......... 8% 174M 1s 2019-12-09T10:04:33.602 INFO:teuthology.orchestra.run.smithi121.stderr: 6000K .......... .......... .......... .......... .......... 8% 204M 1s 2019-12-09T10:04:33.602 INFO:teuthology.orchestra.run.smithi121.stderr: 6050K .......... .......... .......... .......... .......... 8% 183M 1s 2019-12-09T10:04:33.602 INFO:teuthology.orchestra.run.smithi121.stderr: 6100K .......... .......... .......... .......... .......... 8% 210M 1s 2019-12-09T10:04:33.602 INFO:teuthology.orchestra.run.smithi121.stderr: 6150K .......... .......... .......... .......... .......... 8% 161M 1s 2019-12-09T10:04:33.603 INFO:teuthology.orchestra.run.smithi121.stderr: 6200K .......... .......... .......... .......... .......... 8% 197M 1s 2019-12-09T10:04:33.603 INFO:teuthology.orchestra.run.smithi121.stderr: 6250K .......... .......... .......... .......... .......... 8% 159M 1s 2019-12-09T10:04:33.604 INFO:teuthology.orchestra.run.smithi121.stderr: 6300K .......... .......... .......... .......... .......... 8% 216M 1s 2019-12-09T10:04:33.604 INFO:teuthology.orchestra.run.smithi121.stderr: 6350K .......... .......... .......... .......... .......... 8% 186M 1s 2019-12-09T10:04:33.604 INFO:teuthology.orchestra.run.smithi121.stderr: 6400K .......... .......... .......... .......... .......... 8% 206M 1s 2019-12-09T10:04:33.604 INFO:teuthology.orchestra.run.smithi121.stderr: 6450K .......... .......... .......... .......... .......... 8% 197M 1s 2019-12-09T10:04:33.604 INFO:teuthology.orchestra.run.smithi121.stderr: 6500K .......... .......... .......... .......... .......... 8% 197M 1s 2019-12-09T10:04:33.604 INFO:teuthology.orchestra.run.smithi121.stderr: 6550K .......... .......... .......... .......... .......... 8% 179M 1s 2019-12-09T10:04:33.605 INFO:teuthology.orchestra.run.smithi121.stderr: 6600K .......... .......... .......... .......... .......... 9% 211M 1s 2019-12-09T10:04:33.605 INFO:teuthology.orchestra.run.smithi121.stderr: 6650K .......... .......... .......... .......... .......... 9% 197M 1s 2019-12-09T10:04:33.605 INFO:teuthology.orchestra.run.smithi121.stderr: 6700K .......... .......... .......... .......... .......... 9% 208M 1s 2019-12-09T10:04:33.605 INFO:teuthology.orchestra.run.smithi121.stderr: 6750K .......... .......... .......... .......... .......... 9% 186M 1s 2019-12-09T10:04:33.605 INFO:teuthology.orchestra.run.smithi121.stderr: 6800K .......... .......... .......... .......... .......... 9% 214M 1s 2019-12-09T10:04:33.605 INFO:teuthology.orchestra.run.smithi121.stderr: 6850K .......... .......... .......... .......... .......... 9% 190M 1s 2019-12-09T10:04:33.606 INFO:teuthology.orchestra.run.smithi121.stderr: 6900K .......... .......... .......... .......... .......... 9% 199M 1s 2019-12-09T10:04:33.606 INFO:teuthology.orchestra.run.smithi121.stderr: 6950K .......... .......... .......... .......... .......... 9% 152M 1s 2019-12-09T10:04:33.606 INFO:teuthology.orchestra.run.smithi121.stderr: 7000K .......... .......... .......... .......... .......... 9% 186M 1s 2019-12-09T10:04:33.606 INFO:teuthology.orchestra.run.smithi121.stderr: 7050K .......... .......... .......... .......... .......... 9% 178M 1s 2019-12-09T10:04:33.606 INFO:teuthology.orchestra.run.smithi121.stderr: 7100K .......... .......... .......... .......... .......... 9% 211M 1s 2019-12-09T10:04:33.606 INFO:teuthology.orchestra.run.smithi121.stderr: 7150K .......... .......... .......... .......... .......... 9% 192M 1s 2019-12-09T10:04:33.606 INFO:teuthology.orchestra.run.smithi121.stderr: 7200K .......... .......... .......... .......... .......... 9% 205M 1s 2019-12-09T10:04:33.607 INFO:teuthology.orchestra.run.smithi121.stderr: 7250K .......... .......... .......... .......... .......... 9% 216M 1s 2019-12-09T10:04:33.607 INFO:teuthology.orchestra.run.smithi121.stderr: 7300K .......... .......... .......... .......... .......... 9% 215M 1s 2019-12-09T10:04:33.607 INFO:teuthology.orchestra.run.smithi121.stderr: 7350K .......... .......... .......... .......... .......... 10% 190M 1s 2019-12-09T10:04:33.607 INFO:teuthology.orchestra.run.smithi121.stderr: 7400K .......... .......... .......... .......... .......... 10% 223M 1s 2019-12-09T10:04:33.607 INFO:teuthology.orchestra.run.smithi121.stderr: 7450K .......... .......... .......... .......... .......... 10% 218M 1s 2019-12-09T10:04:33.607 INFO:teuthology.orchestra.run.smithi121.stderr: 7500K .......... .......... .......... .......... .......... 10% 222M 1s 2019-12-09T10:04:33.608 INFO:teuthology.orchestra.run.smithi121.stderr: 7550K .......... .......... .......... .......... .......... 10% 193M 1s 2019-12-09T10:04:33.608 INFO:teuthology.orchestra.run.smithi121.stderr: 7600K .......... .......... .......... .......... .......... 10% 214M 1s 2019-12-09T10:04:33.608 INFO:teuthology.orchestra.run.smithi121.stderr: 7650K .......... .......... .......... .......... .......... 10% 222M 1s 2019-12-09T10:04:33.608 INFO:teuthology.orchestra.run.smithi121.stderr: 7700K .......... .......... .......... .......... .......... 10% 221M 1s 2019-12-09T10:04:33.608 INFO:teuthology.orchestra.run.smithi121.stderr: 7750K .......... .......... .......... .......... .......... 10% 188M 1s 2019-12-09T10:04:33.608 INFO:teuthology.orchestra.run.smithi121.stderr: 7800K .......... .......... .......... .......... .......... 10% 194M 1s 2019-12-09T10:04:33.608 INFO:teuthology.orchestra.run.smithi121.stderr: 7850K .......... .......... .......... .......... .......... 10% 202M 1s 2019-12-09T10:04:33.609 INFO:teuthology.orchestra.run.smithi121.stderr: 7900K .......... .......... .......... .......... .......... 10% 213M 1s 2019-12-09T10:04:33.609 INFO:teuthology.orchestra.run.smithi121.stderr: 7950K .......... .......... .......... .......... .......... 10% 187M 1s 2019-12-09T10:04:33.609 INFO:teuthology.orchestra.run.smithi121.stderr: 8000K .......... .......... .......... .......... .......... 10% 215M 1s 2019-12-09T10:04:33.609 INFO:teuthology.orchestra.run.smithi121.stderr: 8050K .......... .......... .......... .......... .......... 11% 195M 1s 2019-12-09T10:04:33.609 INFO:teuthology.orchestra.run.smithi121.stderr: 8100K .......... .......... .......... .......... .......... 11% 221M 1s 2019-12-09T10:04:33.609 INFO:teuthology.orchestra.run.smithi121.stderr: 8150K .......... .......... .......... .......... .......... 11% 180M 1s 2019-12-09T10:04:33.609 INFO:teuthology.orchestra.run.smithi121.stderr: 8200K .......... .......... .......... .......... .......... 11% 216M 1s 2019-12-09T10:04:33.609 INFO:teuthology.orchestra.run.smithi121.stderr: 8250K .......... .......... .......... .......... .......... 11% 215M 1s 2019-12-09T10:04:33.610 INFO:teuthology.orchestra.run.smithi121.stderr: 8300K .......... .......... .......... .......... .......... 11% 214M 1s 2019-12-09T10:04:33.610 INFO:teuthology.orchestra.run.smithi121.stderr: 8350K .......... .......... .......... .......... .......... 11% 199M 1s 2019-12-09T10:04:33.610 INFO:teuthology.orchestra.run.smithi121.stderr: 8400K .......... .......... .......... .......... .......... 11% 216M 1s 2019-12-09T10:04:33.610 INFO:teuthology.orchestra.run.smithi121.stderr: 8450K .......... .......... .......... .......... .......... 11% 216M 1s 2019-12-09T10:04:33.610 INFO:teuthology.orchestra.run.smithi121.stderr: 8500K .......... .......... .......... .......... .......... 11% 206M 1s 2019-12-09T10:04:33.610 INFO:teuthology.orchestra.run.smithi121.stderr: 8550K .......... .......... .......... .......... .......... 11% 182M 1s 2019-12-09T10:04:33.610 INFO:teuthology.orchestra.run.smithi121.stderr: 8600K .......... .......... .......... .......... .......... 11% 213M 1s 2019-12-09T10:04:33.611 INFO:teuthology.orchestra.run.smithi121.stderr: 8650K .......... .......... .......... .......... .......... 11% 201M 1s 2019-12-09T10:04:33.611 INFO:teuthology.orchestra.run.smithi121.stderr: 8700K .......... .......... .......... .......... .......... 11% 227M 1s 2019-12-09T10:04:33.611 INFO:teuthology.orchestra.run.smithi121.stderr: 8750K .......... .......... .......... .......... .......... 11% 216M 1s 2019-12-09T10:04:33.611 INFO:teuthology.orchestra.run.smithi121.stderr: 8800K .......... .......... .......... .......... .......... 12% 250M 1s 2019-12-09T10:04:33.611 INFO:teuthology.orchestra.run.smithi121.stderr: 8850K .......... .......... .......... .......... .......... 12% 247M 1s 2019-12-09T10:04:33.611 INFO:teuthology.orchestra.run.smithi121.stderr: 8900K .......... .......... .......... .......... .......... 12% 240M 1s 2019-12-09T10:04:33.611 INFO:teuthology.orchestra.run.smithi121.stderr: 8950K .......... .......... .......... .......... .......... 12% 198M 1s 2019-12-09T10:04:33.612 INFO:teuthology.orchestra.run.smithi121.stderr: 9000K .......... .......... .......... .......... .......... 12% 205M 1s 2019-12-09T10:04:33.612 INFO:teuthology.orchestra.run.smithi121.stderr: 9050K .......... .......... .......... .......... .......... 12% 213M 1s 2019-12-09T10:04:33.612 INFO:teuthology.orchestra.run.smithi121.stderr: 9100K .......... .......... .......... .......... .......... 12% 215M 1s 2019-12-09T10:04:33.612 INFO:teuthology.orchestra.run.smithi121.stderr: 9150K .......... .......... .......... .......... .......... 12% 182M 1s 2019-12-09T10:04:33.612 INFO:teuthology.orchestra.run.smithi121.stderr: 9200K .......... .......... .......... .......... .......... 12% 221M 1s 2019-12-09T10:04:33.612 INFO:teuthology.orchestra.run.smithi121.stderr: 9250K .......... .......... .......... .......... .......... 12% 208M 1s 2019-12-09T10:04:33.612 INFO:teuthology.orchestra.run.smithi121.stderr: 9300K .......... .......... .......... .......... .......... 12% 226M 1s 2019-12-09T10:04:33.613 INFO:teuthology.orchestra.run.smithi121.stderr: 9350K .......... .......... .......... .......... .......... 12% 177M 1s 2019-12-09T10:04:33.613 INFO:teuthology.orchestra.run.smithi121.stderr: 9400K .......... .......... .......... .......... .......... 12% 232M 1s 2019-12-09T10:04:33.613 INFO:teuthology.orchestra.run.smithi121.stderr: 9450K .......... .......... .......... .......... .......... 12% 236M 1s 2019-12-09T10:04:33.613 INFO:teuthology.orchestra.run.smithi121.stderr: 9500K .......... .......... .......... .......... .......... 12% 231M 1s 2019-12-09T10:04:33.613 INFO:teuthology.orchestra.run.smithi121.stderr: 9550K .......... .......... .......... .......... .......... 13% 220M 1s 2019-12-09T10:04:33.613 INFO:teuthology.orchestra.run.smithi121.stderr: 9600K .......... .......... .......... .......... .......... 13% 249M 1s 2019-12-09T10:04:33.613 INFO:teuthology.orchestra.run.smithi121.stderr: 9650K .......... .......... .......... .......... .......... 13% 232M 1s 2019-12-09T10:04:33.614 INFO:teuthology.orchestra.run.smithi121.stderr: 9700K .......... .......... .......... .......... .......... 13% 215M 1s 2019-12-09T10:04:33.614 INFO:teuthology.orchestra.run.smithi121.stderr: 9750K .......... .......... .......... .......... .......... 13% 216M 1s 2019-12-09T10:04:33.614 INFO:teuthology.orchestra.run.smithi121.stderr: 9800K .......... .......... .......... .......... .......... 13% 255M 1s 2019-12-09T10:04:33.614 INFO:teuthology.orchestra.run.smithi121.stderr: 9850K .......... .......... .......... .......... .......... 13% 253M 1s 2019-12-09T10:04:33.614 INFO:teuthology.orchestra.run.smithi121.stderr: 9900K .......... .......... .......... .......... .......... 13% 251M 1s 2019-12-09T10:04:33.614 INFO:teuthology.orchestra.run.smithi121.stderr: 9950K .......... .......... .......... .......... .......... 13% 221M 1s 2019-12-09T10:04:33.614 INFO:teuthology.orchestra.run.smithi121.stderr: 10000K .......... .......... .......... .......... .......... 13% 256M 1s 2019-12-09T10:04:33.615 INFO:teuthology.orchestra.run.smithi121.stderr: 10050K .......... .......... .......... .......... .......... 13% 249M 1s 2019-12-09T10:04:33.615 INFO:teuthology.orchestra.run.smithi121.stderr: 10100K .......... .......... .......... .......... .......... 13% 250M 0s 2019-12-09T10:04:33.615 INFO:teuthology.orchestra.run.smithi121.stderr: 10150K .......... .......... .......... .......... .......... 13% 208M 0s 2019-12-09T10:04:33.615 INFO:teuthology.orchestra.run.smithi121.stderr: 10200K .......... .......... .......... .......... .......... 13% 257M 0s 2019-12-09T10:04:33.615 INFO:teuthology.orchestra.run.smithi121.stderr: 10250K .......... .......... .......... .......... .......... 14% 237M 0s 2019-12-09T10:04:33.615 INFO:teuthology.orchestra.run.smithi121.stderr: 10300K .......... .......... .......... .......... .......... 14% 248M 0s 2019-12-09T10:04:33.615 INFO:teuthology.orchestra.run.smithi121.stderr: 10350K .......... .......... .......... .......... .......... 14% 227M 0s 2019-12-09T10:04:33.615 INFO:teuthology.orchestra.run.smithi121.stderr: 10400K .......... .......... .......... .......... .......... 14% 249M 0s 2019-12-09T10:04:33.616 INFO:teuthology.orchestra.run.smithi121.stderr: 10450K .......... .......... .......... .......... .......... 14% 236M 0s 2019-12-09T10:04:33.616 INFO:teuthology.orchestra.run.smithi121.stderr: 10500K .......... .......... .......... .......... .......... 14% 250M 0s 2019-12-09T10:04:33.616 INFO:teuthology.orchestra.run.smithi121.stderr: 10550K .......... .......... .......... .......... .......... 14% 207M 0s 2019-12-09T10:04:33.616 INFO:teuthology.orchestra.run.smithi121.stderr: 10600K .......... .......... .......... .......... .......... 14% 249M 0s 2019-12-09T10:04:33.616 INFO:teuthology.orchestra.run.smithi121.stderr: 10650K .......... .......... .......... .......... .......... 14% 249M 0s 2019-12-09T10:04:33.616 INFO:teuthology.orchestra.run.smithi121.stderr: 10700K .......... .......... .......... .......... .......... 14% 254M 0s 2019-12-09T10:04:33.616 INFO:teuthology.orchestra.run.smithi121.stderr: 10750K .......... .......... .......... .......... .......... 14% 226M 0s 2019-12-09T10:04:33.617 INFO:teuthology.orchestra.run.smithi121.stderr: 10800K .......... .......... .......... .......... .......... 14% 242M 0s 2019-12-09T10:04:33.617 INFO:teuthology.orchestra.run.smithi121.stderr: 10850K .......... .......... .......... .......... .......... 14% 249M 0s 2019-12-09T10:04:33.617 INFO:teuthology.orchestra.run.smithi121.stderr: 10900K .......... .......... .......... .......... .......... 14% 258M 0s 2019-12-09T10:04:33.617 INFO:teuthology.orchestra.run.smithi121.stderr: 10950K .......... .......... .......... .......... .......... 14% 217M 0s 2019-12-09T10:04:33.617 INFO:teuthology.orchestra.run.smithi121.stderr: 11000K .......... .......... .......... .......... .......... 15% 252M 0s 2019-12-09T10:04:33.617 INFO:teuthology.orchestra.run.smithi121.stderr: 11050K .......... .......... .......... .......... .......... 15% 241M 0s 2019-12-09T10:04:33.617 INFO:teuthology.orchestra.run.smithi121.stderr: 11100K .......... .......... .......... .......... .......... 15% 254M 0s 2019-12-09T10:04:33.618 INFO:teuthology.orchestra.run.smithi121.stderr: 11150K .......... .......... .......... .......... .......... 15% 212M 0s 2019-12-09T10:04:33.618 INFO:teuthology.orchestra.run.smithi121.stderr: 11200K .......... .......... .......... .......... .......... 15% 228M 0s 2019-12-09T10:04:33.618 INFO:teuthology.orchestra.run.smithi121.stderr: 11250K .......... .......... .......... .......... .......... 15% 221M 0s 2019-12-09T10:04:33.618 INFO:teuthology.orchestra.run.smithi121.stderr: 11300K .......... .......... .......... .......... .......... 15% 224M 0s 2019-12-09T10:04:33.618 INFO:teuthology.orchestra.run.smithi121.stderr: 11350K .......... .......... .......... .......... .......... 15% 171M 0s 2019-12-09T10:04:33.618 INFO:teuthology.orchestra.run.smithi121.stderr: 11400K .......... .......... .......... .......... .......... 15% 223M 0s 2019-12-09T10:04:33.618 INFO:teuthology.orchestra.run.smithi121.stderr: 11450K .......... .......... .......... .......... .......... 15% 223M 0s 2019-12-09T10:04:33.619 INFO:teuthology.orchestra.run.smithi121.stderr: 11500K .......... .......... .......... .......... .......... 15% 206M 0s 2019-12-09T10:04:33.619 INFO:teuthology.orchestra.run.smithi121.stderr: 11550K .......... .......... .......... .......... .......... 15% 197M 0s 2019-12-09T10:04:33.619 INFO:teuthology.orchestra.run.smithi121.stderr: 11600K .......... .......... .......... .......... .......... 15% 232M 0s 2019-12-09T10:04:33.619 INFO:teuthology.orchestra.run.smithi121.stderr: 11650K .......... .......... .......... .......... .......... 15% 227M 0s 2019-12-09T10:04:33.619 INFO:teuthology.orchestra.run.smithi121.stderr: 11700K .......... .......... .......... .......... .......... 15% 209M 0s 2019-12-09T10:04:33.619 INFO:teuthology.orchestra.run.smithi121.stderr: 11750K .......... .......... .......... .......... .......... 16% 177M 0s 2019-12-09T10:04:33.619 INFO:teuthology.orchestra.run.smithi121.stderr: 11800K .......... .......... .......... .......... .......... 16% 245M 0s 2019-12-09T10:04:33.619 INFO:teuthology.orchestra.run.smithi121.stderr: 11850K .......... .......... .......... .......... .......... 16% 237M 0s 2019-12-09T10:04:33.620 INFO:teuthology.orchestra.run.smithi121.stderr: 11900K .......... .......... .......... .......... .......... 16% 260M 0s 2019-12-09T10:04:33.620 INFO:teuthology.orchestra.run.smithi121.stderr: 11950K .......... .......... .......... .......... .......... 16% 222M 0s 2019-12-09T10:04:33.620 INFO:teuthology.orchestra.run.smithi121.stderr: 12000K .......... .......... .......... .......... .......... 16% 248M 0s 2019-12-09T10:04:33.620 INFO:teuthology.orchestra.run.smithi121.stderr: 12050K .......... .......... .......... .......... .......... 16% 254M 0s 2019-12-09T10:04:33.620 INFO:teuthology.orchestra.run.smithi121.stderr: 12100K .......... .......... .......... .......... .......... 16% 253M 0s 2019-12-09T10:04:33.620 INFO:teuthology.orchestra.run.smithi121.stderr: 12150K .......... .......... .......... .......... .......... 16% 219M 0s 2019-12-09T10:04:33.621 INFO:teuthology.orchestra.run.smithi121.stderr: 12200K .......... .......... .......... .......... .......... 16% 254M 0s 2019-12-09T10:04:33.621 INFO:teuthology.orchestra.run.smithi121.stderr: 12250K .......... .......... .......... .......... .......... 16% 247M 0s 2019-12-09T10:04:33.621 INFO:teuthology.orchestra.run.smithi121.stderr: 12300K .......... .......... .......... .......... .......... 16% 249M 0s 2019-12-09T10:04:33.621 INFO:teuthology.orchestra.run.smithi121.stderr: 12350K .......... .......... .......... .......... .......... 16% 228M 0s 2019-12-09T10:04:33.621 INFO:teuthology.orchestra.run.smithi121.stderr: 12400K .......... .......... .......... .......... .......... 16% 252M 0s 2019-12-09T10:04:33.621 INFO:teuthology.orchestra.run.smithi121.stderr: 12450K .......... .......... .......... .......... .......... 16% 246M 0s 2019-12-09T10:04:33.621 INFO:teuthology.orchestra.run.smithi121.stderr: 12500K .......... .......... .......... .......... .......... 17% 247M 0s 2019-12-09T10:04:33.622 INFO:teuthology.orchestra.run.smithi121.stderr: 12550K .......... .......... .......... .......... .......... 17% 207M 0s 2019-12-09T10:04:33.622 INFO:teuthology.orchestra.run.smithi121.stderr: 12600K .......... .......... .......... .......... .......... 17% 256M 0s 2019-12-09T10:04:33.622 INFO:teuthology.orchestra.run.smithi121.stderr: 12650K .......... .......... .......... .......... .......... 17% 259M 0s 2019-12-09T10:04:33.622 INFO:teuthology.orchestra.run.smithi121.stderr: 12700K .......... .......... .......... .......... .......... 17% 248M 0s 2019-12-09T10:04:33.622 INFO:teuthology.orchestra.run.smithi121.stderr: 12750K .......... .......... .......... .......... .......... 17% 223M 0s 2019-12-09T10:04:33.622 INFO:teuthology.orchestra.run.smithi121.stderr: 12800K .......... .......... .......... .......... .......... 17% 254M 0s 2019-12-09T10:04:33.622 INFO:teuthology.orchestra.run.smithi121.stderr: 12850K .......... .......... .......... .......... .......... 17% 247M 0s 2019-12-09T10:04:33.623 INFO:teuthology.orchestra.run.smithi121.stderr: 12900K .......... .......... .......... .......... .......... 17% 252M 0s 2019-12-09T10:04:33.623 INFO:teuthology.orchestra.run.smithi121.stderr: 12950K .......... .......... .......... .......... .......... 17% 188M 0s 2019-12-09T10:04:33.623 INFO:teuthology.orchestra.run.smithi121.stderr: 13000K .......... .......... .......... .......... .......... 17% 236M 0s 2019-12-09T10:04:33.623 INFO:teuthology.orchestra.run.smithi121.stderr: 13050K .......... .......... .......... .......... .......... 17% 247M 0s 2019-12-09T10:04:33.623 INFO:teuthology.orchestra.run.smithi121.stderr: 13100K .......... .......... .......... .......... .......... 17% 228M 0s 2019-12-09T10:04:33.623 INFO:teuthology.orchestra.run.smithi121.stderr: 13150K .......... .......... .......... .......... .......... 17% 208M 0s 2019-12-09T10:04:33.623 INFO:teuthology.orchestra.run.smithi121.stderr: 13200K .......... .......... .......... .......... .......... 18% 235M 0s 2019-12-09T10:04:33.623 INFO:teuthology.orchestra.run.smithi121.stderr: 13250K .......... .......... .......... .......... .......... 18% 245M 0s 2019-12-09T10:04:33.624 INFO:teuthology.orchestra.run.smithi121.stderr: 13300K .......... .......... .......... .......... .......... 18% 259M 0s 2019-12-09T10:04:33.624 INFO:teuthology.orchestra.run.smithi121.stderr: 13350K .......... .......... .......... .......... .......... 18% 204M 0s 2019-12-09T10:04:33.624 INFO:teuthology.orchestra.run.smithi121.stderr: 13400K .......... .......... .......... .......... .......... 18% 238M 0s 2019-12-09T10:04:33.624 INFO:teuthology.orchestra.run.smithi121.stderr: 13450K .......... .......... .......... .......... .......... 18% 236M 0s 2019-12-09T10:04:33.624 INFO:teuthology.orchestra.run.smithi121.stderr: 13500K .......... .......... .......... .......... .......... 18% 243M 0s 2019-12-09T10:04:33.624 INFO:teuthology.orchestra.run.smithi121.stderr: 13550K .......... .......... .......... .......... .......... 18% 221M 0s 2019-12-09T10:04:33.624 INFO:teuthology.orchestra.run.smithi121.stderr: 13600K .......... .......... .......... .......... .......... 18% 255M 0s 2019-12-09T10:04:33.625 INFO:teuthology.orchestra.run.smithi121.stderr: 13650K .......... .......... .......... .......... .......... 18% 237M 0s 2019-12-09T10:04:33.625 INFO:teuthology.orchestra.run.smithi121.stderr: 13700K .......... .......... .......... .......... .......... 18% 261M 0s 2019-12-09T10:04:33.625 INFO:teuthology.orchestra.run.smithi121.stderr: 13750K .......... .......... .......... .......... .......... 18% 204M 0s 2019-12-09T10:04:33.625 INFO:teuthology.orchestra.run.smithi121.stderr: 13800K .......... .......... .......... .......... .......... 18% 238M 0s 2019-12-09T10:04:33.625 INFO:teuthology.orchestra.run.smithi121.stderr: 13850K .......... .......... .......... .......... .......... 18% 239M 0s 2019-12-09T10:04:33.625 INFO:teuthology.orchestra.run.smithi121.stderr: 13900K .......... .......... .......... .......... .......... 18% 244M 0s 2019-12-09T10:04:33.625 INFO:teuthology.orchestra.run.smithi121.stderr: 13950K .......... .......... .......... .......... .......... 19% 233M 0s 2019-12-09T10:04:33.626 INFO:teuthology.orchestra.run.smithi121.stderr: 14000K .......... .......... .......... .......... .......... 19% 260M 0s 2019-12-09T10:04:33.626 INFO:teuthology.orchestra.run.smithi121.stderr: 14050K .......... .......... .......... .......... .......... 19% 255M 0s 2019-12-09T10:04:33.626 INFO:teuthology.orchestra.run.smithi121.stderr: 14100K .......... .......... .......... .......... .......... 19% 248M 0s 2019-12-09T10:04:33.626 INFO:teuthology.orchestra.run.smithi121.stderr: 14150K .......... .......... .......... .......... .......... 19% 201M 0s 2019-12-09T10:04:33.626 INFO:teuthology.orchestra.run.smithi121.stderr: 14200K .......... .......... .......... .......... .......... 19% 244M 0s 2019-12-09T10:04:33.626 INFO:teuthology.orchestra.run.smithi121.stderr: 14250K .......... .......... .......... .......... .......... 19% 259M 0s 2019-12-09T10:04:33.626 INFO:teuthology.orchestra.run.smithi121.stderr: 14300K .......... .......... .......... .......... .......... 19% 251M 0s 2019-12-09T10:04:33.627 INFO:teuthology.orchestra.run.smithi121.stderr: 14350K .......... .......... .......... .......... .......... 19% 219M 0s 2019-12-09T10:04:33.627 INFO:teuthology.orchestra.run.smithi121.stderr: 14400K .......... .......... .......... .......... .......... 19% 236M 0s 2019-12-09T10:04:33.627 INFO:teuthology.orchestra.run.smithi121.stderr: 14450K .......... .......... .......... .......... .......... 19% 249M 0s 2019-12-09T10:04:33.627 INFO:teuthology.orchestra.run.smithi121.stderr: 14500K .......... .......... .......... .......... .......... 19% 234M 0s 2019-12-09T10:04:33.627 INFO:teuthology.orchestra.run.smithi121.stderr: 14550K .......... .......... .......... .......... .......... 19% 220M 0s 2019-12-09T10:04:33.627 INFO:teuthology.orchestra.run.smithi121.stderr: 14600K .......... .......... .......... .......... .......... 19% 257M 0s 2019-12-09T10:04:33.627 INFO:teuthology.orchestra.run.smithi121.stderr: 14650K .......... .......... .......... .......... .......... 19% 258M 0s 2019-12-09T10:04:33.627 INFO:teuthology.orchestra.run.smithi121.stderr: 14700K .......... .......... .......... .......... .......... 20% 259M 0s 2019-12-09T10:04:33.628 INFO:teuthology.orchestra.run.smithi121.stderr: 14750K .......... .......... .......... .......... .......... 20% 229M 0s 2019-12-09T10:04:33.628 INFO:teuthology.orchestra.run.smithi121.stderr: 14800K .......... .......... .......... .......... .......... 20% 256M 0s 2019-12-09T10:04:33.628 INFO:teuthology.orchestra.run.smithi121.stderr: 14850K .......... .......... .......... .......... .......... 20% 258M 0s 2019-12-09T10:04:33.628 INFO:teuthology.orchestra.run.smithi121.stderr: 14900K .......... .......... .......... .......... .......... 20% 249M 0s 2019-12-09T10:04:33.628 INFO:teuthology.orchestra.run.smithi121.stderr: 14950K .......... .......... .......... .......... .......... 20% 213M 0s 2019-12-09T10:04:33.628 INFO:teuthology.orchestra.run.smithi121.stderr: 15000K .......... .......... .......... .......... .......... 20% 247M 0s 2019-12-09T10:04:33.628 INFO:teuthology.orchestra.run.smithi121.stderr: 15050K .......... .......... .......... .......... .......... 20% 264M 0s 2019-12-09T10:04:33.629 INFO:teuthology.orchestra.run.smithi121.stderr: 15100K .......... .......... .......... .......... .......... 20% 246M 0s 2019-12-09T10:04:33.629 INFO:teuthology.orchestra.run.smithi121.stderr: 15150K .......... .......... .......... .......... .......... 20% 219M 0s 2019-12-09T10:04:33.629 INFO:teuthology.orchestra.run.smithi121.stderr: 15200K .......... .......... .......... .......... .......... 20% 257M 0s 2019-12-09T10:04:33.629 INFO:teuthology.orchestra.run.smithi121.stderr: 15250K .......... .......... .......... .......... .......... 20% 240M 0s 2019-12-09T10:04:33.629 INFO:teuthology.orchestra.run.smithi121.stderr: 15300K .......... .......... .......... .......... .......... 20% 258M 0s 2019-12-09T10:04:33.629 INFO:teuthology.orchestra.run.smithi121.stderr: 15350K .......... .......... .......... .......... .......... 20% 214M 0s 2019-12-09T10:04:33.629 INFO:teuthology.orchestra.run.smithi121.stderr: 15400K .......... .......... .......... .......... .......... 21% 257M 0s 2019-12-09T10:04:33.630 INFO:teuthology.orchestra.run.smithi121.stderr: 15450K .......... .......... .......... .......... .......... 21% 252M 0s 2019-12-09T10:04:33.630 INFO:teuthology.orchestra.run.smithi121.stderr: 15500K .......... .......... .......... .......... .......... 21% 255M 0s 2019-12-09T10:04:33.630 INFO:teuthology.orchestra.run.smithi121.stderr: 15550K .......... .......... .......... .......... .......... 21% 229M 0s 2019-12-09T10:04:33.630 INFO:teuthology.orchestra.run.smithi121.stderr: 15600K .......... .......... .......... .......... .......... 21% 261M 0s 2019-12-09T10:04:33.630 INFO:teuthology.orchestra.run.smithi121.stderr: 15650K .......... .......... .......... .......... .......... 21% 244M 0s 2019-12-09T10:04:33.630 INFO:teuthology.orchestra.run.smithi121.stderr: 15700K .......... .......... .......... .......... .......... 21% 252M 0s 2019-12-09T10:04:33.631 INFO:teuthology.orchestra.run.smithi121.stderr: 15750K .......... .......... .......... .......... .......... 21% 219M 0s 2019-12-09T10:04:33.631 INFO:teuthology.orchestra.run.smithi121.stderr: 15800K .......... .......... .......... .......... .......... 21% 259M 0s 2019-12-09T10:04:33.631 INFO:teuthology.orchestra.run.smithi121.stderr: 15850K .......... .......... .......... .......... .......... 21% 256M 0s 2019-12-09T10:04:33.631 INFO:teuthology.orchestra.run.smithi121.stderr: 15900K .......... .......... .......... .......... .......... 21% 258M 0s 2019-12-09T10:04:33.631 INFO:teuthology.orchestra.run.smithi121.stderr: 15950K .......... .......... .......... .......... .......... 21% 242M 0s 2019-12-09T10:04:33.631 INFO:teuthology.orchestra.run.smithi121.stderr: 16000K .......... .......... .......... .......... .......... 21% 256M 0s 2019-12-09T10:04:33.632 INFO:teuthology.orchestra.run.smithi121.stderr: 16050K .......... .......... .......... .......... .......... 21% 260M 0s 2019-12-09T10:04:33.632 INFO:teuthology.orchestra.run.smithi121.stderr: 16100K .......... .......... .......... .......... .......... 21% 260M 0s 2019-12-09T10:04:33.632 INFO:teuthology.orchestra.run.smithi121.stderr: 16150K .......... .......... .......... .......... .......... 22% 186M 0s 2019-12-09T10:04:33.632 INFO:teuthology.orchestra.run.smithi121.stderr: 16200K .......... .......... .......... .......... .......... 22% 255M 0s 2019-12-09T10:04:33.632 INFO:teuthology.orchestra.run.smithi121.stderr: 16250K .......... .......... .......... .......... .......... 22% 262M 0s 2019-12-09T10:04:33.632 INFO:teuthology.orchestra.run.smithi121.stderr: 16300K .......... .......... .......... .......... .......... 22% 243M 0s 2019-12-09T10:04:33.632 INFO:teuthology.orchestra.run.smithi121.stderr: 16350K .......... .......... .......... .......... .......... 22% 220M 0s 2019-12-09T10:04:33.633 INFO:teuthology.orchestra.run.smithi121.stderr: 16400K .......... .......... .......... .......... .......... 22% 255M 0s 2019-12-09T10:04:33.633 INFO:teuthology.orchestra.run.smithi121.stderr: 16450K .......... .......... .......... .......... .......... 22% 257M 0s 2019-12-09T10:04:33.633 INFO:teuthology.orchestra.run.smithi121.stderr: 16500K .......... .......... .......... .......... .......... 22% 257M 0s 2019-12-09T10:04:33.633 INFO:teuthology.orchestra.run.smithi121.stderr: 16550K .......... .......... .......... .......... .......... 22% 210M 0s 2019-12-09T10:04:33.633 INFO:teuthology.orchestra.run.smithi121.stderr: 16600K .......... .......... .......... .......... .......... 22% 273M 0s 2019-12-09T10:04:33.633 INFO:teuthology.orchestra.run.smithi121.stderr: 16650K .......... .......... .......... .......... .......... 22% 219M 0s 2019-12-09T10:04:33.633 INFO:teuthology.orchestra.run.smithi121.stderr: 16700K .......... .......... .......... .......... .......... 22% 248M 0s 2019-12-09T10:04:33.634 INFO:teuthology.orchestra.run.smithi121.stderr: 16750K .......... .......... .......... .......... .......... 22% 227M 0s 2019-12-09T10:04:33.634 INFO:teuthology.orchestra.run.smithi121.stderr: 16800K .......... .......... .......... .......... .......... 22% 253M 0s 2019-12-09T10:04:33.634 INFO:teuthology.orchestra.run.smithi121.stderr: 16850K .......... .......... .......... .......... .......... 22% 247M 0s 2019-12-09T10:04:33.634 INFO:teuthology.orchestra.run.smithi121.stderr: 16900K .......... .......... .......... .......... .......... 23% 256M 0s 2019-12-09T10:04:33.634 INFO:teuthology.orchestra.run.smithi121.stderr: 16950K .......... .......... .......... .......... .......... 23% 221M 0s 2019-12-09T10:04:33.634 INFO:teuthology.orchestra.run.smithi121.stderr: 17000K .......... .......... .......... .......... .......... 23% 263M 0s 2019-12-09T10:04:33.634 INFO:teuthology.orchestra.run.smithi121.stderr: 17050K .......... .......... .......... .......... .......... 23% 276M 0s 2019-12-09T10:04:33.634 INFO:teuthology.orchestra.run.smithi121.stderr: 17100K .......... .......... .......... .......... .......... 23% 262M 0s 2019-12-09T10:04:33.635 INFO:teuthology.orchestra.run.smithi121.stderr: 17150K .......... .......... .......... .......... .......... 23% 226M 0s 2019-12-09T10:04:33.635 INFO:teuthology.orchestra.run.smithi121.stderr: 17200K .......... .......... .......... .......... .......... 23% 264M 0s 2019-12-09T10:04:33.635 INFO:teuthology.orchestra.run.smithi121.stderr: 17250K .......... .......... .......... .......... .......... 23% 272M 0s 2019-12-09T10:04:33.635 INFO:teuthology.orchestra.run.smithi121.stderr: 17300K .......... .......... .......... .......... .......... 23% 263M 0s 2019-12-09T10:04:33.635 INFO:teuthology.orchestra.run.smithi121.stderr: 17350K .......... .......... .......... .......... .......... 23% 225M 0s 2019-12-09T10:04:33.635 INFO:teuthology.orchestra.run.smithi121.stderr: 17400K .......... .......... .......... .......... .......... 23% 273M 0s 2019-12-09T10:04:33.635 INFO:teuthology.orchestra.run.smithi121.stderr: 17450K .......... .......... .......... .......... .......... 23% 278M 0s 2019-12-09T10:04:33.636 INFO:teuthology.orchestra.run.smithi121.stderr: 17500K .......... .......... .......... .......... .......... 23% 281M 0s 2019-12-09T10:04:33.636 INFO:teuthology.orchestra.run.smithi121.stderr: 17550K .......... .......... .......... .......... .......... 23% 235M 0s 2019-12-09T10:04:33.636 INFO:teuthology.orchestra.run.smithi121.stderr: 17600K .......... .......... .......... .......... .......... 23% 259M 0s 2019-12-09T10:04:33.636 INFO:teuthology.orchestra.run.smithi121.stderr: 17650K .......... .......... .......... .......... .......... 24% 261M 0s 2019-12-09T10:04:33.636 INFO:teuthology.orchestra.run.smithi121.stderr: 17700K .......... .......... .......... .......... .......... 24% 281M 0s 2019-12-09T10:04:33.636 INFO:teuthology.orchestra.run.smithi121.stderr: 17750K .......... .......... .......... .......... .......... 24% 219M 0s 2019-12-09T10:04:33.636 INFO:teuthology.orchestra.run.smithi121.stderr: 17800K .......... .......... .......... .......... .......... 24% 284M 0s 2019-12-09T10:04:33.637 INFO:teuthology.orchestra.run.smithi121.stderr: 17850K .......... .......... .......... .......... .......... 24% 278M 0s 2019-12-09T10:04:33.637 INFO:teuthology.orchestra.run.smithi121.stderr: 17900K .......... .......... .......... .......... .......... 24% 257M 0s 2019-12-09T10:04:33.637 INFO:teuthology.orchestra.run.smithi121.stderr: 17950K .......... .......... .......... .......... .......... 24% 231M 0s 2019-12-09T10:04:33.637 INFO:teuthology.orchestra.run.smithi121.stderr: 18000K .......... .......... .......... .......... .......... 24% 256M 0s 2019-12-09T10:04:33.637 INFO:teuthology.orchestra.run.smithi121.stderr: 18050K .......... .......... .......... .......... .......... 24% 268M 0s 2019-12-09T10:04:33.637 INFO:teuthology.orchestra.run.smithi121.stderr: 18100K .......... .......... .......... .......... .......... 24% 257M 0s 2019-12-09T10:04:33.637 INFO:teuthology.orchestra.run.smithi121.stderr: 18150K .......... .......... .......... .......... .......... 24% 206M 0s 2019-12-09T10:04:33.637 INFO:teuthology.orchestra.run.smithi121.stderr: 18200K .......... .......... .......... .......... .......... 24% 263M 0s 2019-12-09T10:04:33.638 INFO:teuthology.orchestra.run.smithi121.stderr: 18250K .......... .......... .......... .......... .......... 24% 263M 0s 2019-12-09T10:04:33.638 INFO:teuthology.orchestra.run.smithi121.stderr: 18300K .......... .......... .......... .......... .......... 24% 262M 0s 2019-12-09T10:04:33.638 INFO:teuthology.orchestra.run.smithi121.stderr: 18350K .......... .......... .......... .......... .......... 25% 234M 0s 2019-12-09T10:04:33.638 INFO:teuthology.orchestra.run.smithi121.stderr: 18400K .......... .......... .......... .......... .......... 25% 266M 0s 2019-12-09T10:04:33.638 INFO:teuthology.orchestra.run.smithi121.stderr: 18450K .......... .......... .......... .......... .......... 25% 259M 0s 2019-12-09T10:04:33.638 INFO:teuthology.orchestra.run.smithi121.stderr: 18500K .......... .......... .......... .......... .......... 25% 265M 0s 2019-12-09T10:04:33.638 INFO:teuthology.orchestra.run.smithi121.stderr: 18550K .......... .......... .......... .......... .......... 25% 229M 0s 2019-12-09T10:04:33.639 INFO:teuthology.orchestra.run.smithi121.stderr: 18600K .......... .......... .......... .......... .......... 25% 272M 0s 2019-12-09T10:04:33.639 INFO:teuthology.orchestra.run.smithi121.stderr: 18650K .......... .......... .......... .......... .......... 25% 271M 0s 2019-12-09T10:04:33.639 INFO:teuthology.orchestra.run.smithi121.stderr: 18700K .......... .......... .......... .......... .......... 25% 249M 0s 2019-12-09T10:04:33.639 INFO:teuthology.orchestra.run.smithi121.stderr: 18750K .......... .......... .......... .......... .......... 25% 217M 0s 2019-12-09T10:04:33.639 INFO:teuthology.orchestra.run.smithi121.stderr: 18800K .......... .......... .......... .......... .......... 25% 273M 0s 2019-12-09T10:04:33.639 INFO:teuthology.orchestra.run.smithi121.stderr: 18850K .......... .......... .......... .......... .......... 25% 275M 0s 2019-12-09T10:04:33.639 INFO:teuthology.orchestra.run.smithi121.stderr: 18900K .......... .......... .......... .......... .......... 25% 280M 0s 2019-12-09T10:04:33.640 INFO:teuthology.orchestra.run.smithi121.stderr: 18950K .......... .......... .......... .......... .......... 25% 221M 0s 2019-12-09T10:04:33.640 INFO:teuthology.orchestra.run.smithi121.stderr: 19000K .......... .......... .......... .......... .......... 25% 264M 0s 2019-12-09T10:04:33.640 INFO:teuthology.orchestra.run.smithi121.stderr: 19050K .......... .......... .......... .......... .......... 25% 265M 0s 2019-12-09T10:04:33.640 INFO:teuthology.orchestra.run.smithi121.stderr: 19100K .......... .......... .......... .......... .......... 26% 261M 0s 2019-12-09T10:04:33.640 INFO:teuthology.orchestra.run.smithi121.stderr: 19150K .......... .......... .......... .......... .......... 26% 233M 0s 2019-12-09T10:04:33.640 INFO:teuthology.orchestra.run.smithi121.stderr: 19200K .......... .......... .......... .......... .......... 26% 268M 0s 2019-12-09T10:04:33.640 INFO:teuthology.orchestra.run.smithi121.stderr: 19250K .......... .......... .......... .......... .......... 26% 274M 0s 2019-12-09T10:04:33.641 INFO:teuthology.orchestra.run.smithi121.stderr: 19300K .......... .......... .......... .......... .......... 26% 278M 0s 2019-12-09T10:04:33.641 INFO:teuthology.orchestra.run.smithi121.stderr: 19350K .......... .......... .......... .......... .......... 26% 230M 0s 2019-12-09T10:04:33.641 INFO:teuthology.orchestra.run.smithi121.stderr: 19400K .......... .......... .......... .......... .......... 26% 278M 0s 2019-12-09T10:04:33.641 INFO:teuthology.orchestra.run.smithi121.stderr: 19450K .......... .......... .......... .......... .......... 26% 283M 0s 2019-12-09T10:04:33.641 INFO:teuthology.orchestra.run.smithi121.stderr: 19500K .......... .......... .......... .......... .......... 26% 276M 0s 2019-12-09T10:04:33.641 INFO:teuthology.orchestra.run.smithi121.stderr: 19550K .......... .......... .......... .......... .......... 26% 253M 0s 2019-12-09T10:04:33.641 INFO:teuthology.orchestra.run.smithi121.stderr: 19600K .......... .......... .......... .......... .......... 26% 271M 0s 2019-12-09T10:04:33.642 INFO:teuthology.orchestra.run.smithi121.stderr: 19650K .......... .......... .......... .......... .......... 26% 288M 0s 2019-12-09T10:04:33.642 INFO:teuthology.orchestra.run.smithi121.stderr: 19700K .......... .......... .......... .......... .......... 26% 289M 0s 2019-12-09T10:04:33.642 INFO:teuthology.orchestra.run.smithi121.stderr: 19750K .......... .......... .......... .......... .......... 26% 228M 0s 2019-12-09T10:04:33.642 INFO:teuthology.orchestra.run.smithi121.stderr: 19800K .......... .......... .......... .......... .......... 26% 293M 0s 2019-12-09T10:04:33.642 INFO:teuthology.orchestra.run.smithi121.stderr: 19850K .......... .......... .......... .......... .......... 27% 294M 0s 2019-12-09T10:04:33.642 INFO:teuthology.orchestra.run.smithi121.stderr: 19900K .......... .......... .......... .......... .......... 27% 288M 0s 2019-12-09T10:04:33.642 INFO:teuthology.orchestra.run.smithi121.stderr: 19950K .......... .......... .......... .......... .......... 27% 230M 0s 2019-12-09T10:04:33.643 INFO:teuthology.orchestra.run.smithi121.stderr: 20000K .......... .......... .......... .......... .......... 27% 289M 0s 2019-12-09T10:04:33.643 INFO:teuthology.orchestra.run.smithi121.stderr: 20050K .......... .......... .......... .......... .......... 27% 273M 0s 2019-12-09T10:04:33.643 INFO:teuthology.orchestra.run.smithi121.stderr: 20100K .......... .......... .......... .......... .......... 27% 290M 0s 2019-12-09T10:04:33.643 INFO:teuthology.orchestra.run.smithi121.stderr: 20150K .......... .......... .......... .......... .......... 27% 211M 0s 2019-12-09T10:04:33.643 INFO:teuthology.orchestra.run.smithi121.stderr: 20200K .......... .......... .......... .......... .......... 27% 271M 0s 2019-12-09T10:04:33.643 INFO:teuthology.orchestra.run.smithi121.stderr: 20250K .......... .......... .......... .......... .......... 27% 274M 0s 2019-12-09T10:04:33.643 INFO:teuthology.orchestra.run.smithi121.stderr: 20300K .......... .......... .......... .......... .......... 27% 269M 0s 2019-12-09T10:04:33.644 INFO:teuthology.orchestra.run.smithi121.stderr: 20350K .......... .......... .......... .......... .......... 27% 238M 0s 2019-12-09T10:04:33.644 INFO:teuthology.orchestra.run.smithi121.stderr: 20400K .......... .......... .......... .......... .......... 27% 272M 0s 2019-12-09T10:04:33.644 INFO:teuthology.orchestra.run.smithi121.stderr: 20450K .......... .......... .......... .......... .......... 27% 276M 0s 2019-12-09T10:04:33.644 INFO:teuthology.orchestra.run.smithi121.stderr: 20500K .......... .......... .......... .......... .......... 27% 297M 0s 2019-12-09T10:04:33.644 INFO:teuthology.orchestra.run.smithi121.stderr: 20550K .......... .......... .......... .......... .......... 28% 226M 0s 2019-12-09T10:04:33.644 INFO:teuthology.orchestra.run.smithi121.stderr: 20600K .......... .......... .......... .......... .......... 28% 257M 0s 2019-12-09T10:04:33.644 INFO:teuthology.orchestra.run.smithi121.stderr: 20650K .......... .......... .......... .......... .......... 28% 285M 0s 2019-12-09T10:04:33.645 INFO:teuthology.orchestra.run.smithi121.stderr: 20700K .......... .......... .......... .......... .......... 28% 280M 0s 2019-12-09T10:04:33.645 INFO:teuthology.orchestra.run.smithi121.stderr: 20750K .......... .......... .......... .......... .......... 28% 250M 0s 2019-12-09T10:04:33.645 INFO:teuthology.orchestra.run.smithi121.stderr: 20800K .......... .......... .......... .......... .......... 28% 287M 0s 2019-12-09T10:04:33.645 INFO:teuthology.orchestra.run.smithi121.stderr: 20850K .......... .......... .......... .......... .......... 28% 280M 0s 2019-12-09T10:04:33.645 INFO:teuthology.orchestra.run.smithi121.stderr: 20900K .......... .......... .......... .......... .......... 28% 297M 0s 2019-12-09T10:04:33.646 INFO:teuthology.orchestra.run.smithi121.stderr: 20950K .......... .......... .......... .......... .......... 28% 248M 0s 2019-12-09T10:04:33.646 INFO:teuthology.orchestra.run.smithi121.stderr: 21000K .......... .......... .......... .......... .......... 28% 294M 0s 2019-12-09T10:04:33.646 INFO:teuthology.orchestra.run.smithi121.stderr: 21050K .......... .......... .......... .......... .......... 28% 287M 0s 2019-12-09T10:04:33.646 INFO:teuthology.orchestra.run.smithi121.stderr: 21100K .......... .......... .......... .......... .......... 28% 279M 0s 2019-12-09T10:04:33.646 INFO:teuthology.orchestra.run.smithi121.stderr: 21150K .......... .......... .......... .......... .......... 28% 244M 0s 2019-12-09T10:04:33.646 INFO:teuthology.orchestra.run.smithi121.stderr: 21200K .......... .......... .......... .......... .......... 28% 274M 0s 2019-12-09T10:04:33.646 INFO:teuthology.orchestra.run.smithi121.stderr: 21250K .......... .......... .......... .......... .......... 28% 278M 0s 2019-12-09T10:04:33.646 INFO:teuthology.orchestra.run.smithi121.stderr: 21300K .......... .......... .......... .......... .......... 29% 280M 0s 2019-12-09T10:04:33.647 INFO:teuthology.orchestra.run.smithi121.stderr: 21350K .......... .......... .......... .......... .......... 29% 240M 0s 2019-12-09T10:04:33.647 INFO:teuthology.orchestra.run.smithi121.stderr: 21400K .......... .......... .......... .......... .......... 29% 282M 0s 2019-12-09T10:04:33.647 INFO:teuthology.orchestra.run.smithi121.stderr: 21450K .......... .......... .......... .......... .......... 29% 272M 0s 2019-12-09T10:04:33.647 INFO:teuthology.orchestra.run.smithi121.stderr: 21500K .......... .......... .......... .......... .......... 29% 272M 0s 2019-12-09T10:04:33.647 INFO:teuthology.orchestra.run.smithi121.stderr: 21550K .......... .......... .......... .......... .......... 29% 251M 0s 2019-12-09T10:04:33.647 INFO:teuthology.orchestra.run.smithi121.stderr: 21600K .......... .......... .......... .......... .......... 29% 298M 0s 2019-12-09T10:04:33.647 INFO:teuthology.orchestra.run.smithi121.stderr: 21650K .......... .......... .......... .......... .......... 29% 278M 0s 2019-12-09T10:04:33.648 INFO:teuthology.orchestra.run.smithi121.stderr: 21700K .......... .......... .......... .......... .......... 29% 282M 0s 2019-12-09T10:04:33.648 INFO:teuthology.orchestra.run.smithi121.stderr: 21750K .......... .......... .......... .......... .......... 29% 246M 0s 2019-12-09T10:04:33.648 INFO:teuthology.orchestra.run.smithi121.stderr: 21800K .......... .......... .......... .......... .......... 29% 291M 0s 2019-12-09T10:04:33.648 INFO:teuthology.orchestra.run.smithi121.stderr: 21850K .......... .......... .......... .......... .......... 29% 275M 0s 2019-12-09T10:04:33.648 INFO:teuthology.orchestra.run.smithi121.stderr: 21900K .......... .......... .......... .......... .......... 29% 298M 0s 2019-12-09T10:04:33.648 INFO:teuthology.orchestra.run.smithi121.stderr: 21950K .......... .......... .......... .......... .......... 29% 241M 0s 2019-12-09T10:04:33.648 INFO:teuthology.orchestra.run.smithi121.stderr: 22000K .......... .......... .......... .......... .......... 29% 276M 0s 2019-12-09T10:04:33.649 INFO:teuthology.orchestra.run.smithi121.stderr: 22050K .......... .......... .......... .......... .......... 30% 271M 0s 2019-12-09T10:04:33.649 INFO:teuthology.orchestra.run.smithi121.stderr: 22100K .......... .......... .......... .......... .......... 30% 284M 0s 2019-12-09T10:04:33.649 INFO:teuthology.orchestra.run.smithi121.stderr: 22150K .......... .......... .......... .......... .......... 30% 222M 0s 2019-12-09T10:04:33.649 INFO:teuthology.orchestra.run.smithi121.stderr: 22200K .......... .......... .......... .......... .......... 30% 292M 0s 2019-12-09T10:04:33.649 INFO:teuthology.orchestra.run.smithi121.stderr: 22250K .......... .......... .......... .......... .......... 30% 277M 0s 2019-12-09T10:04:33.649 INFO:teuthology.orchestra.run.smithi121.stderr: 22300K .......... .......... .......... .......... .......... 30% 272M 0s 2019-12-09T10:04:33.649 INFO:teuthology.orchestra.run.smithi121.stderr: 22350K .......... .......... .......... .......... .......... 30% 237M 0s 2019-12-09T10:04:33.649 INFO:teuthology.orchestra.run.smithi121.stderr: 22400K .......... .......... .......... .......... .......... 30% 275M 0s 2019-12-09T10:04:33.650 INFO:teuthology.orchestra.run.smithi121.stderr: 22450K .......... .......... .......... .......... .......... 30% 280M 0s 2019-12-09T10:04:33.650 INFO:teuthology.orchestra.run.smithi121.stderr: 22500K .......... .......... .......... .......... .......... 30% 268M 0s 2019-12-09T10:04:33.650 INFO:teuthology.orchestra.run.smithi121.stderr: 22550K .......... .......... .......... .......... .......... 30% 225M 0s 2019-12-09T10:04:33.650 INFO:teuthology.orchestra.run.smithi121.stderr: 22600K .......... .......... .......... .......... .......... 30% 292M 0s 2019-12-09T10:04:33.650 INFO:teuthology.orchestra.run.smithi121.stderr: 22650K .......... .......... .......... .......... .......... 30% 295M 0s 2019-12-09T10:04:33.650 INFO:teuthology.orchestra.run.smithi121.stderr: 22700K .......... .......... .......... .......... .......... 30% 287M 0s 2019-12-09T10:04:33.650 INFO:teuthology.orchestra.run.smithi121.stderr: 22750K .......... .......... .......... .......... .......... 30% 254M 0s 2019-12-09T10:04:33.651 INFO:teuthology.orchestra.run.smithi121.stderr: 22800K .......... .......... .......... .......... .......... 31% 281M 0s 2019-12-09T10:04:33.651 INFO:teuthology.orchestra.run.smithi121.stderr: 22850K .......... .......... .......... .......... .......... 31% 288M 0s 2019-12-09T10:04:33.651 INFO:teuthology.orchestra.run.smithi121.stderr: 22900K .......... .......... .......... .......... .......... 31% 276M 0s 2019-12-09T10:04:33.651 INFO:teuthology.orchestra.run.smithi121.stderr: 22950K .......... .......... .......... .......... .......... 31% 258M 0s 2019-12-09T10:04:33.651 INFO:teuthology.orchestra.run.smithi121.stderr: 23000K .......... .......... .......... .......... .......... 31% 297M 0s 2019-12-09T10:04:33.651 INFO:teuthology.orchestra.run.smithi121.stderr: 23050K .......... .......... .......... .......... .......... 31% 305M 0s 2019-12-09T10:04:33.651 INFO:teuthology.orchestra.run.smithi121.stderr: 23100K .......... .......... .......... .......... .......... 31% 285M 0s 2019-12-09T10:04:33.652 INFO:teuthology.orchestra.run.smithi121.stderr: 23150K .......... .......... .......... .......... .......... 31% 273M 0s 2019-12-09T10:04:33.652 INFO:teuthology.orchestra.run.smithi121.stderr: 23200K .......... .......... .......... .......... .......... 31% 299M 0s 2019-12-09T10:04:33.652 INFO:teuthology.orchestra.run.smithi121.stderr: 23250K .......... .......... .......... .......... .......... 31% 296M 0s 2019-12-09T10:04:33.652 INFO:teuthology.orchestra.run.smithi121.stderr: 23300K .......... .......... .......... .......... .......... 31% 297M 0s 2019-12-09T10:04:33.652 INFO:teuthology.orchestra.run.smithi121.stderr: 23350K .......... .......... .......... .......... .......... 31% 245M 0s 2019-12-09T10:04:33.652 INFO:teuthology.orchestra.run.smithi121.stderr: 23400K .......... .......... .......... .......... .......... 31% 305M 0s 2019-12-09T10:04:33.652 INFO:teuthology.orchestra.run.smithi121.stderr: 23450K .......... .......... .......... .......... .......... 31% 287M 0s 2019-12-09T10:04:33.652 INFO:teuthology.orchestra.run.smithi121.stderr: 23500K .......... .......... .......... .......... .......... 32% 293M 0s 2019-12-09T10:04:33.653 INFO:teuthology.orchestra.run.smithi121.stderr: 23550K .......... .......... .......... .......... .......... 32% 259M 0s 2019-12-09T10:04:33.653 INFO:teuthology.orchestra.run.smithi121.stderr: 23600K .......... .......... .......... .......... .......... 32% 310M 0s 2019-12-09T10:04:33.653 INFO:teuthology.orchestra.run.smithi121.stderr: 23650K .......... .......... .......... .......... .......... 32% 263M 0s 2019-12-09T10:04:33.653 INFO:teuthology.orchestra.run.smithi121.stderr: 23700K .......... .......... .......... .......... .......... 32% 263M 0s 2019-12-09T10:04:33.653 INFO:teuthology.orchestra.run.smithi121.stderr: 23750K .......... .......... .......... .......... .......... 32% 250M 0s 2019-12-09T10:04:33.653 INFO:teuthology.orchestra.run.smithi121.stderr: 23800K .......... .......... .......... .......... .......... 32% 269M 0s 2019-12-09T10:04:33.653 INFO:teuthology.orchestra.run.smithi121.stderr: 23850K .......... .......... .......... .......... .......... 32% 277M 0s 2019-12-09T10:04:33.654 INFO:teuthology.orchestra.run.smithi121.stderr: 23900K .......... .......... .......... .......... .......... 32% 307M 0s 2019-12-09T10:04:33.654 INFO:teuthology.orchestra.run.smithi121.stderr: 23950K .......... .......... .......... .......... .......... 32% 251M 0s 2019-12-09T10:04:33.654 INFO:teuthology.orchestra.run.smithi121.stderr: 24000K .......... .......... .......... .......... .......... 32% 271M 0s 2019-12-09T10:04:33.654 INFO:teuthology.orchestra.run.smithi121.stderr: 24050K .......... .......... .......... .......... .......... 32% 317M 0s 2019-12-09T10:04:33.654 INFO:teuthology.orchestra.run.smithi121.stderr: 24100K .......... .......... .......... .......... .......... 32% 282M 0s 2019-12-09T10:04:33.654 INFO:teuthology.orchestra.run.smithi121.stderr: 24150K .......... .......... .......... .......... .......... 32% 235M 0s 2019-12-09T10:04:33.654 INFO:teuthology.orchestra.run.smithi121.stderr: 24200K .......... .......... .......... .......... .......... 32% 276M 0s 2019-12-09T10:04:33.655 INFO:teuthology.orchestra.run.smithi121.stderr: 24250K .......... .......... .......... .......... .......... 33% 282M 0s 2019-12-09T10:04:33.655 INFO:teuthology.orchestra.run.smithi121.stderr: 24300K .......... .......... .......... .......... .......... 33% 276M 0s 2019-12-09T10:04:33.655 INFO:teuthology.orchestra.run.smithi121.stderr: 24350K .......... .......... .......... .......... .......... 33% 258M 0s 2019-12-09T10:04:33.655 INFO:teuthology.orchestra.run.smithi121.stderr: 24400K .......... .......... .......... .......... .......... 33% 289M 0s 2019-12-09T10:04:33.655 INFO:teuthology.orchestra.run.smithi121.stderr: 24450K .......... .......... .......... .......... .......... 33% 275M 0s 2019-12-09T10:04:33.655 INFO:teuthology.orchestra.run.smithi121.stderr: 24500K .......... .......... .......... .......... .......... 33% 303M 0s 2019-12-09T10:04:33.655 INFO:teuthology.orchestra.run.smithi121.stderr: 24550K .......... .......... .......... .......... .......... 33% 240M 0s 2019-12-09T10:04:33.655 INFO:teuthology.orchestra.run.smithi121.stderr: 24600K .......... .......... .......... .......... .......... 33% 300M 0s 2019-12-09T10:04:33.656 INFO:teuthology.orchestra.run.smithi121.stderr: 24650K .......... .......... .......... .......... .......... 33% 290M 0s 2019-12-09T10:04:33.656 INFO:teuthology.orchestra.run.smithi121.stderr: 24700K .......... .......... .......... .......... .......... 33% 291M 0s 2019-12-09T10:04:33.656 INFO:teuthology.orchestra.run.smithi121.stderr: 24750K .......... .......... .......... .......... .......... 33% 267M 0s 2019-12-09T10:04:33.656 INFO:teuthology.orchestra.run.smithi121.stderr: 24800K .......... .......... .......... .......... .......... 33% 278M 0s 2019-12-09T10:04:33.656 INFO:teuthology.orchestra.run.smithi121.stderr: 24850K .......... .......... .......... .......... .......... 33% 312M 0s 2019-12-09T10:04:33.656 INFO:teuthology.orchestra.run.smithi121.stderr: 24900K .......... .......... .......... .......... .......... 33% 310M 0s 2019-12-09T10:04:33.656 INFO:teuthology.orchestra.run.smithi121.stderr: 24950K .......... .......... .......... .......... .......... 33% 241M 0s 2019-12-09T10:04:33.657 INFO:teuthology.orchestra.run.smithi121.stderr: 25000K .......... .......... .......... .......... .......... 34% 300M 0s 2019-12-09T10:04:33.657 INFO:teuthology.orchestra.run.smithi121.stderr: 25050K .......... .......... .......... .......... .......... 34% 281M 0s 2019-12-09T10:04:33.657 INFO:teuthology.orchestra.run.smithi121.stderr: 25100K .......... .......... .......... .......... .......... 34% 294M 0s 2019-12-09T10:04:33.657 INFO:teuthology.orchestra.run.smithi121.stderr: 25150K .......... .......... .......... .......... .......... 34% 262M 0s 2019-12-09T10:04:33.657 INFO:teuthology.orchestra.run.smithi121.stderr: 25200K .......... .......... .......... .......... .......... 34% 304M 0s 2019-12-09T10:04:33.657 INFO:teuthology.orchestra.run.smithi121.stderr: 25250K .......... .......... .......... .......... .......... 34% 282M 0s 2019-12-09T10:04:33.657 INFO:teuthology.orchestra.run.smithi121.stderr: 25300K .......... .......... .......... .......... .......... 34% 249M 0s 2019-12-09T10:04:33.658 INFO:teuthology.orchestra.run.smithi121.stderr: 25350K .......... .......... .......... .......... .......... 34% 239M 0s 2019-12-09T10:04:33.658 INFO:teuthology.orchestra.run.smithi121.stderr: 25400K .......... .......... .......... .......... .......... 34% 243M 0s 2019-12-09T10:04:33.658 INFO:teuthology.orchestra.run.smithi121.stderr: 25450K .......... .......... .......... .......... .......... 34% 280M 0s 2019-12-09T10:04:33.658 INFO:teuthology.orchestra.run.smithi121.stderr: 25500K .......... .......... .......... .......... .......... 34% 280M 0s 2019-12-09T10:04:33.658 INFO:teuthology.orchestra.run.smithi121.stderr: 25550K .......... .......... .......... .......... .......... 34% 267M 0s 2019-12-09T10:04:33.658 INFO:teuthology.orchestra.run.smithi121.stderr: 25600K .......... .......... .......... .......... .......... 34% 292M 0s 2019-12-09T10:04:33.658 INFO:teuthology.orchestra.run.smithi121.stderr: 25650K .......... .......... .......... .......... .......... 34% 294M 0s 2019-12-09T10:04:33.659 INFO:teuthology.orchestra.run.smithi121.stderr: 25700K .......... .......... .......... .......... .......... 35% 293M 0s 2019-12-09T10:04:33.659 INFO:teuthology.orchestra.run.smithi121.stderr: 25750K .......... .......... .......... .......... .......... 35% 256M 0s 2019-12-09T10:04:33.659 INFO:teuthology.orchestra.run.smithi121.stderr: 25800K .......... .......... .......... .......... .......... 35% 289M 0s 2019-12-09T10:04:33.659 INFO:teuthology.orchestra.run.smithi121.stderr: 25850K .......... .......... .......... .......... .......... 35% 314M 0s 2019-12-09T10:04:33.659 INFO:teuthology.orchestra.run.smithi121.stderr: 25900K .......... .......... .......... .......... .......... 35% 302M 0s 2019-12-09T10:04:33.659 INFO:teuthology.orchestra.run.smithi121.stderr: 25950K .......... .......... .......... .......... .......... 35% 279M 0s 2019-12-09T10:04:33.659 INFO:teuthology.orchestra.run.smithi121.stderr: 26000K .......... .......... .......... .......... .......... 35% 308M 0s 2019-12-09T10:04:33.659 INFO:teuthology.orchestra.run.smithi121.stderr: 26050K .......... .......... .......... .......... .......... 35% 309M 0s 2019-12-09T10:04:33.660 INFO:teuthology.orchestra.run.smithi121.stderr: 26100K .......... .......... .......... .......... .......... 35% 313M 0s 2019-12-09T10:04:33.660 INFO:teuthology.orchestra.run.smithi121.stderr: 26150K .......... .......... .......... .......... .......... 35% 261M 0s 2019-12-09T10:04:33.660 INFO:teuthology.orchestra.run.smithi121.stderr: 26200K .......... .......... .......... .......... .......... 35% 311M 0s 2019-12-09T10:04:33.660 INFO:teuthology.orchestra.run.smithi121.stderr: 26250K .......... .......... .......... .......... .......... 35% 300M 0s 2019-12-09T10:04:33.660 INFO:teuthology.orchestra.run.smithi121.stderr: 26300K .......... .......... .......... .......... .......... 35% 308M 0s 2019-12-09T10:04:33.660 INFO:teuthology.orchestra.run.smithi121.stderr: 26350K .......... .......... .......... .......... .......... 35% 272M 0s 2019-12-09T10:04:33.660 INFO:teuthology.orchestra.run.smithi121.stderr: 26400K .......... .......... .......... .......... .......... 35% 322M 0s 2019-12-09T10:04:33.661 INFO:teuthology.orchestra.run.smithi121.stderr: 26450K .......... .......... .......... .......... .......... 36% 314M 0s 2019-12-09T10:04:33.661 INFO:teuthology.orchestra.run.smithi121.stderr: 26500K .......... .......... .......... .......... .......... 36% 311M 0s 2019-12-09T10:04:33.661 INFO:teuthology.orchestra.run.smithi121.stderr: 26550K .......... .......... .......... .......... .......... 36% 245M 0s 2019-12-09T10:04:33.661 INFO:teuthology.orchestra.run.smithi121.stderr: 26600K .......... .......... .......... .......... .......... 36% 299M 0s 2019-12-09T10:04:33.661 INFO:teuthology.orchestra.run.smithi121.stderr: 26650K .......... .......... .......... .......... .......... 36% 322M 0s 2019-12-09T10:04:33.661 INFO:teuthology.orchestra.run.smithi121.stderr: 26700K .......... .......... .......... .......... .......... 36% 321M 0s 2019-12-09T10:04:33.661 INFO:teuthology.orchestra.run.smithi121.stderr: 26750K .......... .......... .......... .......... .......... 36% 258M 0s 2019-12-09T10:04:33.662 INFO:teuthology.orchestra.run.smithi121.stderr: 26800K .......... .......... .......... .......... .......... 36% 286M 0s 2019-12-09T10:04:33.662 INFO:teuthology.orchestra.run.smithi121.stderr: 26850K .......... .......... .......... .......... .......... 36% 285M 0s 2019-12-09T10:04:33.662 INFO:teuthology.orchestra.run.smithi121.stderr: 26900K .......... .......... .......... .......... .......... 36% 302M 0s 2019-12-09T10:04:33.662 INFO:teuthology.orchestra.run.smithi121.stderr: 26950K .......... .......... .......... .......... .......... 36% 243M 0s 2019-12-09T10:04:33.662 INFO:teuthology.orchestra.run.smithi121.stderr: 27000K .......... .......... .......... .......... .......... 36% 287M 0s 2019-12-09T10:04:33.662 INFO:teuthology.orchestra.run.smithi121.stderr: 27050K .......... .......... .......... .......... .......... 36% 295M 0s 2019-12-09T10:04:33.662 INFO:teuthology.orchestra.run.smithi121.stderr: 27100K .......... .......... .......... .......... .......... 36% 294M 0s 2019-12-09T10:04:33.663 INFO:teuthology.orchestra.run.smithi121.stderr: 27150K .......... .......... .......... .......... .......... 36% 278M 0s 2019-12-09T10:04:33.663 INFO:teuthology.orchestra.run.smithi121.stderr: 27200K .......... .......... .......... .......... .......... 37% 308M 0s 2019-12-09T10:04:33.663 INFO:teuthology.orchestra.run.smithi121.stderr: 27250K .......... .......... .......... .......... .......... 37% 322M 0s 2019-12-09T10:04:33.663 INFO:teuthology.orchestra.run.smithi121.stderr: 27300K .......... .......... .......... .......... .......... 37% 311M 0s 2019-12-09T10:04:33.663 INFO:teuthology.orchestra.run.smithi121.stderr: 27350K .......... .......... .......... .......... .......... 37% 264M 0s 2019-12-09T10:04:33.663 INFO:teuthology.orchestra.run.smithi121.stderr: 27400K .......... .......... .......... .......... .......... 37% 306M 0s 2019-12-09T10:04:33.663 INFO:teuthology.orchestra.run.smithi121.stderr: 27450K .......... .......... .......... .......... .......... 37% 292M 0s 2019-12-09T10:04:33.663 INFO:teuthology.orchestra.run.smithi121.stderr: 27500K .......... .......... .......... .......... .......... 37% 301M 0s 2019-12-09T10:04:33.664 INFO:teuthology.orchestra.run.smithi121.stderr: 27550K .......... .......... .......... .......... .......... 37% 279M 0s 2019-12-09T10:04:33.664 INFO:teuthology.orchestra.run.smithi121.stderr: 27600K .......... .......... .......... .......... .......... 37% 309M 0s 2019-12-09T10:04:33.664 INFO:teuthology.orchestra.run.smithi121.stderr: 27650K .......... .......... .......... .......... .......... 37% 306M 0s 2019-12-09T10:04:33.664 INFO:teuthology.orchestra.run.smithi121.stderr: 27700K .......... .......... .......... .......... .......... 37% 306M 0s 2019-12-09T10:04:33.664 INFO:teuthology.orchestra.run.smithi121.stderr: 27750K .......... .......... .......... .......... .......... 37% 257M 0s 2019-12-09T10:04:33.664 INFO:teuthology.orchestra.run.smithi121.stderr: 27800K .......... .......... .......... .......... .......... 37% 303M 0s 2019-12-09T10:04:33.664 INFO:teuthology.orchestra.run.smithi121.stderr: 27850K .......... .......... .......... .......... .......... 37% 310M 0s 2019-12-09T10:04:33.665 INFO:teuthology.orchestra.run.smithi121.stderr: 27900K .......... .......... .......... .......... .......... 37% 314M 0s 2019-12-09T10:04:33.665 INFO:teuthology.orchestra.run.smithi121.stderr: 27950K .......... .......... .......... .......... .......... 38% 264M 0s 2019-12-09T10:04:33.665 INFO:teuthology.orchestra.run.smithi121.stderr: 28000K .......... .......... .......... .......... .......... 38% 301M 0s 2019-12-09T10:04:33.665 INFO:teuthology.orchestra.run.smithi121.stderr: 28050K .......... .......... .......... .......... .......... 38% 304M 0s 2019-12-09T10:04:33.665 INFO:teuthology.orchestra.run.smithi121.stderr: 28100K .......... .......... .......... .......... .......... 38% 297M 0s 2019-12-09T10:04:33.665 INFO:teuthology.orchestra.run.smithi121.stderr: 28150K .......... .......... .......... .......... .......... 38% 248M 0s 2019-12-09T10:04:33.665 INFO:teuthology.orchestra.run.smithi121.stderr: 28200K .......... .......... .......... .......... .......... 38% 316M 0s 2019-12-09T10:04:33.666 INFO:teuthology.orchestra.run.smithi121.stderr: 28250K .......... .......... .......... .......... .......... 38% 318M 0s 2019-12-09T10:04:33.666 INFO:teuthology.orchestra.run.smithi121.stderr: 28300K .......... .......... .......... .......... .......... 38% 302M 0s 2019-12-09T10:04:33.666 INFO:teuthology.orchestra.run.smithi121.stderr: 28350K .......... .......... .......... .......... .......... 38% 242M 0s 2019-12-09T10:04:33.666 INFO:teuthology.orchestra.run.smithi121.stderr: 28400K .......... .......... .......... .......... .......... 38% 306M 0s 2019-12-09T10:04:33.666 INFO:teuthology.orchestra.run.smithi121.stderr: 28450K .......... .......... .......... .......... .......... 38% 294M 0s 2019-12-09T10:04:33.666 INFO:teuthology.orchestra.run.smithi121.stderr: 28500K .......... .......... .......... .......... .......... 38% 305M 0s 2019-12-09T10:04:33.666 INFO:teuthology.orchestra.run.smithi121.stderr: 28550K .......... .......... .......... .......... .......... 38% 250M 0s 2019-12-09T10:04:33.666 INFO:teuthology.orchestra.run.smithi121.stderr: 28600K .......... .......... .......... .......... .......... 38% 306M 0s 2019-12-09T10:04:33.667 INFO:teuthology.orchestra.run.smithi121.stderr: 28650K .......... .......... .......... .......... .......... 39% 322M 0s 2019-12-09T10:04:33.667 INFO:teuthology.orchestra.run.smithi121.stderr: 28700K .......... .......... .......... .......... .......... 39% 316M 0s 2019-12-09T10:04:33.667 INFO:teuthology.orchestra.run.smithi121.stderr: 28750K .......... .......... .......... .......... .......... 39% 288M 0s 2019-12-09T10:04:33.667 INFO:teuthology.orchestra.run.smithi121.stderr: 28800K .......... .......... .......... .......... .......... 39% 295M 0s 2019-12-09T10:04:33.667 INFO:teuthology.orchestra.run.smithi121.stderr: 28850K .......... .......... .......... .......... .......... 39% 317M 0s 2019-12-09T10:04:33.667 INFO:teuthology.orchestra.run.smithi121.stderr: 28900K .......... .......... .......... .......... .......... 39% 315M 0s 2019-12-09T10:04:33.667 INFO:teuthology.orchestra.run.smithi121.stderr: 28950K .......... .......... .......... .......... .......... 39% 267M 0s 2019-12-09T10:04:33.668 INFO:teuthology.orchestra.run.smithi121.stderr: 29000K .......... .......... .......... .......... .......... 39% 308M 0s 2019-12-09T10:04:33.668 INFO:teuthology.orchestra.run.smithi121.stderr: 29050K .......... .......... .......... .......... .......... 39% 324M 0s 2019-12-09T10:04:33.668 INFO:teuthology.orchestra.run.smithi121.stderr: 29100K .......... .......... .......... .......... .......... 39% 325M 0s 2019-12-09T10:04:33.668 INFO:teuthology.orchestra.run.smithi121.stderr: 29150K .......... .......... .......... .......... .......... 39% 276M 0s 2019-12-09T10:04:33.668 INFO:teuthology.orchestra.run.smithi121.stderr: 29200K .......... .......... .......... .......... .......... 39% 330M 0s 2019-12-09T10:04:33.668 INFO:teuthology.orchestra.run.smithi121.stderr: 29250K .......... .......... .......... .......... .......... 39% 317M 0s 2019-12-09T10:04:33.668 INFO:teuthology.orchestra.run.smithi121.stderr: 29300K .......... .......... .......... .......... .......... 39% 323M 0s 2019-12-09T10:04:33.669 INFO:teuthology.orchestra.run.smithi121.stderr: 29350K .......... .......... .......... .......... .......... 39% 260M 0s 2019-12-09T10:04:33.669 INFO:teuthology.orchestra.run.smithi121.stderr: 29400K .......... .......... .......... .......... .......... 40% 304M 0s 2019-12-09T10:04:33.669 INFO:teuthology.orchestra.run.smithi121.stderr: 29450K .......... .......... .......... .......... .......... 40% 309M 0s 2019-12-09T10:04:33.669 INFO:teuthology.orchestra.run.smithi121.stderr: 29500K .......... .......... .......... .......... .......... 40% 328M 0s 2019-12-09T10:04:33.669 INFO:teuthology.orchestra.run.smithi121.stderr: 29550K .......... .......... .......... .......... .......... 40% 272M 0s 2019-12-09T10:04:33.669 INFO:teuthology.orchestra.run.smithi121.stderr: 29600K .......... .......... .......... .......... .......... 40% 300M 0s 2019-12-09T10:04:33.669 INFO:teuthology.orchestra.run.smithi121.stderr: 29650K .......... .......... .......... .......... .......... 40% 294M 0s 2019-12-09T10:04:33.670 INFO:teuthology.orchestra.run.smithi121.stderr: 29700K .......... .......... .......... .......... .......... 40% 327M 0s 2019-12-09T10:04:33.670 INFO:teuthology.orchestra.run.smithi121.stderr: 29750K .......... .......... .......... .......... .......... 40% 248M 0s 2019-12-09T10:04:33.670 INFO:teuthology.orchestra.run.smithi121.stderr: 29800K .......... .......... .......... .......... .......... 40% 304M 0s 2019-12-09T10:04:33.670 INFO:teuthology.orchestra.run.smithi121.stderr: 29850K .......... .......... .......... .......... .......... 40% 314M 0s 2019-12-09T10:04:33.670 INFO:teuthology.orchestra.run.smithi121.stderr: 29900K .......... .......... .......... .......... .......... 40% 312M 0s 2019-12-09T10:04:33.670 INFO:teuthology.orchestra.run.smithi121.stderr: 29950K .......... .......... .......... .......... .......... 40% 289M 0s 2019-12-09T10:04:33.670 INFO:teuthology.orchestra.run.smithi121.stderr: 30000K .......... .......... .......... .......... .......... 40% 331M 0s 2019-12-09T10:04:33.670 INFO:teuthology.orchestra.run.smithi121.stderr: 30050K .......... .......... .......... .......... .......... 40% 330M 0s 2019-12-09T10:04:33.671 INFO:teuthology.orchestra.run.smithi121.stderr: 30100K .......... .......... .......... .......... .......... 40% 314M 0s 2019-12-09T10:04:33.671 INFO:teuthology.orchestra.run.smithi121.stderr: 30150K .......... .......... .......... .......... .......... 41% 261M 0s 2019-12-09T10:04:33.671 INFO:teuthology.orchestra.run.smithi121.stderr: 30200K .......... .......... .......... .......... .......... 41% 314M 0s 2019-12-09T10:04:33.671 INFO:teuthology.orchestra.run.smithi121.stderr: 30250K .......... .......... .......... .......... .......... 41% 319M 0s 2019-12-09T10:04:33.671 INFO:teuthology.orchestra.run.smithi121.stderr: 30300K .......... .......... .......... .......... .......... 41% 320M 0s 2019-12-09T10:04:33.671 INFO:teuthology.orchestra.run.smithi121.stderr: 30350K .......... .......... .......... .......... .......... 41% 295M 0s 2019-12-09T10:04:33.671 INFO:teuthology.orchestra.run.smithi121.stderr: 30400K .......... .......... .......... .......... .......... 41% 325M 0s 2019-12-09T10:04:33.672 INFO:teuthology.orchestra.run.smithi121.stderr: 30450K .......... .......... .......... .......... .......... 41% 338M 0s 2019-12-09T10:04:33.672 INFO:teuthology.orchestra.run.smithi121.stderr: 30500K .......... .......... .......... .......... .......... 41% 325M 0s 2019-12-09T10:04:33.672 INFO:teuthology.orchestra.run.smithi121.stderr: 30550K .......... .......... .......... .......... .......... 41% 271M 0s 2019-12-09T10:04:33.672 INFO:teuthology.orchestra.run.smithi121.stderr: 30600K .......... .......... .......... .......... .......... 41% 327M 0s 2019-12-09T10:04:33.672 INFO:teuthology.orchestra.run.smithi121.stderr: 30650K .......... .......... .......... .......... .......... 41% 327M 0s 2019-12-09T10:04:33.672 INFO:teuthology.orchestra.run.smithi121.stderr: 30700K .......... .......... .......... .......... .......... 41% 325M 0s 2019-12-09T10:04:33.672 INFO:teuthology.orchestra.run.smithi121.stderr: 30750K .......... .......... .......... .......... .......... 41% 265M 0s 2019-12-09T10:04:33.673 INFO:teuthology.orchestra.run.smithi121.stderr: 30800K .......... .......... .......... .......... .......... 41% 310M 0s 2019-12-09T10:04:33.673 INFO:teuthology.orchestra.run.smithi121.stderr: 30850K .......... .......... .......... .......... .......... 42% 313M 0s 2019-12-09T10:04:33.673 INFO:teuthology.orchestra.run.smithi121.stderr: 30900K .......... .......... .......... .......... .......... 42% 308M 0s 2019-12-09T10:04:33.673 INFO:teuthology.orchestra.run.smithi121.stderr: 30950K .......... .......... .......... .......... .......... 42% 273M 0s 2019-12-09T10:04:33.673 INFO:teuthology.orchestra.run.smithi121.stderr: 31000K .......... .......... .......... .......... .......... 42% 322M 0s 2019-12-09T10:04:33.673 INFO:teuthology.orchestra.run.smithi121.stderr: 31050K .......... .......... .......... .......... .......... 42% 323M 0s 2019-12-09T10:04:33.674 INFO:teuthology.orchestra.run.smithi121.stderr: 31100K .......... .......... .......... .......... .......... 42% 311M 0s 2019-12-09T10:04:33.674 INFO:teuthology.orchestra.run.smithi121.stderr: 31150K .......... .......... .......... .......... .......... 42% 287M 0s 2019-12-09T10:04:33.674 INFO:teuthology.orchestra.run.smithi121.stderr: 31200K .......... .......... .......... .......... .......... 42% 322M 0s 2019-12-09T10:04:33.674 INFO:teuthology.orchestra.run.smithi121.stderr: 31250K .......... .......... .......... .......... .......... 42% 324M 0s 2019-12-09T10:04:33.674 INFO:teuthology.orchestra.run.smithi121.stderr: 31300K .......... .......... .......... .......... .......... 42% 328M 0s 2019-12-09T10:04:33.674 INFO:teuthology.orchestra.run.smithi121.stderr: 31350K .......... .......... .......... .......... .......... 42% 274M 0s 2019-12-09T10:04:33.674 INFO:teuthology.orchestra.run.smithi121.stderr: 31400K .......... .......... .......... .......... .......... 42% 337M 0s 2019-12-09T10:04:33.675 INFO:teuthology.orchestra.run.smithi121.stderr: 31450K .......... .......... .......... .......... .......... 42% 282M 0s 2019-12-09T10:04:33.675 INFO:teuthology.orchestra.run.smithi121.stderr: 31500K .......... .......... .......... .......... .......... 42% 330M 0s 2019-12-09T10:04:33.675 INFO:teuthology.orchestra.run.smithi121.stderr: 31550K .......... .......... .......... .......... .......... 42% 272M 0s 2019-12-09T10:04:33.675 INFO:teuthology.orchestra.run.smithi121.stderr: 31600K .......... .......... .......... .......... .......... 43% 329M 0s 2019-12-09T10:04:33.675 INFO:teuthology.orchestra.run.smithi121.stderr: 31650K .......... .......... .......... .......... .......... 43% 320M 0s 2019-12-09T10:04:33.675 INFO:teuthology.orchestra.run.smithi121.stderr: 31700K .......... .......... .......... .......... .......... 43% 321M 0s 2019-12-09T10:04:33.675 INFO:teuthology.orchestra.run.smithi121.stderr: 31750K .......... .......... .......... .......... .......... 43% 276M 0s 2019-12-09T10:04:33.676 INFO:teuthology.orchestra.run.smithi121.stderr: 31800K .......... .......... .......... .......... .......... 43% 319M 0s 2019-12-09T10:04:33.676 INFO:teuthology.orchestra.run.smithi121.stderr: 31850K .......... .......... .......... .......... .......... 43% 321M 0s 2019-12-09T10:04:33.676 INFO:teuthology.orchestra.run.smithi121.stderr: 31900K .......... .......... .......... .......... .......... 43% 345M 0s 2019-12-09T10:04:33.676 INFO:teuthology.orchestra.run.smithi121.stderr: 31950K .......... .......... .......... .......... .......... 43% 269M 0s 2019-12-09T10:04:33.676 INFO:teuthology.orchestra.run.smithi121.stderr: 32000K .......... .......... .......... .......... .......... 43% 344M 0s 2019-12-09T10:04:33.676 INFO:teuthology.orchestra.run.smithi121.stderr: 32050K .......... .......... .......... .......... .......... 43% 335M 0s 2019-12-09T10:04:33.676 INFO:teuthology.orchestra.run.smithi121.stderr: 32100K .......... .......... .......... .......... .......... 43% 332M 0s 2019-12-09T10:04:33.677 INFO:teuthology.orchestra.run.smithi121.stderr: 32150K .......... .......... .......... .......... .......... 43% 290M 0s 2019-12-09T10:04:33.677 INFO:teuthology.orchestra.run.smithi121.stderr: 32200K .......... .......... .......... .......... .......... 43% 342M 0s 2019-12-09T10:04:33.677 INFO:teuthology.orchestra.run.smithi121.stderr: 32250K .......... .......... .......... .......... .......... 43% 339M 0s 2019-12-09T10:04:33.677 INFO:teuthology.orchestra.run.smithi121.stderr: 32300K .......... .......... .......... .......... .......... 43% 346M 0s 2019-12-09T10:04:33.677 INFO:teuthology.orchestra.run.smithi121.stderr: 32350K .......... .......... .......... .......... .......... 44% 291M 0s 2019-12-09T10:04:33.677 INFO:teuthology.orchestra.run.smithi121.stderr: 32400K .......... .......... .......... .......... .......... 44% 333M 0s 2019-12-09T10:04:33.677 INFO:teuthology.orchestra.run.smithi121.stderr: 32450K .......... .......... .......... .......... .......... 44% 297M 0s 2019-12-09T10:04:33.678 INFO:teuthology.orchestra.run.smithi121.stderr: 32500K .......... .......... .......... .......... .......... 44% 325M 0s 2019-12-09T10:04:33.678 INFO:teuthology.orchestra.run.smithi121.stderr: 32550K .......... .......... .......... .......... .......... 44% 254M 0s 2019-12-09T10:04:33.678 INFO:teuthology.orchestra.run.smithi121.stderr: 32600K .......... .......... .......... .......... .......... 44% 306M 0s 2019-12-09T10:04:33.678 INFO:teuthology.orchestra.run.smithi121.stderr: 32650K .......... .......... .......... .......... .......... 44% 320M 0s 2019-12-09T10:04:33.678 INFO:teuthology.orchestra.run.smithi121.stderr: 32700K .......... .......... .......... .......... .......... 44% 305M 0s 2019-12-09T10:04:33.678 INFO:teuthology.orchestra.run.smithi121.stderr: 32750K .......... .......... .......... .......... .......... 44% 264M 0s 2019-12-09T10:04:33.678 INFO:teuthology.orchestra.run.smithi121.stderr: 32800K .......... .......... .......... .......... .......... 44% 325M 0s 2019-12-09T10:04:33.679 INFO:teuthology.orchestra.run.smithi121.stderr: 32850K .......... .......... .......... .......... .......... 44% 320M 0s 2019-12-09T10:04:33.679 INFO:teuthology.orchestra.run.smithi121.stderr: 32900K .......... .......... .......... .......... .......... 44% 311M 0s 2019-12-09T10:04:33.679 INFO:teuthology.orchestra.run.smithi121.stderr: 32950K .......... .......... .......... .......... .......... 44% 292M 0s 2019-12-09T10:04:33.679 INFO:teuthology.orchestra.run.smithi121.stderr: 33000K .......... .......... .......... .......... .......... 44% 321M 0s 2019-12-09T10:04:33.679 INFO:teuthology.orchestra.run.smithi121.stderr: 33050K .......... .......... .......... .......... .......... 44% 323M 0s 2019-12-09T10:04:33.680 INFO:teuthology.orchestra.run.smithi121.stderr: 33100K .......... .......... .......... .......... .......... 45% 334M 0s 2019-12-09T10:04:33.680 INFO:teuthology.orchestra.run.smithi121.stderr: 33150K .......... .......... .......... .......... .......... 45% 277M 0s 2019-12-09T10:04:33.680 INFO:teuthology.orchestra.run.smithi121.stderr: 33200K .......... .......... .......... .......... .......... 45% 329M 0s 2019-12-09T10:04:33.680 INFO:teuthology.orchestra.run.smithi121.stderr: 33250K .......... .......... .......... .......... .......... 45% 339M 0s 2019-12-09T10:04:33.681 INFO:teuthology.orchestra.run.smithi121.stderr: 33300K .......... .......... .......... .......... .......... 45% 340M 0s 2019-12-09T10:04:33.681 INFO:teuthology.orchestra.run.smithi121.stderr: 33350K .......... .......... .......... .......... .......... 45% 296M 0s 2019-12-09T10:04:33.681 INFO:teuthology.orchestra.run.smithi121.stderr: 33400K .......... .......... .......... .......... .......... 45% 335M 0s 2019-12-09T10:04:33.681 INFO:teuthology.orchestra.run.smithi121.stderr: 33450K .......... .......... .......... .......... .......... 45% 332M 0s 2019-12-09T10:04:33.681 INFO:teuthology.orchestra.run.smithi121.stderr: 33500K .......... .......... .......... .......... .......... 45% 330M 0s 2019-12-09T10:04:33.681 INFO:teuthology.orchestra.run.smithi121.stderr: 33550K .......... .......... .......... .......... .......... 45% 285M 0s 2019-12-09T10:04:33.681 INFO:teuthology.orchestra.run.smithi121.stderr: 33600K .......... .......... .......... .......... .......... 45% 330M 0s 2019-12-09T10:04:33.682 INFO:teuthology.orchestra.run.smithi121.stderr: 33650K .......... .......... .......... .......... .......... 45% 332M 0s 2019-12-09T10:04:33.682 INFO:teuthology.orchestra.run.smithi121.stderr: 33700K .......... .......... .......... .......... .......... 45% 334M 0s 2019-12-09T10:04:33.682 INFO:teuthology.orchestra.run.smithi121.stderr: 33750K .......... .......... .......... .......... .......... 45% 297M 0s 2019-12-09T10:04:33.682 INFO:teuthology.orchestra.run.smithi121.stderr: 33800K .......... .......... .......... .......... .......... 46% 337M 0s 2019-12-09T10:04:33.682 INFO:teuthology.orchestra.run.smithi121.stderr: 33850K .......... .......... .......... .......... .......... 46% 325M 0s 2019-12-09T10:04:33.682 INFO:teuthology.orchestra.run.smithi121.stderr: 33900K .......... .......... .......... .......... .......... 46% 323M 0s 2019-12-09T10:04:33.682 INFO:teuthology.orchestra.run.smithi121.stderr: 33950K .......... .......... .......... .......... .......... 46% 270M 0s 2019-12-09T10:04:33.683 INFO:teuthology.orchestra.run.smithi121.stderr: 34000K .......... .......... .......... .......... .......... 46% 318M 0s 2019-12-09T10:04:33.683 INFO:teuthology.orchestra.run.smithi121.stderr: 34050K .......... .......... .......... .......... .......... 46% 328M 0s 2019-12-09T10:04:33.683 INFO:teuthology.orchestra.run.smithi121.stderr: 34100K .......... .......... .......... .......... .......... 46% 332M 0s 2019-12-09T10:04:33.683 INFO:teuthology.orchestra.run.smithi121.stderr: 34150K .......... .......... .......... .......... .......... 46% 298M 0s 2019-12-09T10:04:33.683 INFO:teuthology.orchestra.run.smithi121.stderr: 34200K .......... .......... .......... .......... .......... 46% 329M 0s 2019-12-09T10:04:33.683 INFO:teuthology.orchestra.run.smithi121.stderr: 34250K .......... .......... .......... .......... .......... 46% 341M 0s 2019-12-09T10:04:33.683 INFO:teuthology.orchestra.run.smithi121.stderr: 34300K .......... .......... .......... .......... .......... 46% 313M 0s 2019-12-09T10:04:33.684 INFO:teuthology.orchestra.run.smithi121.stderr: 34350K .......... .......... .......... .......... .......... 46% 268M 0s 2019-12-09T10:04:33.684 INFO:teuthology.orchestra.run.smithi121.stderr: 34400K .......... .......... .......... .......... .......... 46% 332M 0s 2019-12-09T10:04:33.684 INFO:teuthology.orchestra.run.smithi121.stderr: 34450K .......... .......... .......... .......... .......... 46% 319M 0s 2019-12-09T10:04:33.684 INFO:teuthology.orchestra.run.smithi121.stderr: 34500K .......... .......... .......... .......... .......... 46% 315M 0s 2019-12-09T10:04:33.684 INFO:teuthology.orchestra.run.smithi121.stderr: 34550K .......... .......... .......... .......... .......... 47% 280M 0s 2019-12-09T10:04:33.684 INFO:teuthology.orchestra.run.smithi121.stderr: 34600K .......... .......... .......... .......... .......... 47% 342M 0s 2019-12-09T10:04:33.684 INFO:teuthology.orchestra.run.smithi121.stderr: 34650K .......... .......... .......... .......... .......... 47% 316M 0s 2019-12-09T10:04:33.685 INFO:teuthology.orchestra.run.smithi121.stderr: 34700K .......... .......... .......... .......... .......... 47% 301M 0s 2019-12-09T10:04:33.685 INFO:teuthology.orchestra.run.smithi121.stderr: 34750K .......... .......... .......... .......... .......... 47% 263M 0s 2019-12-09T10:04:33.685 INFO:teuthology.orchestra.run.smithi121.stderr: 34800K .......... .......... .......... .......... .......... 47% 295M 0s 2019-12-09T10:04:33.685 INFO:teuthology.orchestra.run.smithi121.stderr: 34850K .......... .......... .......... .......... .......... 47% 295M 0s 2019-12-09T10:04:33.685 INFO:teuthology.orchestra.run.smithi121.stderr: 34900K .......... .......... .......... .......... .......... 47% 322M 0s 2019-12-09T10:04:33.685 INFO:teuthology.orchestra.run.smithi121.stderr: 34950K .......... .......... .......... .......... .......... 47% 284M 0s 2019-12-09T10:04:33.685 INFO:teuthology.orchestra.run.smithi121.stderr: 35000K .......... .......... .......... .......... .......... 47% 322M 0s 2019-12-09T10:04:33.685 INFO:teuthology.orchestra.run.smithi121.stderr: 35050K .......... .......... .......... .......... .......... 47% 318M 0s 2019-12-09T10:04:33.686 INFO:teuthology.orchestra.run.smithi121.stderr: 35100K .......... .......... .......... .......... .......... 47% 344M 0s 2019-12-09T10:04:33.686 INFO:teuthology.orchestra.run.smithi121.stderr: 35150K .......... .......... .......... .......... .......... 47% 292M 0s 2019-12-09T10:04:33.686 INFO:teuthology.orchestra.run.smithi121.stderr: 35200K .......... .......... .......... .......... .......... 47% 352M 0s 2019-12-09T10:04:33.686 INFO:teuthology.orchestra.run.smithi121.stderr: 35250K .......... .......... .......... .......... .......... 47% 337M 0s 2019-12-09T10:04:33.686 INFO:teuthology.orchestra.run.smithi121.stderr: 35300K .......... .......... .......... .......... .......... 48% 340M 0s 2019-12-09T10:04:33.686 INFO:teuthology.orchestra.run.smithi121.stderr: 35350K .......... .......... .......... .......... .......... 48% 294M 0s 2019-12-09T10:04:33.686 INFO:teuthology.orchestra.run.smithi121.stderr: 35400K .......... .......... .......... .......... .......... 48% 319M 0s 2019-12-09T10:04:33.687 INFO:teuthology.orchestra.run.smithi121.stderr: 35450K .......... .......... .......... .......... .......... 48% 342M 0s 2019-12-09T10:04:33.687 INFO:teuthology.orchestra.run.smithi121.stderr: 35500K .......... .......... .......... .......... .......... 48% 329M 0s 2019-12-09T10:04:33.687 INFO:teuthology.orchestra.run.smithi121.stderr: 35550K .......... .......... .......... .......... .......... 48% 293M 0s 2019-12-09T10:04:33.687 INFO:teuthology.orchestra.run.smithi121.stderr: 35600K .......... .......... .......... .......... .......... 48% 317M 0s 2019-12-09T10:04:33.687 INFO:teuthology.orchestra.run.smithi121.stderr: 35650K .......... .......... .......... .......... .......... 48% 324M 0s 2019-12-09T10:04:33.687 INFO:teuthology.orchestra.run.smithi121.stderr: 35700K .......... .......... .......... .......... .......... 48% 319M 0s 2019-12-09T10:04:33.687 INFO:teuthology.orchestra.run.smithi121.stderr: 35750K .......... .......... .......... .......... .......... 48% 283M 0s 2019-12-09T10:04:33.688 INFO:teuthology.orchestra.run.smithi121.stderr: 35800K .......... .......... .......... .......... .......... 48% 318M 0s 2019-12-09T10:04:33.688 INFO:teuthology.orchestra.run.smithi121.stderr: 35850K .......... .......... .......... .......... .......... 48% 326M 0s 2019-12-09T10:04:33.688 INFO:teuthology.orchestra.run.smithi121.stderr: 35900K .......... .......... .......... .......... .......... 48% 343M 0s 2019-12-09T10:04:33.688 INFO:teuthology.orchestra.run.smithi121.stderr: 35950K .......... .......... .......... .......... .......... 48% 285M 0s 2019-12-09T10:04:33.688 INFO:teuthology.orchestra.run.smithi121.stderr: 36000K .......... .......... .......... .......... .......... 49% 342M 0s 2019-12-09T10:04:33.688 INFO:teuthology.orchestra.run.smithi121.stderr: 36050K .......... .......... .......... .......... .......... 49% 335M 0s 2019-12-09T10:04:33.689 INFO:teuthology.orchestra.run.smithi121.stderr: 36100K .......... .......... .......... .......... .......... 49% 342M 0s 2019-12-09T10:04:33.689 INFO:teuthology.orchestra.run.smithi121.stderr: 36150K .......... .......... .......... .......... .......... 49% 308M 0s 2019-12-09T10:04:33.689 INFO:teuthology.orchestra.run.smithi121.stderr: 36200K .......... .......... .......... .......... .......... 49% 336M 0s 2019-12-09T10:04:33.689 INFO:teuthology.orchestra.run.smithi121.stderr: 36250K .......... .......... .......... .......... .......... 49% 343M 0s 2019-12-09T10:04:33.689 INFO:teuthology.orchestra.run.smithi121.stderr: 36300K .......... .......... .......... .......... .......... 49% 342M 0s 2019-12-09T10:04:33.689 INFO:teuthology.orchestra.run.smithi121.stderr: 36350K .......... .......... .......... .......... .......... 49% 271M 0s 2019-12-09T10:04:33.689 INFO:teuthology.orchestra.run.smithi121.stderr: 36400K .......... .......... .......... .......... .......... 49% 341M 0s 2019-12-09T10:04:33.689 INFO:teuthology.orchestra.run.smithi121.stderr: 36450K .......... .......... .......... .......... .......... 49% 332M 0s 2019-12-09T10:04:33.690 INFO:teuthology.orchestra.run.smithi121.stderr: 36500K .......... .......... .......... .......... .......... 49% 337M 0s 2019-12-09T10:04:33.690 INFO:teuthology.orchestra.run.smithi121.stderr: 36550K .......... .......... .......... .......... .......... 49% 299M 0s 2019-12-09T10:04:33.690 INFO:teuthology.orchestra.run.smithi121.stderr: 36600K .......... .......... .......... .......... .......... 49% 338M 0s 2019-12-09T10:04:33.690 INFO:teuthology.orchestra.run.smithi121.stderr: 36650K .......... .......... .......... .......... .......... 49% 331M 0s 2019-12-09T10:04:33.690 INFO:teuthology.orchestra.run.smithi121.stderr: 36700K .......... .......... .......... .......... .......... 49% 330M 0s 2019-12-09T10:04:33.691 INFO:teuthology.orchestra.run.smithi121.stderr: 36750K .......... .......... .......... .......... .......... 50% 278M 0s 2019-12-09T10:04:33.691 INFO:teuthology.orchestra.run.smithi121.stderr: 36800K .......... .......... .......... .......... .......... 50% 327M 0s 2019-12-09T10:04:33.691 INFO:teuthology.orchestra.run.smithi121.stderr: 36850K .......... .......... .......... .......... .......... 50% 330M 0s 2019-12-09T10:04:33.691 INFO:teuthology.orchestra.run.smithi121.stderr: 36900K .......... .......... .......... .......... .......... 50% 314M 0s 2019-12-09T10:04:33.691 INFO:teuthology.orchestra.run.smithi121.stderr: 36950K .......... .......... .......... .......... .......... 50% 280M 0s 2019-12-09T10:04:33.691 INFO:teuthology.orchestra.run.smithi121.stderr: 37000K .......... .......... .......... .......... .......... 50% 323M 0s 2019-12-09T10:04:33.692 INFO:teuthology.orchestra.run.smithi121.stderr: 37050K .......... .......... .......... .......... .......... 50% 343M 0s 2019-12-09T10:04:33.692 INFO:teuthology.orchestra.run.smithi121.stderr: 37100K .......... .......... .......... .......... .......... 50% 293M 0s 2019-12-09T10:04:33.692 INFO:teuthology.orchestra.run.smithi121.stderr: 37150K .......... .......... .......... .......... .......... 50% 270M 0s 2019-12-09T10:04:33.692 INFO:teuthology.orchestra.run.smithi121.stderr: 37200K .......... .......... .......... .......... .......... 50% 325M 0s 2019-12-09T10:04:33.692 INFO:teuthology.orchestra.run.smithi121.stderr: 37250K .......... .......... .......... .......... .......... 50% 317M 0s 2019-12-09T10:04:33.692 INFO:teuthology.orchestra.run.smithi121.stderr: 37300K .......... .......... .......... .......... .......... 50% 315M 0s 2019-12-09T10:04:33.693 INFO:teuthology.orchestra.run.smithi121.stderr: 37350K .......... .......... .......... .......... .......... 50% 297M 0s 2019-12-09T10:04:33.693 INFO:teuthology.orchestra.run.smithi121.stderr: 37400K .......... .......... .......... .......... .......... 50% 331M 0s 2019-12-09T10:04:33.693 INFO:teuthology.orchestra.run.smithi121.stderr: 37450K .......... .......... .......... .......... .......... 50% 328M 0s 2019-12-09T10:04:33.693 INFO:teuthology.orchestra.run.smithi121.stderr: 37500K .......... .......... .......... .......... .......... 51% 335M 0s 2019-12-09T10:04:33.693 INFO:teuthology.orchestra.run.smithi121.stderr: 37550K .......... .......... .......... .......... .......... 51% 274M 0s 2019-12-09T10:04:33.693 INFO:teuthology.orchestra.run.smithi121.stderr: 37600K .......... .......... .......... .......... .......... 51% 311M 0s 2019-12-09T10:04:33.693 INFO:teuthology.orchestra.run.smithi121.stderr: 37650K .......... .......... .......... .......... .......... 51% 347M 0s 2019-12-09T10:04:33.694 INFO:teuthology.orchestra.run.smithi121.stderr: 37700K .......... .......... .......... .......... .......... 51% 343M 0s 2019-12-09T10:04:33.694 INFO:teuthology.orchestra.run.smithi121.stderr: 37750K .......... .......... .......... .......... .......... 51% 296M 0s 2019-12-09T10:04:33.694 INFO:teuthology.orchestra.run.smithi121.stderr: 37800K .......... .......... .......... .......... .......... 51% 344M 0s 2019-12-09T10:04:33.694 INFO:teuthology.orchestra.run.smithi121.stderr: 37850K .......... .......... .......... .......... .......... 51% 332M 0s 2019-12-09T10:04:33.694 INFO:teuthology.orchestra.run.smithi121.stderr: 37900K .......... .......... .......... .......... .......... 51% 339M 0s 2019-12-09T10:04:33.694 INFO:teuthology.orchestra.run.smithi121.stderr: 37950K .......... .......... .......... .......... .......... 51% 280M 0s 2019-12-09T10:04:33.694 INFO:teuthology.orchestra.run.smithi121.stderr: 38000K .......... .......... .......... .......... .......... 51% 348M 0s 2019-12-09T10:04:33.695 INFO:teuthology.orchestra.run.smithi121.stderr: 38050K .......... .......... .......... .......... .......... 51% 341M 0s 2019-12-09T10:04:33.695 INFO:teuthology.orchestra.run.smithi121.stderr: 38100K .......... .......... .......... .......... .......... 51% 336M 0s 2019-12-09T10:04:33.695 INFO:teuthology.orchestra.run.smithi121.stderr: 38150K .......... .......... .......... .......... .......... 51% 296M 0s 2019-12-09T10:04:33.695 INFO:teuthology.orchestra.run.smithi121.stderr: 38200K .......... .......... .......... .......... .......... 51% 310M 0s 2019-12-09T10:04:33.695 INFO:teuthology.orchestra.run.smithi121.stderr: 38250K .......... .......... .......... .......... .......... 52% 333M 0s 2019-12-09T10:04:33.695 INFO:teuthology.orchestra.run.smithi121.stderr: 38300K .......... .......... .......... .......... .......... 52% 353M 0s 2019-12-09T10:04:33.695 INFO:teuthology.orchestra.run.smithi121.stderr: 38350K .......... .......... .......... .......... .......... 52% 259M 0s 2019-12-09T10:04:33.696 INFO:teuthology.orchestra.run.smithi121.stderr: 38400K .......... .......... .......... .......... .......... 52% 362M 0s 2019-12-09T10:04:33.696 INFO:teuthology.orchestra.run.smithi121.stderr: 38450K .......... .......... .......... .......... .......... 52% 333M 0s 2019-12-09T10:04:33.696 INFO:teuthology.orchestra.run.smithi121.stderr: 38500K .......... .......... .......... .......... .......... 52% 323M 0s 2019-12-09T10:04:33.696 INFO:teuthology.orchestra.run.smithi121.stderr: 38550K .......... .......... .......... .......... .......... 52% 300M 0s 2019-12-09T10:04:33.696 INFO:teuthology.orchestra.run.smithi121.stderr: 38600K .......... .......... .......... .......... .......... 52% 354M 0s 2019-12-09T10:04:33.696 INFO:teuthology.orchestra.run.smithi121.stderr: 38650K .......... .......... .......... .......... .......... 52% 331M 0s 2019-12-09T10:04:33.696 INFO:teuthology.orchestra.run.smithi121.stderr: 38700K .......... .......... .......... .......... .......... 52% 331M 0s 2019-12-09T10:04:33.697 INFO:teuthology.orchestra.run.smithi121.stderr: 38750K .......... .......... .......... .......... .......... 52% 293M 0s 2019-12-09T10:04:33.697 INFO:teuthology.orchestra.run.smithi121.stderr: 38800K .......... .......... .......... .......... .......... 52% 339M 0s 2019-12-09T10:04:33.697 INFO:teuthology.orchestra.run.smithi121.stderr: 38850K .......... .......... .......... .......... .......... 52% 297M 0s 2019-12-09T10:04:33.697 INFO:teuthology.orchestra.run.smithi121.stderr: 38900K .......... .......... .......... .......... .......... 52% 330M 0s 2019-12-09T10:04:33.697 INFO:teuthology.orchestra.run.smithi121.stderr: 38950K .......... .......... .......... .......... .......... 53% 275M 0s 2019-12-09T10:04:33.697 INFO:teuthology.orchestra.run.smithi121.stderr: 39000K .......... .......... .......... .......... .......... 53% 327M 0s 2019-12-09T10:04:33.697 INFO:teuthology.orchestra.run.smithi121.stderr: 39050K .......... .......... .......... .......... .......... 53% 358M 0s 2019-12-09T10:04:33.698 INFO:teuthology.orchestra.run.smithi121.stderr: 39100K .......... .......... .......... .......... .......... 53% 346M 0s 2019-12-09T10:04:33.698 INFO:teuthology.orchestra.run.smithi121.stderr: 39150K .......... .......... .......... .......... .......... 53% 269M 0s 2019-12-09T10:04:33.698 INFO:teuthology.orchestra.run.smithi121.stderr: 39200K .......... .......... .......... .......... .......... 53% 339M 0s 2019-12-09T10:04:33.698 INFO:teuthology.orchestra.run.smithi121.stderr: 39250K .......... .......... .......... .......... .......... 53% 359M 0s 2019-12-09T10:04:33.698 INFO:teuthology.orchestra.run.smithi121.stderr: 39300K .......... .......... .......... .......... .......... 53% 340M 0s 2019-12-09T10:04:33.698 INFO:teuthology.orchestra.run.smithi121.stderr: 39350K .......... .......... .......... .......... .......... 53% 323M 0s 2019-12-09T10:04:33.698 INFO:teuthology.orchestra.run.smithi121.stderr: 39400K .......... .......... .......... .......... .......... 53% 345M 0s 2019-12-09T10:04:33.698 INFO:teuthology.orchestra.run.smithi121.stderr: 39450K .......... .......... .......... .......... .......... 53% 345M 0s 2019-12-09T10:04:33.699 INFO:teuthology.orchestra.run.smithi121.stderr: 39500K .......... .......... .......... .......... .......... 53% 369M 0s 2019-12-09T10:04:33.699 INFO:teuthology.orchestra.run.smithi121.stderr: 39550K .......... .......... .......... .......... .......... 53% 286M 0s 2019-12-09T10:04:33.699 INFO:teuthology.orchestra.run.smithi121.stderr: 39600K .......... .......... .......... .......... .......... 53% 357M 0s 2019-12-09T10:04:33.699 INFO:teuthology.orchestra.run.smithi121.stderr: 39650K .......... .......... .......... .......... .......... 53% 354M 0s 2019-12-09T10:04:33.699 INFO:teuthology.orchestra.run.smithi121.stderr: 39700K .......... .......... .......... .......... .......... 54% 344M 0s 2019-12-09T10:04:33.699 INFO:teuthology.orchestra.run.smithi121.stderr: 39750K .......... .......... .......... .......... .......... 54% 304M 0s 2019-12-09T10:04:33.699 INFO:teuthology.orchestra.run.smithi121.stderr: 39800K .......... .......... .......... .......... .......... 54% 346M 0s 2019-12-09T10:04:33.700 INFO:teuthology.orchestra.run.smithi121.stderr: 39850K .......... .......... .......... .......... .......... 54% 367M 0s 2019-12-09T10:04:33.700 INFO:teuthology.orchestra.run.smithi121.stderr: 39900K .......... .......... .......... .......... .......... 54% 344M 0s 2019-12-09T10:04:33.700 INFO:teuthology.orchestra.run.smithi121.stderr: 39950K .......... .......... .......... .......... .......... 54% 293M 0s 2019-12-09T10:04:33.700 INFO:teuthology.orchestra.run.smithi121.stderr: 40000K .......... .......... .......... .......... .......... 54% 344M 0s 2019-12-09T10:04:33.700 INFO:teuthology.orchestra.run.smithi121.stderr: 40050K .......... .......... .......... .......... .......... 54% 358M 0s 2019-12-09T10:04:33.700 INFO:teuthology.orchestra.run.smithi121.stderr: 40100K .......... .......... .......... .......... .......... 54% 344M 0s 2019-12-09T10:04:33.700 INFO:teuthology.orchestra.run.smithi121.stderr: 40150K .......... .......... .......... .......... .......... 54% 313M 0s 2019-12-09T10:04:33.701 INFO:teuthology.orchestra.run.smithi121.stderr: 40200K .......... .......... .......... .......... .......... 54% 349M 0s 2019-12-09T10:04:33.701 INFO:teuthology.orchestra.run.smithi121.stderr: 40250K .......... .......... .......... .......... .......... 54% 362M 0s 2019-12-09T10:04:33.701 INFO:teuthology.orchestra.run.smithi121.stderr: 40300K .......... .......... .......... .......... .......... 54% 368M 0s 2019-12-09T10:04:33.701 INFO:teuthology.orchestra.run.smithi121.stderr: 40350K .......... .......... .......... .......... .......... 54% 301M 0s 2019-12-09T10:04:33.701 INFO:teuthology.orchestra.run.smithi121.stderr: 40400K .......... .......... .......... .......... .......... 54% 360M 0s 2019-12-09T10:04:33.701 INFO:teuthology.orchestra.run.smithi121.stderr: 40450K .......... .......... .......... .......... .......... 55% 351M 0s 2019-12-09T10:04:33.701 INFO:teuthology.orchestra.run.smithi121.stderr: 40500K .......... .......... .......... .......... .......... 55% 357M 0s 2019-12-09T10:04:33.702 INFO:teuthology.orchestra.run.smithi121.stderr: 40550K .......... .......... .......... .......... .......... 55% 302M 0s 2019-12-09T10:04:33.702 INFO:teuthology.orchestra.run.smithi121.stderr: 40600K .......... .......... .......... .......... .......... 55% 358M 0s 2019-12-09T10:04:33.702 INFO:teuthology.orchestra.run.smithi121.stderr: 40650K .......... .......... .......... .......... .......... 55% 348M 0s 2019-12-09T10:04:33.702 INFO:teuthology.orchestra.run.smithi121.stderr: 40700K .......... .......... .......... .......... .......... 55% 337M 0s 2019-12-09T10:04:33.702 INFO:teuthology.orchestra.run.smithi121.stderr: 40750K .......... .......... .......... .......... .......... 55% 281M 0s 2019-12-09T10:04:33.702 INFO:teuthology.orchestra.run.smithi121.stderr: 40800K .......... .......... .......... .......... .......... 55% 370M 0s 2019-12-09T10:04:33.702 INFO:teuthology.orchestra.run.smithi121.stderr: 40850K .......... .......... .......... .......... .......... 55% 364M 0s 2019-12-09T10:04:33.702 INFO:teuthology.orchestra.run.smithi121.stderr: 40900K .......... .......... .......... .......... .......... 55% 351M 0s 2019-12-09T10:04:33.703 INFO:teuthology.orchestra.run.smithi121.stderr: 40950K .......... .......... .......... .......... .......... 55% 307M 0s 2019-12-09T10:04:33.703 INFO:teuthology.orchestra.run.smithi121.stderr: 41000K .......... .......... .......... .......... .......... 55% 338M 0s 2019-12-09T10:04:33.703 INFO:teuthology.orchestra.run.smithi121.stderr: 41050K .......... .......... .......... .......... .......... 55% 371M 0s 2019-12-09T10:04:33.703 INFO:teuthology.orchestra.run.smithi121.stderr: 41100K .......... .......... .......... .......... .......... 55% 350M 0s 2019-12-09T10:04:33.703 INFO:teuthology.orchestra.run.smithi121.stderr: 41150K .......... .......... .......... .......... .......... 56% 289M 0s 2019-12-09T10:04:33.703 INFO:teuthology.orchestra.run.smithi121.stderr: 41200K .......... .......... .......... .......... .......... 56% 360M 0s 2019-12-09T10:04:33.703 INFO:teuthology.orchestra.run.smithi121.stderr: 41250K .......... .......... .......... .......... .......... 56% 347M 0s 2019-12-09T10:04:33.704 INFO:teuthology.orchestra.run.smithi121.stderr: 41300K .......... .......... .......... .......... .......... 56% 361M 0s 2019-12-09T10:04:33.704 INFO:teuthology.orchestra.run.smithi121.stderr: 41350K .......... .......... .......... .......... .......... 56% 313M 0s 2019-12-09T10:04:33.704 INFO:teuthology.orchestra.run.smithi121.stderr: 41400K .......... .......... .......... .......... .......... 56% 353M 0s 2019-12-09T10:04:33.704 INFO:teuthology.orchestra.run.smithi121.stderr: 41450K .......... .......... .......... .......... .......... 56% 351M 0s 2019-12-09T10:04:33.704 INFO:teuthology.orchestra.run.smithi121.stderr: 41500K .......... .......... .......... .......... .......... 56% 362M 0s 2019-12-09T10:04:33.704 INFO:teuthology.orchestra.run.smithi121.stderr: 41550K .......... .......... .......... .......... .......... 56% 302M 0s 2019-12-09T10:04:33.704 INFO:teuthology.orchestra.run.smithi121.stderr: 41600K .......... .......... .......... .......... .......... 56% 347M 0s 2019-12-09T10:04:33.705 INFO:teuthology.orchestra.run.smithi121.stderr: 41650K .......... .......... .......... .......... .......... 56% 343M 0s 2019-12-09T10:04:33.705 INFO:teuthology.orchestra.run.smithi121.stderr: 41700K .......... .......... .......... .......... .......... 56% 351M 0s 2019-12-09T10:04:33.705 INFO:teuthology.orchestra.run.smithi121.stderr: 41750K .......... .......... .......... .......... .......... 56% 305M 0s 2019-12-09T10:04:33.705 INFO:teuthology.orchestra.run.smithi121.stderr: 41800K .......... .......... .......... .......... .......... 56% 336M 0s 2019-12-09T10:04:33.705 INFO:teuthology.orchestra.run.smithi121.stderr: 41850K .......... .......... .......... .......... .......... 56% 357M 0s 2019-12-09T10:04:33.705 INFO:teuthology.orchestra.run.smithi121.stderr: 41900K .......... .......... .......... .......... .......... 57% 350M 0s 2019-12-09T10:04:33.706 INFO:teuthology.orchestra.run.smithi121.stderr: 41950K .......... .......... .......... .......... .......... 57% 292M 0s 2019-12-09T10:04:33.706 INFO:teuthology.orchestra.run.smithi121.stderr: 42000K .......... .......... .......... .......... .......... 57% 362M 0s 2019-12-09T10:04:33.706 INFO:teuthology.orchestra.run.smithi121.stderr: 42050K .......... .......... .......... .......... .......... 57% 349M 0s 2019-12-09T10:04:33.706 INFO:teuthology.orchestra.run.smithi121.stderr: 42100K .......... .......... .......... .......... .......... 57% 352M 0s 2019-12-09T10:04:33.706 INFO:teuthology.orchestra.run.smithi121.stderr: 42150K .......... .......... .......... .......... .......... 57% 306M 0s 2019-12-09T10:04:33.706 INFO:teuthology.orchestra.run.smithi121.stderr: 42200K .......... .......... .......... .......... .......... 57% 377M 0s 2019-12-09T10:04:33.706 INFO:teuthology.orchestra.run.smithi121.stderr: 42250K .......... .......... .......... .......... .......... 57% 369M 0s 2019-12-09T10:04:33.707 INFO:teuthology.orchestra.run.smithi121.stderr: 42300K .......... .......... .......... .......... .......... 57% 356M 0s 2019-12-09T10:04:33.707 INFO:teuthology.orchestra.run.smithi121.stderr: 42350K .......... .......... .......... .......... .......... 57% 308M 0s 2019-12-09T10:04:33.707 INFO:teuthology.orchestra.run.smithi121.stderr: 42400K .......... .......... .......... .......... .......... 57% 346M 0s 2019-12-09T10:04:33.707 INFO:teuthology.orchestra.run.smithi121.stderr: 42450K .......... .......... .......... .......... .......... 57% 358M 0s 2019-12-09T10:04:33.707 INFO:teuthology.orchestra.run.smithi121.stderr: 42500K .......... .......... .......... .......... .......... 57% 362M 0s 2019-12-09T10:04:33.707 INFO:teuthology.orchestra.run.smithi121.stderr: 42550K .......... .......... .......... .......... .......... 57% 319M 0s 2019-12-09T10:04:33.707 INFO:teuthology.orchestra.run.smithi121.stderr: 42600K .......... .......... .......... .......... .......... 57% 361M 0s 2019-12-09T10:04:33.708 INFO:teuthology.orchestra.run.smithi121.stderr: 42650K .......... .......... .......... .......... .......... 58% 360M 0s 2019-12-09T10:04:33.708 INFO:teuthology.orchestra.run.smithi121.stderr: 42700K .......... .......... .......... .......... .......... 58% 352M 0s 2019-12-09T10:04:33.708 INFO:teuthology.orchestra.run.smithi121.stderr: 42750K .......... .......... .......... .......... .......... 58% 310M 0s 2019-12-09T10:04:33.708 INFO:teuthology.orchestra.run.smithi121.stderr: 42800K .......... .......... .......... .......... .......... 58% 366M 0s 2019-12-09T10:04:33.708 INFO:teuthology.orchestra.run.smithi121.stderr: 42850K .......... .......... .......... .......... .......... 58% 367M 0s 2019-12-09T10:04:33.708 INFO:teuthology.orchestra.run.smithi121.stderr: 42900K .......... .......... .......... .......... .......... 58% 353M 0s 2019-12-09T10:04:33.708 INFO:teuthology.orchestra.run.smithi121.stderr: 42950K .......... .......... .......... .......... .......... 58% 336M 0s 2019-12-09T10:04:33.709 INFO:teuthology.orchestra.run.smithi121.stderr: 43000K .......... .......... .......... .......... .......... 58% 354M 0s 2019-12-09T10:04:33.709 INFO:teuthology.orchestra.run.smithi121.stderr: 43050K .......... .......... .......... .......... .......... 58% 350M 0s 2019-12-09T10:04:33.709 INFO:teuthology.orchestra.run.smithi121.stderr: 43100K .......... .......... .......... .......... .......... 58% 379M 0s 2019-12-09T10:04:33.709 INFO:teuthology.orchestra.run.smithi121.stderr: 43150K .......... .......... .......... .......... .......... 58% 306M 0s 2019-12-09T10:04:33.709 INFO:teuthology.orchestra.run.smithi121.stderr: 43200K .......... .......... .......... .......... .......... 58% 324M 0s 2019-12-09T10:04:33.709 INFO:teuthology.orchestra.run.smithi121.stderr: 43250K .......... .......... .......... .......... .......... 58% 263M 0s 2019-12-09T10:04:33.709 INFO:teuthology.orchestra.run.smithi121.stderr: 43300K .......... .......... .......... .......... .......... 58% 346M 0s 2019-12-09T10:04:33.710 INFO:teuthology.orchestra.run.smithi121.stderr: 43350K .......... .......... .......... .......... .......... 59% 302M 0s 2019-12-09T10:04:33.710 INFO:teuthology.orchestra.run.smithi121.stderr: 43400K .......... .......... .......... .......... .......... 59% 345M 0s 2019-12-09T10:04:33.710 INFO:teuthology.orchestra.run.smithi121.stderr: 43450K .......... .......... .......... .......... .......... 59% 362M 0s 2019-12-09T10:04:33.710 INFO:teuthology.orchestra.run.smithi121.stderr: 43500K .......... .......... .......... .......... .......... 59% 350M 0s 2019-12-09T10:04:33.710 INFO:teuthology.orchestra.run.smithi121.stderr: 43550K .......... .......... .......... .......... .......... 59% 329M 0s 2019-12-09T10:04:33.710 INFO:teuthology.orchestra.run.smithi121.stderr: 43600K .......... .......... .......... .......... .......... 59% 372M 0s 2019-12-09T10:04:33.710 INFO:teuthology.orchestra.run.smithi121.stderr: 43650K .......... .......... .......... .......... .......... 59% 365M 0s 2019-12-09T10:04:33.711 INFO:teuthology.orchestra.run.smithi121.stderr: 43700K .......... .......... .......... .......... .......... 59% 302M 0s 2019-12-09T10:04:33.711 INFO:teuthology.orchestra.run.smithi121.stderr: 43750K .......... .......... .......... .......... .......... 59% 180M 0s 2019-12-09T10:04:33.711 INFO:teuthology.orchestra.run.smithi121.stderr: 43800K .......... .......... .......... .......... .......... 59% 216M 0s 2019-12-09T10:04:33.711 INFO:teuthology.orchestra.run.smithi121.stderr: 43850K .......... .......... .......... .......... .......... 59% 269M 0s 2019-12-09T10:04:33.711 INFO:teuthology.orchestra.run.smithi121.stderr: 43900K .......... .......... .......... .......... .......... 59% 334M 0s 2019-12-09T10:04:33.711 INFO:teuthology.orchestra.run.smithi121.stderr: 43950K .......... .......... .......... .......... .......... 59% 290M 0s 2019-12-09T10:04:33.711 INFO:teuthology.orchestra.run.smithi121.stderr: 44000K .......... .......... .......... .......... .......... 59% 401M 0s 2019-12-09T10:04:33.712 INFO:teuthology.orchestra.run.smithi121.stderr: 44050K .......... .......... .......... .......... .......... 59% 402M 0s 2019-12-09T10:04:33.712 INFO:teuthology.orchestra.run.smithi121.stderr: 44100K .......... .......... .......... .......... .......... 60% 383M 0s 2019-12-09T10:04:33.712 INFO:teuthology.orchestra.run.smithi121.stderr: 44150K .......... .......... .......... .......... .......... 60% 196M 0s 2019-12-09T10:04:33.713 INFO:teuthology.orchestra.run.smithi121.stderr: 44200K .......... .......... .......... .......... .......... 60% 257M 0s 2019-12-09T10:04:33.713 INFO:teuthology.orchestra.run.smithi121.stderr: 44250K .......... .......... .......... .......... .......... 60% 359M 0s 2019-12-09T10:04:33.713 INFO:teuthology.orchestra.run.smithi121.stderr: 44300K .......... .......... .......... .......... .......... 60% 389M 0s 2019-12-09T10:04:33.713 INFO:teuthology.orchestra.run.smithi121.stderr: 44350K .......... .......... .......... .......... .......... 60% 347M 0s 2019-12-09T10:04:33.713 INFO:teuthology.orchestra.run.smithi121.stderr: 44400K .......... .......... .......... .......... .......... 60% 407M 0s 2019-12-09T10:04:33.713 INFO:teuthology.orchestra.run.smithi121.stderr: 44450K .......... .......... .......... .......... .......... 60% 399M 0s 2019-12-09T10:04:33.713 INFO:teuthology.orchestra.run.smithi121.stderr: 44500K .......... .......... .......... .......... .......... 60% 374M 0s 2019-12-09T10:04:33.714 INFO:teuthology.orchestra.run.smithi121.stderr: 44550K .......... .......... .......... .......... .......... 60% 366M 0s 2019-12-09T10:04:33.714 INFO:teuthology.orchestra.run.smithi121.stderr: 44600K .......... .......... .......... .......... .......... 60% 410M 0s 2019-12-09T10:04:33.714 INFO:teuthology.orchestra.run.smithi121.stderr: 44650K .......... .......... .......... .......... .......... 60% 365M 0s 2019-12-09T10:04:33.714 INFO:teuthology.orchestra.run.smithi121.stderr: 44700K .......... .......... .......... .......... .......... 60% 403M 0s 2019-12-09T10:04:33.714 INFO:teuthology.orchestra.run.smithi121.stderr: 44750K .......... .......... .......... .......... .......... 60% 336M 0s 2019-12-09T10:04:33.714 INFO:teuthology.orchestra.run.smithi121.stderr: 44800K .......... .......... .......... .......... .......... 60% 400M 0s 2019-12-09T10:04:33.714 INFO:teuthology.orchestra.run.smithi121.stderr: 44850K .......... .......... .......... .......... .......... 61% 408M 0s 2019-12-09T10:04:33.715 INFO:teuthology.orchestra.run.smithi121.stderr: 44900K .......... .......... .......... .......... .......... 61% 387M 0s 2019-12-09T10:04:33.715 INFO:teuthology.orchestra.run.smithi121.stderr: 44950K .......... .......... .......... .......... .......... 61% 359M 0s 2019-12-09T10:04:33.715 INFO:teuthology.orchestra.run.smithi121.stderr: 45000K .......... .......... .......... .......... .......... 61% 409M 0s 2019-12-09T10:04:33.715 INFO:teuthology.orchestra.run.smithi121.stderr: 45050K .......... .......... .......... .......... .......... 61% 398M 0s 2019-12-09T10:04:33.715 INFO:teuthology.orchestra.run.smithi121.stderr: 45100K .......... .......... .......... .......... .......... 61% 398M 0s 2019-12-09T10:04:33.715 INFO:teuthology.orchestra.run.smithi121.stderr: 45150K .......... .......... .......... .......... .......... 61% 342M 0s 2019-12-09T10:04:33.715 INFO:teuthology.orchestra.run.smithi121.stderr: 45200K .......... .......... .......... .......... .......... 61% 383M 0s 2019-12-09T10:04:33.715 INFO:teuthology.orchestra.run.smithi121.stderr: 45250K .......... .......... .......... .......... .......... 61% 376M 0s 2019-12-09T10:04:33.716 INFO:teuthology.orchestra.run.smithi121.stderr: 45300K .......... .......... .......... .......... .......... 61% 412M 0s 2019-12-09T10:04:33.716 INFO:teuthology.orchestra.run.smithi121.stderr: 45350K .......... .......... .......... .......... .......... 61% 344M 0s 2019-12-09T10:04:33.716 INFO:teuthology.orchestra.run.smithi121.stderr: 45400K .......... .......... .......... .......... .......... 61% 398M 0s 2019-12-09T10:04:33.716 INFO:teuthology.orchestra.run.smithi121.stderr: 45450K .......... .......... .......... .......... .......... 61% 390M 0s 2019-12-09T10:04:33.716 INFO:teuthology.orchestra.run.smithi121.stderr: 45500K .......... .......... .......... .......... .......... 61% 385M 0s 2019-12-09T10:04:33.716 INFO:teuthology.orchestra.run.smithi121.stderr: 45550K .......... .......... .......... .......... .......... 61% 338M 0s 2019-12-09T10:04:33.716 INFO:teuthology.orchestra.run.smithi121.stderr: 45600K .......... .......... .......... .......... .......... 62% 408M 0s 2019-12-09T10:04:33.717 INFO:teuthology.orchestra.run.smithi121.stderr: 45650K .......... .......... .......... .......... .......... 62% 392M 0s 2019-12-09T10:04:33.717 INFO:teuthology.orchestra.run.smithi121.stderr: 45700K .......... .......... .......... .......... .......... 62% 402M 0s 2019-12-09T10:04:33.717 INFO:teuthology.orchestra.run.smithi121.stderr: 45750K .......... .......... .......... .......... .......... 62% 338M 0s 2019-12-09T10:04:33.717 INFO:teuthology.orchestra.run.smithi121.stderr: 45800K .......... .......... .......... .......... .......... 62% 383M 0s 2019-12-09T10:04:33.717 INFO:teuthology.orchestra.run.smithi121.stderr: 45850K .......... .......... .......... .......... .......... 62% 402M 0s 2019-12-09T10:04:33.717 INFO:teuthology.orchestra.run.smithi121.stderr: 45900K .......... .......... .......... .......... .......... 62% 385M 0s 2019-12-09T10:04:33.717 INFO:teuthology.orchestra.run.smithi121.stderr: 45950K .......... .......... .......... .......... .......... 62% 335M 0s 2019-12-09T10:04:33.718 INFO:teuthology.orchestra.run.smithi121.stderr: 46000K .......... .......... .......... .......... .......... 62% 399M 0s 2019-12-09T10:04:33.718 INFO:teuthology.orchestra.run.smithi121.stderr: 46050K .......... .......... .......... .......... .......... 62% 401M 0s 2019-12-09T10:04:33.718 INFO:teuthology.orchestra.run.smithi121.stderr: 46100K .......... .......... .......... .......... .......... 62% 409M 0s 2019-12-09T10:04:33.718 INFO:teuthology.orchestra.run.smithi121.stderr: 46150K .......... .......... .......... .......... .......... 62% 341M 0s 2019-12-09T10:04:33.718 INFO:teuthology.orchestra.run.smithi121.stderr: 46200K .......... .......... .......... .......... .......... 62% 379M 0s 2019-12-09T10:04:33.718 INFO:teuthology.orchestra.run.smithi121.stderr: 46250K .......... .......... .......... .......... .......... 62% 407M 0s 2019-12-09T10:04:33.718 INFO:teuthology.orchestra.run.smithi121.stderr: 46300K .......... .......... .......... .......... .......... 63% 397M 0s 2019-12-09T10:04:33.719 INFO:teuthology.orchestra.run.smithi121.stderr: 46350K .......... .......... .......... .......... .......... 63% 361M 0s 2019-12-09T10:04:33.719 INFO:teuthology.orchestra.run.smithi121.stderr: 46400K .......... .......... .......... .......... .......... 63% 416M 0s 2019-12-09T10:04:33.719 INFO:teuthology.orchestra.run.smithi121.stderr: 46450K .......... .......... .......... .......... .......... 63% 399M 0s 2019-12-09T10:04:33.719 INFO:teuthology.orchestra.run.smithi121.stderr: 46500K .......... .......... .......... .......... .......... 63% 401M 0s 2019-12-09T10:04:33.719 INFO:teuthology.orchestra.run.smithi121.stderr: 46550K .......... .......... .......... .......... .......... 63% 348M 0s 2019-12-09T10:04:33.719 INFO:teuthology.orchestra.run.smithi121.stderr: 46600K .......... .......... .......... .......... .......... 63% 402M 0s 2019-12-09T10:04:33.719 INFO:teuthology.orchestra.run.smithi121.stderr: 46650K .......... .......... .......... .......... .......... 63% 387M 0s 2019-12-09T10:04:33.720 INFO:teuthology.orchestra.run.smithi121.stderr: 46700K .......... .......... .......... .......... .......... 63% 370M 0s 2019-12-09T10:04:33.720 INFO:teuthology.orchestra.run.smithi121.stderr: 46750K .......... .......... .......... .......... .......... 63% 363M 0s 2019-12-09T10:04:33.720 INFO:teuthology.orchestra.run.smithi121.stderr: 46800K .......... .......... .......... .......... .......... 63% 413M 0s 2019-12-09T10:04:33.720 INFO:teuthology.orchestra.run.smithi121.stderr: 46850K .......... .......... .......... .......... .......... 63% 401M 0s 2019-12-09T10:04:33.720 INFO:teuthology.orchestra.run.smithi121.stderr: 46900K .......... .......... .......... .......... .......... 63% 407M 0s 2019-12-09T10:04:33.720 INFO:teuthology.orchestra.run.smithi121.stderr: 46950K .......... .......... .......... .......... .......... 63% 335M 0s 2019-12-09T10:04:33.720 INFO:teuthology.orchestra.run.smithi121.stderr: 47000K .......... .......... .......... .......... .......... 63% 316M 0s 2019-12-09T10:04:33.721 INFO:teuthology.orchestra.run.smithi121.stderr: 47050K .......... .......... .......... .......... .......... 64% 303M 0s 2019-12-09T10:04:33.721 INFO:teuthology.orchestra.run.smithi121.stderr: 47100K .......... .......... .......... .......... .......... 64% 309M 0s 2019-12-09T10:04:33.721 INFO:teuthology.orchestra.run.smithi121.stderr: 47150K .......... .......... .......... .......... .......... 64% 357M 0s 2019-12-09T10:04:33.721 INFO:teuthology.orchestra.run.smithi121.stderr: 47200K .......... .......... .......... .......... .......... 64% 407M 0s 2019-12-09T10:04:33.721 INFO:teuthology.orchestra.run.smithi121.stderr: 47250K .......... .......... .......... .......... .......... 64% 392M 0s 2019-12-09T10:04:33.721 INFO:teuthology.orchestra.run.smithi121.stderr: 47300K .......... .......... .......... .......... .......... 64% 411M 0s 2019-12-09T10:04:33.721 INFO:teuthology.orchestra.run.smithi121.stderr: 47350K .......... .......... .......... .......... .......... 64% 339M 0s 2019-12-09T10:04:33.721 INFO:teuthology.orchestra.run.smithi121.stderr: 47400K .......... .......... .......... .......... .......... 64% 386M 0s 2019-12-09T10:04:33.722 INFO:teuthology.orchestra.run.smithi121.stderr: 47450K .......... .......... .......... .......... .......... 64% 416M 0s 2019-12-09T10:04:33.722 INFO:teuthology.orchestra.run.smithi121.stderr: 47500K .......... .......... .......... .......... .......... 64% 404M 0s 2019-12-09T10:04:33.722 INFO:teuthology.orchestra.run.smithi121.stderr: 47550K .......... .......... .......... .......... .......... 64% 347M 0s 2019-12-09T10:04:33.722 INFO:teuthology.orchestra.run.smithi121.stderr: 47600K .......... .......... .......... .......... .......... 64% 413M 0s 2019-12-09T10:04:33.722 INFO:teuthology.orchestra.run.smithi121.stderr: 47650K .......... .......... .......... .......... .......... 64% 406M 0s 2019-12-09T10:04:33.722 INFO:teuthology.orchestra.run.smithi121.stderr: 47700K .......... .......... .......... .......... .......... 64% 401M 0s 2019-12-09T10:04:33.722 INFO:teuthology.orchestra.run.smithi121.stderr: 47750K .......... .......... .......... .......... .......... 64% 347M 0s 2019-12-09T10:04:33.723 INFO:teuthology.orchestra.run.smithi121.stderr: 47800K .......... .......... .......... .......... .......... 65% 383M 0s 2019-12-09T10:04:33.723 INFO:teuthology.orchestra.run.smithi121.stderr: 47850K .......... .......... .......... .......... .......... 65% 387M 0s 2019-12-09T10:04:33.723 INFO:teuthology.orchestra.run.smithi121.stderr: 47900K .......... .......... .......... .......... .......... 65% 409M 0s 2019-12-09T10:04:33.723 INFO:teuthology.orchestra.run.smithi121.stderr: 47950K .......... .......... .......... .......... .......... 65% 338M 0s 2019-12-09T10:04:33.723 INFO:teuthology.orchestra.run.smithi121.stderr: 48000K .......... .......... .......... .......... .......... 65% 395M 0s 2019-12-09T10:04:33.723 INFO:teuthology.orchestra.run.smithi121.stderr: 48050K .......... .......... .......... .......... .......... 65% 389M 0s 2019-12-09T10:04:33.723 INFO:teuthology.orchestra.run.smithi121.stderr: 48100K .......... .......... .......... .......... .......... 65% 394M 0s 2019-12-09T10:04:33.724 INFO:teuthology.orchestra.run.smithi121.stderr: 48150K .......... .......... .......... .......... .......... 65% 350M 0s 2019-12-09T10:04:33.724 INFO:teuthology.orchestra.run.smithi121.stderr: 48200K .......... .......... .......... .......... .......... 65% 408M 0s 2019-12-09T10:04:33.724 INFO:teuthology.orchestra.run.smithi121.stderr: 48250K .......... .......... .......... .......... .......... 65% 407M 0s 2019-12-09T10:04:33.724 INFO:teuthology.orchestra.run.smithi121.stderr: 48300K .......... .......... .......... .......... .......... 65% 407M 0s 2019-12-09T10:04:33.724 INFO:teuthology.orchestra.run.smithi121.stderr: 48350K .......... .......... .......... .......... .......... 65% 351M 0s 2019-12-09T10:04:33.724 INFO:teuthology.orchestra.run.smithi121.stderr: 48400K .......... .......... .......... .......... .......... 65% 397M 0s 2019-12-09T10:04:33.724 INFO:teuthology.orchestra.run.smithi121.stderr: 48450K .......... .......... .......... .......... .......... 65% 420M 0s 2019-12-09T10:04:33.725 INFO:teuthology.orchestra.run.smithi121.stderr: 48500K .......... .......... .......... .......... .......... 66% 410M 0s 2019-12-09T10:04:33.725 INFO:teuthology.orchestra.run.smithi121.stderr: 48550K .......... .......... .......... .......... .......... 66% 333M 0s 2019-12-09T10:04:33.725 INFO:teuthology.orchestra.run.smithi121.stderr: 48600K .......... .......... .......... .......... .......... 66% 393M 0s 2019-12-09T10:04:33.725 INFO:teuthology.orchestra.run.smithi121.stderr: 48650K .......... .......... .......... .......... .......... 66% 396M 0s 2019-12-09T10:04:33.725 INFO:teuthology.orchestra.run.smithi121.stderr: 48700K .......... .......... .......... .......... .......... 66% 407M 0s 2019-12-09T10:04:33.725 INFO:teuthology.orchestra.run.smithi121.stderr: 48750K .......... .......... .......... .......... .......... 66% 332M 0s 2019-12-09T10:04:33.725 INFO:teuthology.orchestra.run.smithi121.stderr: 48800K .......... .......... .......... .......... .......... 66% 405M 0s 2019-12-09T10:04:33.725 INFO:teuthology.orchestra.run.smithi121.stderr: 48850K .......... .......... .......... .......... .......... 66% 419M 0s 2019-12-09T10:04:33.726 INFO:teuthology.orchestra.run.smithi121.stderr: 48900K .......... .......... .......... .......... .......... 66% 409M 0s 2019-12-09T10:04:33.726 INFO:teuthology.orchestra.run.smithi121.stderr: 48950K .......... .......... .......... .......... .......... 66% 320M 0s 2019-12-09T10:04:33.726 INFO:teuthology.orchestra.run.smithi121.stderr: 49000K .......... .......... .......... .......... .......... 66% 409M 0s 2019-12-09T10:04:33.726 INFO:teuthology.orchestra.run.smithi121.stderr: 49050K .......... .......... .......... .......... .......... 66% 412M 0s 2019-12-09T10:04:33.726 INFO:teuthology.orchestra.run.smithi121.stderr: 49100K .......... .......... .......... .......... .......... 66% 363M 0s 2019-12-09T10:04:33.726 INFO:teuthology.orchestra.run.smithi121.stderr: 49150K .......... .......... .......... .......... .......... 66% 341M 0s 2019-12-09T10:04:33.726 INFO:teuthology.orchestra.run.smithi121.stderr: 49200K .......... .......... .......... .......... .......... 66% 417M 0s 2019-12-09T10:04:33.727 INFO:teuthology.orchestra.run.smithi121.stderr: 49250K .......... .......... .......... .......... .......... 67% 404M 0s 2019-12-09T10:04:33.727 INFO:teuthology.orchestra.run.smithi121.stderr: 49300K .......... .......... .......... .......... .......... 67% 418M 0s 2019-12-09T10:04:33.727 INFO:teuthology.orchestra.run.smithi121.stderr: 49350K .......... .......... .......... .......... .......... 67% 348M 0s 2019-12-09T10:04:33.727 INFO:teuthology.orchestra.run.smithi121.stderr: 49400K .......... .......... .......... .......... .......... 67% 415M 0s 2019-12-09T10:04:33.727 INFO:teuthology.orchestra.run.smithi121.stderr: 49450K .......... .......... .......... .......... .......... 67% 415M 0s 2019-12-09T10:04:33.727 INFO:teuthology.orchestra.run.smithi121.stderr: 49500K .......... .......... .......... .......... .......... 67% 413M 0s 2019-12-09T10:04:33.727 INFO:teuthology.orchestra.run.smithi121.stderr: 49550K .......... .......... .......... .......... .......... 67% 356M 0s 2019-12-09T10:04:33.728 INFO:teuthology.orchestra.run.smithi121.stderr: 49600K .......... .......... .......... .......... .......... 67% 433M 0s 2019-12-09T10:04:33.728 INFO:teuthology.orchestra.run.smithi121.stderr: 49650K .......... .......... .......... .......... .......... 67% 312M 0s 2019-12-09T10:04:33.728 INFO:teuthology.orchestra.run.smithi121.stderr: 49700K .......... .......... .......... .......... .......... 67% 386M 0s 2019-12-09T10:04:33.728 INFO:teuthology.orchestra.run.smithi121.stderr: 49750K .......... .......... .......... .......... .......... 67% 339M 0s 2019-12-09T10:04:33.728 INFO:teuthology.orchestra.run.smithi121.stderr: 49800K .......... .......... .......... .......... .......... 67% 407M 0s 2019-12-09T10:04:33.729 INFO:teuthology.orchestra.run.smithi121.stderr: 49850K .......... .......... .......... .......... .......... 67% 405M 0s 2019-12-09T10:04:33.729 INFO:teuthology.orchestra.run.smithi121.stderr: 49900K .......... .......... .......... .......... .......... 67% 393M 0s 2019-12-09T10:04:33.729 INFO:teuthology.orchestra.run.smithi121.stderr: 49950K .......... .......... .......... .......... .......... 67% 365M 0s 2019-12-09T10:04:33.729 INFO:teuthology.orchestra.run.smithi121.stderr: 50000K .......... .......... .......... .......... .......... 68% 417M 0s 2019-12-09T10:04:33.729 INFO:teuthology.orchestra.run.smithi121.stderr: 50050K .......... .......... .......... .......... .......... 68% 408M 0s 2019-12-09T10:04:33.729 INFO:teuthology.orchestra.run.smithi121.stderr: 50100K .......... .......... .......... .......... .......... 68% 420M 0s 2019-12-09T10:04:33.729 INFO:teuthology.orchestra.run.smithi121.stderr: 50150K .......... .......... .......... .......... .......... 68% 341M 0s 2019-12-09T10:04:33.730 INFO:teuthology.orchestra.run.smithi121.stderr: 50200K .......... .......... .......... .......... .......... 68% 419M 0s 2019-12-09T10:04:33.730 INFO:teuthology.orchestra.run.smithi121.stderr: 50250K .......... .......... .......... .......... .......... 68% 397M 0s 2019-12-09T10:04:33.730 INFO:teuthology.orchestra.run.smithi121.stderr: 50300K .......... .......... .......... .......... .......... 68% 420M 0s 2019-12-09T10:04:33.730 INFO:teuthology.orchestra.run.smithi121.stderr: 50350K .......... .......... .......... .......... .......... 68% 358M 0s 2019-12-09T10:04:33.730 INFO:teuthology.orchestra.run.smithi121.stderr: 50400K .......... .......... .......... .......... .......... 68% 411M 0s 2019-12-09T10:04:33.730 INFO:teuthology.orchestra.run.smithi121.stderr: 50450K .......... .......... .......... .......... .......... 68% 423M 0s 2019-12-09T10:04:33.730 INFO:teuthology.orchestra.run.smithi121.stderr: 50500K .......... .......... .......... .......... .......... 68% 393M 0s 2019-12-09T10:04:33.731 INFO:teuthology.orchestra.run.smithi121.stderr: 50550K .......... .......... .......... .......... .......... 68% 363M 0s 2019-12-09T10:04:33.731 INFO:teuthology.orchestra.run.smithi121.stderr: 50600K .......... .......... .......... .......... .......... 68% 431M 0s 2019-12-09T10:04:33.731 INFO:teuthology.orchestra.run.smithi121.stderr: 50650K .......... .......... .......... .......... .......... 68% 281M 0s 2019-12-09T10:04:33.731 INFO:teuthology.orchestra.run.smithi121.stderr: 50700K .......... .......... .......... .......... .......... 68% 310M 0s 2019-12-09T10:04:33.731 INFO:teuthology.orchestra.run.smithi121.stderr: 50750K .......... .......... .......... .......... .......... 69% 258M 0s 2019-12-09T10:04:33.731 INFO:teuthology.orchestra.run.smithi121.stderr: 50800K .......... .......... .......... .......... .......... 69% 307M 0s 2019-12-09T10:04:33.731 INFO:teuthology.orchestra.run.smithi121.stderr: 50850K .......... .......... .......... .......... .......... 69% 324M 0s 2019-12-09T10:04:33.731 INFO:teuthology.orchestra.run.smithi121.stderr: 50900K .......... .......... .......... .......... .......... 69% 329M 0s 2019-12-09T10:04:33.732 INFO:teuthology.orchestra.run.smithi121.stderr: 50950K .......... .......... .......... .......... .......... 69% 283M 0s 2019-12-09T10:04:33.732 INFO:teuthology.orchestra.run.smithi121.stderr: 51000K .......... .......... .......... .......... .......... 69% 325M 0s 2019-12-09T10:04:33.732 INFO:teuthology.orchestra.run.smithi121.stderr: 51050K .......... .......... .......... .......... .......... 69% 315M 0s 2019-12-09T10:04:33.732 INFO:teuthology.orchestra.run.smithi121.stderr: 51100K .......... .......... .......... .......... .......... 69% 343M 0s 2019-12-09T10:04:33.732 INFO:teuthology.orchestra.run.smithi121.stderr: 51150K .......... .......... .......... .......... .......... 69% 276M 0s 2019-12-09T10:04:33.732 INFO:teuthology.orchestra.run.smithi121.stderr: 51200K .......... .......... .......... .......... .......... 69% 308M 0s 2019-12-09T10:04:33.732 INFO:teuthology.orchestra.run.smithi121.stderr: 51250K .......... .......... .......... .......... .......... 69% 367M 0s 2019-12-09T10:04:33.733 INFO:teuthology.orchestra.run.smithi121.stderr: 51300K .......... .......... .......... .......... .......... 69% 386M 0s 2019-12-09T10:04:33.733 INFO:teuthology.orchestra.run.smithi121.stderr: 51350K .......... .......... .......... .......... .......... 69% 331M 0s 2019-12-09T10:04:33.733 INFO:teuthology.orchestra.run.smithi121.stderr: 51400K .......... .......... .......... .......... .......... 69% 378M 0s 2019-12-09T10:04:33.733 INFO:teuthology.orchestra.run.smithi121.stderr: 51450K .......... .......... .......... .......... .......... 70% 376M 0s 2019-12-09T10:04:33.733 INFO:teuthology.orchestra.run.smithi121.stderr: 51500K .......... .......... .......... .......... .......... 70% 384M 0s 2019-12-09T10:04:33.733 INFO:teuthology.orchestra.run.smithi121.stderr: 51550K .......... .......... .......... .......... .......... 70% 290M 0s 2019-12-09T10:04:33.734 INFO:teuthology.orchestra.run.smithi121.stderr: 51600K .......... .......... .......... .......... .......... 70% 368M 0s 2019-12-09T10:04:33.734 INFO:teuthology.orchestra.run.smithi121.stderr: 51650K .......... .......... .......... .......... .......... 70% 373M 0s 2019-12-09T10:04:33.734 INFO:teuthology.orchestra.run.smithi121.stderr: 51700K .......... .......... .......... .......... .......... 70% 369M 0s 2019-12-09T10:04:33.734 INFO:teuthology.orchestra.run.smithi121.stderr: 51750K .......... .......... .......... .......... .......... 70% 337M 0s 2019-12-09T10:04:33.734 INFO:teuthology.orchestra.run.smithi121.stderr: 51800K .......... .......... .......... .......... .......... 70% 374M 0s 2019-12-09T10:04:33.734 INFO:teuthology.orchestra.run.smithi121.stderr: 51850K .......... .......... .......... .......... .......... 70% 368M 0s 2019-12-09T10:04:33.734 INFO:teuthology.orchestra.run.smithi121.stderr: 51900K .......... .......... .......... .......... .......... 70% 345M 0s 2019-12-09T10:04:33.734 INFO:teuthology.orchestra.run.smithi121.stderr: 51950K .......... .......... .......... .......... .......... 70% 294M 0s 2019-12-09T10:04:33.735 INFO:teuthology.orchestra.run.smithi121.stderr: 52000K .......... .......... .......... .......... .......... 70% 364M 0s 2019-12-09T10:04:33.735 INFO:teuthology.orchestra.run.smithi121.stderr: 52050K .......... .......... .......... .......... .......... 70% 337M 0s 2019-12-09T10:04:33.735 INFO:teuthology.orchestra.run.smithi121.stderr: 52100K .......... .......... .......... .......... .......... 70% 376M 0s 2019-12-09T10:04:33.735 INFO:teuthology.orchestra.run.smithi121.stderr: 52150K .......... .......... .......... .......... .......... 70% 329M 0s 2019-12-09T10:04:33.735 INFO:teuthology.orchestra.run.smithi121.stderr: 52200K .......... .......... .......... .......... .......... 71% 365M 0s 2019-12-09T10:04:33.735 INFO:teuthology.orchestra.run.smithi121.stderr: 52250K .......... .......... .......... .......... .......... 71% 374M 0s 2019-12-09T10:04:33.735 INFO:teuthology.orchestra.run.smithi121.stderr: 52300K .......... .......... .......... .......... .......... 71% 382M 0s 2019-12-09T10:04:33.736 INFO:teuthology.orchestra.run.smithi121.stderr: 52350K .......... .......... .......... .......... .......... 71% 316M 0s 2019-12-09T10:04:33.736 INFO:teuthology.orchestra.run.smithi121.stderr: 52400K .......... .......... .......... .......... .......... 71% 387M 0s 2019-12-09T10:04:33.736 INFO:teuthology.orchestra.run.smithi121.stderr: 52450K .......... .......... .......... .......... .......... 71% 356M 0s 2019-12-09T10:04:33.736 INFO:teuthology.orchestra.run.smithi121.stderr: 52500K .......... .......... .......... .......... .......... 71% 359M 0s 2019-12-09T10:04:33.736 INFO:teuthology.orchestra.run.smithi121.stderr: 52550K .......... .......... .......... .......... .......... 71% 327M 0s 2019-12-09T10:04:33.736 INFO:teuthology.orchestra.run.smithi121.stderr: 52600K .......... .......... .......... .......... .......... 71% 353M 0s 2019-12-09T10:04:33.736 INFO:teuthology.orchestra.run.smithi121.stderr: 52650K .......... .......... .......... .......... .......... 71% 374M 0s 2019-12-09T10:04:33.737 INFO:teuthology.orchestra.run.smithi121.stderr: 52700K .......... .......... .......... .......... .......... 71% 373M 0s 2019-12-09T10:04:33.737 INFO:teuthology.orchestra.run.smithi121.stderr: 52750K .......... .......... .......... .......... .......... 71% 308M 0s 2019-12-09T10:04:33.737 INFO:teuthology.orchestra.run.smithi121.stderr: 52800K .......... .......... .......... .......... .......... 71% 367M 0s 2019-12-09T10:04:33.737 INFO:teuthology.orchestra.run.smithi121.stderr: 52850K .......... .......... .......... .......... .......... 71% 372M 0s 2019-12-09T10:04:33.737 INFO:teuthology.orchestra.run.smithi121.stderr: 52900K .......... .......... .......... .......... .......... 71% 394M 0s 2019-12-09T10:04:33.737 INFO:teuthology.orchestra.run.smithi121.stderr: 52950K .......... .......... .......... .......... .......... 72% 331M 0s 2019-12-09T10:04:33.737 INFO:teuthology.orchestra.run.smithi121.stderr: 53000K .......... .......... .......... .......... .......... 72% 375M 0s 2019-12-09T10:04:33.738 INFO:teuthology.orchestra.run.smithi121.stderr: 53050K .......... .......... .......... .......... .......... 72% 376M 0s 2019-12-09T10:04:33.738 INFO:teuthology.orchestra.run.smithi121.stderr: 53100K .......... .......... .......... .......... .......... 72% 367M 0s 2019-12-09T10:04:33.738 INFO:teuthology.orchestra.run.smithi121.stderr: 53150K .......... .......... .......... .......... .......... 72% 326M 0s 2019-12-09T10:04:33.738 INFO:teuthology.orchestra.run.smithi121.stderr: 53200K .......... .......... .......... .......... .......... 72% 373M 0s 2019-12-09T10:04:33.738 INFO:teuthology.orchestra.run.smithi121.stderr: 53250K .......... .......... .......... .......... .......... 72% 381M 0s 2019-12-09T10:04:33.738 INFO:teuthology.orchestra.run.smithi121.stderr: 53300K .......... .......... .......... .......... .......... 72% 378M 0s 2019-12-09T10:04:33.738 INFO:teuthology.orchestra.run.smithi121.stderr: 53350K .......... .......... .......... .......... .......... 72% 326M 0s 2019-12-09T10:04:33.739 INFO:teuthology.orchestra.run.smithi121.stderr: 53400K .......... .......... .......... .......... .......... 72% 387M 0s 2019-12-09T10:04:33.739 INFO:teuthology.orchestra.run.smithi121.stderr: 53450K .......... .......... .......... .......... .......... 72% 363M 0s 2019-12-09T10:04:33.739 INFO:teuthology.orchestra.run.smithi121.stderr: 53500K .......... .......... .......... .......... .......... 72% 386M 0s 2019-12-09T10:04:33.739 INFO:teuthology.orchestra.run.smithi121.stderr: 53550K .......... .......... .......... .......... .......... 72% 308M 0s 2019-12-09T10:04:33.739 INFO:teuthology.orchestra.run.smithi121.stderr: 53600K .......... .......... .......... .......... .......... 72% 375M 0s 2019-12-09T10:04:33.739 INFO:teuthology.orchestra.run.smithi121.stderr: 53650K .......... .......... .......... .......... .......... 73% 393M 0s 2019-12-09T10:04:33.740 INFO:teuthology.orchestra.run.smithi121.stderr: 53700K .......... .......... .......... .......... .......... 73% 369M 0s 2019-12-09T10:04:33.740 INFO:teuthology.orchestra.run.smithi121.stderr: 53750K .......... .......... .......... .......... .......... 73% 329M 0s 2019-12-09T10:04:33.740 INFO:teuthology.orchestra.run.smithi121.stderr: 53800K .......... .......... .......... .......... .......... 73% 376M 0s 2019-12-09T10:04:33.740 INFO:teuthology.orchestra.run.smithi121.stderr: 53850K .......... .......... .......... .......... .......... 73% 376M 0s 2019-12-09T10:04:33.740 INFO:teuthology.orchestra.run.smithi121.stderr: 53900K .......... .......... .......... .......... .......... 73% 381M 0s 2019-12-09T10:04:33.740 INFO:teuthology.orchestra.run.smithi121.stderr: 53950K .......... .......... .......... .......... .......... 73% 313M 0s 2019-12-09T10:04:33.740 INFO:teuthology.orchestra.run.smithi121.stderr: 54000K .......... .......... .......... .......... .......... 73% 379M 0s 2019-12-09T10:04:33.741 INFO:teuthology.orchestra.run.smithi121.stderr: 54050K .......... .......... .......... .......... .......... 73% 367M 0s 2019-12-09T10:04:33.741 INFO:teuthology.orchestra.run.smithi121.stderr: 54100K .......... .......... .......... .......... .......... 73% 363M 0s 2019-12-09T10:04:33.741 INFO:teuthology.orchestra.run.smithi121.stderr: 54150K .......... .......... .......... .......... .......... 73% 336M 0s 2019-12-09T10:04:33.741 INFO:teuthology.orchestra.run.smithi121.stderr: 54200K .......... .......... .......... .......... .......... 73% 388M 0s 2019-12-09T10:04:33.741 INFO:teuthology.orchestra.run.smithi121.stderr: 54250K .......... .......... .......... .......... .......... 73% 384M 0s 2019-12-09T10:04:33.741 INFO:teuthology.orchestra.run.smithi121.stderr: 54300K .......... .......... .......... .......... .......... 73% 376M 0s 2019-12-09T10:04:33.741 INFO:teuthology.orchestra.run.smithi121.stderr: 54350K .......... .......... .......... .......... .......... 73% 315M 0s 2019-12-09T10:04:33.742 INFO:teuthology.orchestra.run.smithi121.stderr: 54400K .......... .......... .......... .......... .......... 74% 395M 0s 2019-12-09T10:04:33.742 INFO:teuthology.orchestra.run.smithi121.stderr: 54450K .......... .......... .......... .......... .......... 74% 374M 0s 2019-12-09T10:04:33.742 INFO:teuthology.orchestra.run.smithi121.stderr: 54500K .......... .......... .......... .......... .......... 74% 366M 0s 2019-12-09T10:04:33.742 INFO:teuthology.orchestra.run.smithi121.stderr: 54550K .......... .......... .......... .......... .......... 74% 328M 0s 2019-12-09T10:04:33.742 INFO:teuthology.orchestra.run.smithi121.stderr: 54600K .......... .......... .......... .......... .......... 74% 381M 0s 2019-12-09T10:04:33.742 INFO:teuthology.orchestra.run.smithi121.stderr: 54650K .......... .......... .......... .......... .......... 74% 380M 0s 2019-12-09T10:04:33.742 INFO:teuthology.orchestra.run.smithi121.stderr: 54700K .......... .......... .......... .......... .......... 74% 375M 0s 2019-12-09T10:04:33.742 INFO:teuthology.orchestra.run.smithi121.stderr: 54750K .......... .......... .......... .......... .......... 74% 318M 0s 2019-12-09T10:04:33.743 INFO:teuthology.orchestra.run.smithi121.stderr: 54800K .......... .......... .......... .......... .......... 74% 391M 0s 2019-12-09T10:04:33.743 INFO:teuthology.orchestra.run.smithi121.stderr: 54850K .......... .......... .......... .......... .......... 74% 373M 0s 2019-12-09T10:04:33.743 INFO:teuthology.orchestra.run.smithi121.stderr: 54900K .......... .......... .......... .......... .......... 74% 387M 0s 2019-12-09T10:04:33.743 INFO:teuthology.orchestra.run.smithi121.stderr: 54950K .......... .......... .......... .......... .......... 74% 313M 0s 2019-12-09T10:04:33.743 INFO:teuthology.orchestra.run.smithi121.stderr: 55000K .......... .......... .......... .......... .......... 74% 392M 0s 2019-12-09T10:04:33.743 INFO:teuthology.orchestra.run.smithi121.stderr: 55050K .......... .......... .......... .......... .......... 74% 392M 0s 2019-12-09T10:04:33.743 INFO:teuthology.orchestra.run.smithi121.stderr: 55100K .......... .......... .......... .......... .......... 74% 407M 0s 2019-12-09T10:04:33.744 INFO:teuthology.orchestra.run.smithi121.stderr: 55150K .......... .......... .......... .......... .......... 75% 325M 0s 2019-12-09T10:04:33.744 INFO:teuthology.orchestra.run.smithi121.stderr: 55200K .......... .......... .......... .......... .......... 75% 366M 0s 2019-12-09T10:04:33.744 INFO:teuthology.orchestra.run.smithi121.stderr: 55250K .......... .......... .......... .......... .......... 75% 396M 0s 2019-12-09T10:04:33.744 INFO:teuthology.orchestra.run.smithi121.stderr: 55300K .......... .......... .......... .......... .......... 75% 381M 0s 2019-12-09T10:04:33.744 INFO:teuthology.orchestra.run.smithi121.stderr: 55350K .......... .......... .......... .......... .......... 75% 310M 0s 2019-12-09T10:04:33.744 INFO:teuthology.orchestra.run.smithi121.stderr: 55400K .......... .......... .......... .......... .......... 75% 390M 0s 2019-12-09T10:04:33.745 INFO:teuthology.orchestra.run.smithi121.stderr: 55450K .......... .......... .......... .......... .......... 75% 371M 0s 2019-12-09T10:04:33.745 INFO:teuthology.orchestra.run.smithi121.stderr: 55500K .......... .......... .......... .......... .......... 75% 386M 0s 2019-12-09T10:04:33.745 INFO:teuthology.orchestra.run.smithi121.stderr: 55550K .......... .......... .......... .......... .......... 75% 342M 0s 2019-12-09T10:04:33.745 INFO:teuthology.orchestra.run.smithi121.stderr: 55600K .......... .......... .......... .......... .......... 75% 374M 0s 2019-12-09T10:04:33.745 INFO:teuthology.orchestra.run.smithi121.stderr: 55650K .......... .......... .......... .......... .......... 75% 392M 0s 2019-12-09T10:04:33.745 INFO:teuthology.orchestra.run.smithi121.stderr: 55700K .......... .......... .......... .......... .......... 75% 383M 0s 2019-12-09T10:04:33.745 INFO:teuthology.orchestra.run.smithi121.stderr: 55750K .......... .......... .......... .......... .......... 75% 292M 0s 2019-12-09T10:04:33.745 INFO:teuthology.orchestra.run.smithi121.stderr: 55800K .......... .......... .......... .......... .......... 75% 367M 0s 2019-12-09T10:04:33.746 INFO:teuthology.orchestra.run.smithi121.stderr: 55850K .......... .......... .......... .......... .......... 75% 356M 0s 2019-12-09T10:04:33.746 INFO:teuthology.orchestra.run.smithi121.stderr: 55900K .......... .......... .......... .......... .......... 76% 362M 0s 2019-12-09T10:04:33.746 INFO:teuthology.orchestra.run.smithi121.stderr: 55950K .......... .......... .......... .......... .......... 76% 312M 0s 2019-12-09T10:04:33.746 INFO:teuthology.orchestra.run.smithi121.stderr: 56000K .......... .......... .......... .......... .......... 76% 371M 0s 2019-12-09T10:04:33.746 INFO:teuthology.orchestra.run.smithi121.stderr: 56050K .......... .......... .......... .......... .......... 76% 347M 0s 2019-12-09T10:04:33.746 INFO:teuthology.orchestra.run.smithi121.stderr: 56100K .......... .......... .......... .......... .......... 76% 401M 0s 2019-12-09T10:04:33.746 INFO:teuthology.orchestra.run.smithi121.stderr: 56150K .......... .......... .......... .......... .......... 76% 318M 0s 2019-12-09T10:04:33.747 INFO:teuthology.orchestra.run.smithi121.stderr: 56200K .......... .......... .......... .......... .......... 76% 392M 0s 2019-12-09T10:04:33.747 INFO:teuthology.orchestra.run.smithi121.stderr: 56250K .......... .......... .......... .......... .......... 76% 386M 0s 2019-12-09T10:04:33.747 INFO:teuthology.orchestra.run.smithi121.stderr: 56300K .......... .......... .......... .......... .......... 76% 384M 0s 2019-12-09T10:04:33.747 INFO:teuthology.orchestra.run.smithi121.stderr: 56350K .......... .......... .......... .......... .......... 76% 356M 0s 2019-12-09T10:04:33.747 INFO:teuthology.orchestra.run.smithi121.stderr: 56400K .......... .......... .......... .......... .......... 76% 408M 0s 2019-12-09T10:04:33.747 INFO:teuthology.orchestra.run.smithi121.stderr: 56450K .......... .......... .......... .......... .......... 76% 410M 0s 2019-12-09T10:04:33.747 INFO:teuthology.orchestra.run.smithi121.stderr: 56500K .......... .......... .......... .......... .......... 76% 414M 0s 2019-12-09T10:04:33.748 INFO:teuthology.orchestra.run.smithi121.stderr: 56550K .......... .......... .......... .......... .......... 76% 338M 0s 2019-12-09T10:04:33.748 INFO:teuthology.orchestra.run.smithi121.stderr: 56600K .......... .......... .......... .......... .......... 77% 407M 0s 2019-12-09T10:04:33.748 INFO:teuthology.orchestra.run.smithi121.stderr: 56650K .......... .......... .......... .......... .......... 77% 400M 0s 2019-12-09T10:04:33.748 INFO:teuthology.orchestra.run.smithi121.stderr: 56700K .......... .......... .......... .......... .......... 77% 394M 0s 2019-12-09T10:04:33.748 INFO:teuthology.orchestra.run.smithi121.stderr: 56750K .......... .......... .......... .......... .......... 77% 364M 0s 2019-12-09T10:04:33.748 INFO:teuthology.orchestra.run.smithi121.stderr: 56800K .......... .......... .......... .......... .......... 77% 386M 0s 2019-12-09T10:04:33.748 INFO:teuthology.orchestra.run.smithi121.stderr: 56850K .......... .......... .......... .......... .......... 77% 398M 0s 2019-12-09T10:04:33.749 INFO:teuthology.orchestra.run.smithi121.stderr: 56900K .......... .......... .......... .......... .......... 77% 375M 0s 2019-12-09T10:04:33.749 INFO:teuthology.orchestra.run.smithi121.stderr: 56950K .......... .......... .......... .......... .......... 77% 335M 0s 2019-12-09T10:04:33.749 INFO:teuthology.orchestra.run.smithi121.stderr: 57000K .......... .......... .......... .......... .......... 77% 395M 0s 2019-12-09T10:04:33.749 INFO:teuthology.orchestra.run.smithi121.stderr: 57050K .......... .......... .......... .......... .......... 77% 400M 0s 2019-12-09T10:04:33.749 INFO:teuthology.orchestra.run.smithi121.stderr: 57100K .......... .......... .......... .......... .......... 77% 381M 0s 2019-12-09T10:04:33.749 INFO:teuthology.orchestra.run.smithi121.stderr: 57150K .......... .......... .......... .......... .......... 77% 340M 0s 2019-12-09T10:04:33.749 INFO:teuthology.orchestra.run.smithi121.stderr: 57200K .......... .......... .......... .......... .......... 77% 383M 0s 2019-12-09T10:04:33.750 INFO:teuthology.orchestra.run.smithi121.stderr: 57250K .......... .......... .......... .......... .......... 77% 383M 0s 2019-12-09T10:04:33.750 INFO:teuthology.orchestra.run.smithi121.stderr: 57300K .......... .......... .......... .......... .......... 77% 385M 0s 2019-12-09T10:04:33.750 INFO:teuthology.orchestra.run.smithi121.stderr: 57350K .......... .......... .......... .......... .......... 78% 334M 0s 2019-12-09T10:04:33.750 INFO:teuthology.orchestra.run.smithi121.stderr: 57400K .......... .......... .......... .......... .......... 78% 387M 0s 2019-12-09T10:04:33.750 INFO:teuthology.orchestra.run.smithi121.stderr: 57450K .......... .......... .......... .......... .......... 78% 392M 0s 2019-12-09T10:04:33.750 INFO:teuthology.orchestra.run.smithi121.stderr: 57500K .......... .......... .......... .......... .......... 78% 379M 0s 2019-12-09T10:04:33.750 INFO:teuthology.orchestra.run.smithi121.stderr: 57550K .......... .......... .......... .......... .......... 78% 327M 0s 2019-12-09T10:04:33.751 INFO:teuthology.orchestra.run.smithi121.stderr: 57600K .......... .......... .......... .......... .......... 78% 383M 0s 2019-12-09T10:04:33.751 INFO:teuthology.orchestra.run.smithi121.stderr: 57650K .......... .......... .......... .......... .......... 78% 390M 0s 2019-12-09T10:04:33.751 INFO:teuthology.orchestra.run.smithi121.stderr: 57700K .......... .......... .......... .......... .......... 78% 394M 0s 2019-12-09T10:04:33.751 INFO:teuthology.orchestra.run.smithi121.stderr: 57750K .......... .......... .......... .......... .......... 78% 337M 0s 2019-12-09T10:04:33.751 INFO:teuthology.orchestra.run.smithi121.stderr: 57800K .......... .......... .......... .......... .......... 78% 410M 0s 2019-12-09T10:04:33.751 INFO:teuthology.orchestra.run.smithi121.stderr: 57850K .......... .......... .......... .......... .......... 78% 396M 0s 2019-12-09T10:04:33.751 INFO:teuthology.orchestra.run.smithi121.stderr: 57900K .......... .......... .......... .......... .......... 78% 402M 0s 2019-12-09T10:04:33.752 INFO:teuthology.orchestra.run.smithi121.stderr: 57950K .......... .......... .......... .......... .......... 78% 349M 0s 2019-12-09T10:04:33.752 INFO:teuthology.orchestra.run.smithi121.stderr: 58000K .......... .......... .......... .......... .......... 78% 411M 0s 2019-12-09T10:04:33.752 INFO:teuthology.orchestra.run.smithi121.stderr: 58050K .......... .......... .......... .......... .......... 78% 393M 0s 2019-12-09T10:04:33.752 INFO:teuthology.orchestra.run.smithi121.stderr: 58100K .......... .......... .......... .......... .......... 79% 370M 0s 2019-12-09T10:04:33.752 INFO:teuthology.orchestra.run.smithi121.stderr: 58150K .......... .......... .......... .......... .......... 79% 341M 0s 2019-12-09T10:04:33.752 INFO:teuthology.orchestra.run.smithi121.stderr: 58200K .......... .......... .......... .......... .......... 79% 384M 0s 2019-12-09T10:04:33.752 INFO:teuthology.orchestra.run.smithi121.stderr: 58250K .......... .......... .......... .......... .......... 79% 368M 0s 2019-12-09T10:04:33.752 INFO:teuthology.orchestra.run.smithi121.stderr: 58300K .......... .......... .......... .......... .......... 79% 364M 0s 2019-12-09T10:04:33.753 INFO:teuthology.orchestra.run.smithi121.stderr: 58350K .......... .......... .......... .......... .......... 79% 328M 0s 2019-12-09T10:04:33.753 INFO:teuthology.orchestra.run.smithi121.stderr: 58400K .......... .......... .......... .......... .......... 79% 381M 0s 2019-12-09T10:04:33.753 INFO:teuthology.orchestra.run.smithi121.stderr: 58450K .......... .......... .......... .......... .......... 79% 379M 0s 2019-12-09T10:04:33.753 INFO:teuthology.orchestra.run.smithi121.stderr: 58500K .......... .......... .......... .......... .......... 79% 394M 0s 2019-12-09T10:04:33.753 INFO:teuthology.orchestra.run.smithi121.stderr: 58550K .......... .......... .......... .......... .......... 79% 341M 0s 2019-12-09T10:04:33.753 INFO:teuthology.orchestra.run.smithi121.stderr: 58600K .......... .......... .......... .......... .......... 79% 374M 0s 2019-12-09T10:04:33.753 INFO:teuthology.orchestra.run.smithi121.stderr: 58650K .......... .......... .......... .......... .......... 79% 367M 0s 2019-12-09T10:04:33.754 INFO:teuthology.orchestra.run.smithi121.stderr: 58700K .......... .......... .......... .......... .......... 79% 375M 0s 2019-12-09T10:04:33.754 INFO:teuthology.orchestra.run.smithi121.stderr: 58750K .......... .......... .......... .......... .......... 79% 350M 0s 2019-12-09T10:04:33.754 INFO:teuthology.orchestra.run.smithi121.stderr: 58800K .......... .......... .......... .......... .......... 80% 372M 0s 2019-12-09T10:04:33.754 INFO:teuthology.orchestra.run.smithi121.stderr: 58850K .......... .......... .......... .......... .......... 80% 376M 0s 2019-12-09T10:04:33.754 INFO:teuthology.orchestra.run.smithi121.stderr: 58900K .......... .......... .......... .......... .......... 80% 385M 0s 2019-12-09T10:04:33.754 INFO:teuthology.orchestra.run.smithi121.stderr: 58950K .......... .......... .......... .......... .......... 80% 360M 0s 2019-12-09T10:04:33.754 INFO:teuthology.orchestra.run.smithi121.stderr: 59000K .......... .......... .......... .......... .......... 80% 388M 0s 2019-12-09T10:04:33.755 INFO:teuthology.orchestra.run.smithi121.stderr: 59050K .......... .......... .......... .......... .......... 80% 386M 0s 2019-12-09T10:04:33.755 INFO:teuthology.orchestra.run.smithi121.stderr: 59100K .......... .......... .......... .......... .......... 80% 402M 0s 2019-12-09T10:04:33.755 INFO:teuthology.orchestra.run.smithi121.stderr: 59150K .......... .......... .......... .......... .......... 80% 333M 0s 2019-12-09T10:04:33.755 INFO:teuthology.orchestra.run.smithi121.stderr: 59200K .......... .......... .......... .......... .......... 80% 401M 0s 2019-12-09T10:04:33.755 INFO:teuthology.orchestra.run.smithi121.stderr: 59250K .......... .......... .......... .......... .......... 80% 386M 0s 2019-12-09T10:04:33.755 INFO:teuthology.orchestra.run.smithi121.stderr: 59300K .......... .......... .......... .......... .......... 80% 393M 0s 2019-12-09T10:04:33.755 INFO:teuthology.orchestra.run.smithi121.stderr: 59350K .......... .......... .......... .......... .......... 80% 332M 0s 2019-12-09T10:04:33.756 INFO:teuthology.orchestra.run.smithi121.stderr: 59400K .......... .......... .......... .......... .......... 80% 376M 0s 2019-12-09T10:04:33.756 INFO:teuthology.orchestra.run.smithi121.stderr: 59450K .......... .......... .......... .......... .......... 80% 393M 0s 2019-12-09T10:04:33.756 INFO:teuthology.orchestra.run.smithi121.stderr: 59500K .......... .......... .......... .......... .......... 80% 391M 0s 2019-12-09T10:04:33.756 INFO:teuthology.orchestra.run.smithi121.stderr: 59550K .......... .......... .......... .......... .......... 81% 349M 0s 2019-12-09T10:04:33.756 INFO:teuthology.orchestra.run.smithi121.stderr: 59600K .......... .......... .......... .......... .......... 81% 404M 0s 2019-12-09T10:04:33.756 INFO:teuthology.orchestra.run.smithi121.stderr: 59650K .......... .......... .......... .......... .......... 81% 371M 0s 2019-12-09T10:04:33.756 INFO:teuthology.orchestra.run.smithi121.stderr: 59700K .......... .......... .......... .......... .......... 81% 406M 0s 2019-12-09T10:04:33.757 INFO:teuthology.orchestra.run.smithi121.stderr: 59750K .......... .......... .......... .......... .......... 81% 355M 0s 2019-12-09T10:04:33.757 INFO:teuthology.orchestra.run.smithi121.stderr: 59800K .......... .......... .......... .......... .......... 81% 369M 0s 2019-12-09T10:04:33.757 INFO:teuthology.orchestra.run.smithi121.stderr: 59850K .......... .......... .......... .......... .......... 81% 410M 0s 2019-12-09T10:04:33.757 INFO:teuthology.orchestra.run.smithi121.stderr: 59900K .......... .......... .......... .......... .......... 81% 404M 0s 2019-12-09T10:04:33.757 INFO:teuthology.orchestra.run.smithi121.stderr: 59950K .......... .......... .......... .......... .......... 81% 360M 0s 2019-12-09T10:04:33.757 INFO:teuthology.orchestra.run.smithi121.stderr: 60000K .......... .......... .......... .......... .......... 81% 406M 0s 2019-12-09T10:04:33.757 INFO:teuthology.orchestra.run.smithi121.stderr: 60050K .......... .......... .......... .......... .......... 81% 373M 0s 2019-12-09T10:04:33.758 INFO:teuthology.orchestra.run.smithi121.stderr: 60100K .......... .......... .......... .......... .......... 81% 400M 0s 2019-12-09T10:04:33.758 INFO:teuthology.orchestra.run.smithi121.stderr: 60150K .......... .......... .......... .......... .......... 81% 345M 0s 2019-12-09T10:04:33.758 INFO:teuthology.orchestra.run.smithi121.stderr: 60200K .......... .......... .......... .......... .......... 81% 406M 0s 2019-12-09T10:04:33.758 INFO:teuthology.orchestra.run.smithi121.stderr: 60250K .......... .......... .......... .......... .......... 81% 376M 0s 2019-12-09T10:04:33.758 INFO:teuthology.orchestra.run.smithi121.stderr: 60300K .......... .......... .......... .......... .......... 82% 420M 0s 2019-12-09T10:04:33.758 INFO:teuthology.orchestra.run.smithi121.stderr: 60350K .......... .......... .......... .......... .......... 82% 344M 0s 2019-12-09T10:04:33.758 INFO:teuthology.orchestra.run.smithi121.stderr: 60400K .......... .......... .......... .......... .......... 82% 392M 0s 2019-12-09T10:04:33.759 INFO:teuthology.orchestra.run.smithi121.stderr: 60450K .......... .......... .......... .......... .......... 82% 411M 0s 2019-12-09T10:04:33.759 INFO:teuthology.orchestra.run.smithi121.stderr: 60500K .......... .......... .......... .......... .......... 82% 408M 0s 2019-12-09T10:04:33.759 INFO:teuthology.orchestra.run.smithi121.stderr: 60550K .......... .......... .......... .......... .......... 82% 350M 0s 2019-12-09T10:04:33.759 INFO:teuthology.orchestra.run.smithi121.stderr: 60600K .......... .......... .......... .......... .......... 82% 406M 0s 2019-12-09T10:04:33.759 INFO:teuthology.orchestra.run.smithi121.stderr: 60650K .......... .......... .......... .......... .......... 82% 400M 0s 2019-12-09T10:04:33.759 INFO:teuthology.orchestra.run.smithi121.stderr: 60700K .......... .......... .......... .......... .......... 82% 409M 0s 2019-12-09T10:04:33.759 INFO:teuthology.orchestra.run.smithi121.stderr: 60750K .......... .......... .......... .......... .......... 82% 367M 0s 2019-12-09T10:04:33.760 INFO:teuthology.orchestra.run.smithi121.stderr: 60800K .......... .......... .......... .......... .......... 82% 421M 0s 2019-12-09T10:04:33.760 INFO:teuthology.orchestra.run.smithi121.stderr: 60850K .......... .......... .......... .......... .......... 82% 419M 0s 2019-12-09T10:04:33.760 INFO:teuthology.orchestra.run.smithi121.stderr: 60900K .......... .......... .......... .......... .......... 82% 414M 0s 2019-12-09T10:04:33.760 INFO:teuthology.orchestra.run.smithi121.stderr: 60950K .......... .......... .......... .......... .......... 82% 211M 0s 2019-12-09T10:04:33.760 INFO:teuthology.orchestra.run.smithi121.stderr: 61000K .......... .......... .......... .......... .......... 82% 400M 0s 2019-12-09T10:04:33.760 INFO:teuthology.orchestra.run.smithi121.stderr: 61050K .......... .......... .......... .......... .......... 83% 393M 0s 2019-12-09T10:04:33.760 INFO:teuthology.orchestra.run.smithi121.stderr: 61100K .......... .......... .......... .......... .......... 83% 382M 0s 2019-12-09T10:04:33.761 INFO:teuthology.orchestra.run.smithi121.stderr: 61150K .......... .......... .......... .......... .......... 83% 257M 0s 2019-12-09T10:04:33.761 INFO:teuthology.orchestra.run.smithi121.stderr: 61200K .......... .......... .......... .......... .......... 83% 249M 0s 2019-12-09T10:04:33.761 INFO:teuthology.orchestra.run.smithi121.stderr: 61250K .......... .......... .......... .......... .......... 83% 241M 0s 2019-12-09T10:04:33.761 INFO:teuthology.orchestra.run.smithi121.stderr: 61300K .......... .......... .......... .......... .......... 83% 263M 0s 2019-12-09T10:04:33.761 INFO:teuthology.orchestra.run.smithi121.stderr: 61350K .......... .......... .......... .......... .......... 83% 227M 0s 2019-12-09T10:04:33.761 INFO:teuthology.orchestra.run.smithi121.stderr: 61400K .......... .......... .......... .......... .......... 83% 244M 0s 2019-12-09T10:04:33.761 INFO:teuthology.orchestra.run.smithi121.stderr: 61450K .......... .......... .......... .......... .......... 83% 260M 0s 2019-12-09T10:04:33.762 INFO:teuthology.orchestra.run.smithi121.stderr: 61500K .......... .......... .......... .......... .......... 83% 354M 0s 2019-12-09T10:04:33.762 INFO:teuthology.orchestra.run.smithi121.stderr: 61550K .......... .......... .......... .......... .......... 83% 243M 0s 2019-12-09T10:04:33.762 INFO:teuthology.orchestra.run.smithi121.stderr: 61600K .......... .......... .......... .......... .......... 83% 236M 0s 2019-12-09T10:04:33.762 INFO:teuthology.orchestra.run.smithi121.stderr: 61650K .......... .......... .......... .......... .......... 83% 249M 0s 2019-12-09T10:04:33.762 INFO:teuthology.orchestra.run.smithi121.stderr: 61700K .......... .......... .......... .......... .......... 83% 323M 0s 2019-12-09T10:04:33.762 INFO:teuthology.orchestra.run.smithi121.stderr: 61750K .......... .......... .......... .......... .......... 84% 232M 0s 2019-12-09T10:04:33.762 INFO:teuthology.orchestra.run.smithi121.stderr: 61800K .......... .......... .......... .......... .......... 84% 230M 0s 2019-12-09T10:04:33.763 INFO:teuthology.orchestra.run.smithi121.stderr: 61850K .......... .......... .......... .......... .......... 84% 228M 0s 2019-12-09T10:04:33.763 INFO:teuthology.orchestra.run.smithi121.stderr: 61900K .......... .......... .......... .......... .......... 84% 234M 0s 2019-12-09T10:04:33.763 INFO:teuthology.orchestra.run.smithi121.stderr: 61950K .......... .......... .......... .......... .......... 84% 290M 0s 2019-12-09T10:04:33.763 INFO:teuthology.orchestra.run.smithi121.stderr: 62000K .......... .......... .......... .......... .......... 84% 385M 0s 2019-12-09T10:04:33.763 INFO:teuthology.orchestra.run.smithi121.stderr: 62050K .......... .......... .......... .......... .......... 84% 385M 0s 2019-12-09T10:04:33.763 INFO:teuthology.orchestra.run.smithi121.stderr: 62100K .......... .......... .......... .......... .......... 84% 396M 0s 2019-12-09T10:04:33.763 INFO:teuthology.orchestra.run.smithi121.stderr: 62150K .......... .......... .......... .......... .......... 84% 292M 0s 2019-12-09T10:04:33.763 INFO:teuthology.orchestra.run.smithi121.stderr: 62200K .......... .......... .......... .......... .......... 84% 317M 0s 2019-12-09T10:04:33.764 INFO:teuthology.orchestra.run.smithi121.stderr: 62250K .......... .......... .......... .......... .......... 84% 318M 0s 2019-12-09T10:04:33.764 INFO:teuthology.orchestra.run.smithi121.stderr: 62300K .......... .......... .......... .......... .......... 84% 308M 0s 2019-12-09T10:04:33.764 INFO:teuthology.orchestra.run.smithi121.stderr: 62350K .......... .......... .......... .......... .......... 84% 277M 0s 2019-12-09T10:04:33.764 INFO:teuthology.orchestra.run.smithi121.stderr: 62400K .......... .......... .......... .......... .......... 84% 289M 0s 2019-12-09T10:04:33.764 INFO:teuthology.orchestra.run.smithi121.stderr: 62450K .......... .......... .......... .......... .......... 84% 319M 0s 2019-12-09T10:04:33.764 INFO:teuthology.orchestra.run.smithi121.stderr: 62500K .......... .......... .......... .......... .......... 85% 315M 0s 2019-12-09T10:04:33.764 INFO:teuthology.orchestra.run.smithi121.stderr: 62550K .......... .......... .......... .......... .......... 85% 277M 0s 2019-12-09T10:04:33.765 INFO:teuthology.orchestra.run.smithi121.stderr: 62600K .......... .......... .......... .......... .......... 85% 312M 0s 2019-12-09T10:04:33.765 INFO:teuthology.orchestra.run.smithi121.stderr: 62650K .......... .......... .......... .......... .......... 85% 308M 0s 2019-12-09T10:04:33.765 INFO:teuthology.orchestra.run.smithi121.stderr: 62700K .......... .......... .......... .......... .......... 85% 235M 0s 2019-12-09T10:04:33.765 INFO:teuthology.orchestra.run.smithi121.stderr: 62750K .......... .......... .......... .......... .......... 85% 227M 0s 2019-12-09T10:04:33.765 INFO:teuthology.orchestra.run.smithi121.stderr: 62800K .......... .......... .......... .......... .......... 85% 260M 0s 2019-12-09T10:04:33.765 INFO:teuthology.orchestra.run.smithi121.stderr: 62850K .......... .......... .......... .......... .......... 85% 258M 0s 2019-12-09T10:04:33.765 INFO:teuthology.orchestra.run.smithi121.stderr: 62900K .......... .......... .......... .......... .......... 85% 246M 0s 2019-12-09T10:04:33.766 INFO:teuthology.orchestra.run.smithi121.stderr: 62950K .......... .......... .......... .......... .......... 85% 216M 0s 2019-12-09T10:04:33.766 INFO:teuthology.orchestra.run.smithi121.stderr: 63000K .......... .......... .......... .......... .......... 85% 361M 0s 2019-12-09T10:04:33.766 INFO:teuthology.orchestra.run.smithi121.stderr: 63050K .......... .......... .......... .......... .......... 85% 424M 0s 2019-12-09T10:04:33.766 INFO:teuthology.orchestra.run.smithi121.stderr: 63100K .......... .......... .......... .......... .......... 85% 418M 0s 2019-12-09T10:04:33.766 INFO:teuthology.orchestra.run.smithi121.stderr: 63150K .......... .......... .......... .......... .......... 85% 332M 0s 2019-12-09T10:04:33.766 INFO:teuthology.orchestra.run.smithi121.stderr: 63200K .......... .......... .......... .......... .......... 85% 404M 0s 2019-12-09T10:04:33.766 INFO:teuthology.orchestra.run.smithi121.stderr: 63250K .......... .......... .......... .......... .......... 86% 385M 0s 2019-12-09T10:04:33.767 INFO:teuthology.orchestra.run.smithi121.stderr: 63300K .......... .......... .......... .......... .......... 86% 381M 0s 2019-12-09T10:04:33.767 INFO:teuthology.orchestra.run.smithi121.stderr: 63350K .......... .......... .......... .......... .......... 86% 229M 0s 2019-12-09T10:04:33.767 INFO:teuthology.orchestra.run.smithi121.stderr: 63400K .......... .......... .......... .......... .......... 86% 238M 0s 2019-12-09T10:04:33.767 INFO:teuthology.orchestra.run.smithi121.stderr: 63450K .......... .......... .......... .......... .......... 86% 365M 0s 2019-12-09T10:04:33.767 INFO:teuthology.orchestra.run.smithi121.stderr: 63500K .......... .......... .......... .......... .......... 86% 365M 0s 2019-12-09T10:04:33.767 INFO:teuthology.orchestra.run.smithi121.stderr: 63550K .......... .......... .......... .......... .......... 86% 334M 0s 2019-12-09T10:04:33.767 INFO:teuthology.orchestra.run.smithi121.stderr: 63600K .......... .......... .......... .......... .......... 86% 419M 0s 2019-12-09T10:04:33.768 INFO:teuthology.orchestra.run.smithi121.stderr: 63650K .......... .......... .......... .......... .......... 86% 363M 0s 2019-12-09T10:04:33.768 INFO:teuthology.orchestra.run.smithi121.stderr: 63700K .......... .......... .......... .......... .......... 86% 390M 0s 2019-12-09T10:04:33.768 INFO:teuthology.orchestra.run.smithi121.stderr: 63750K .......... .......... .......... .......... .......... 86% 364M 0s 2019-12-09T10:04:33.768 INFO:teuthology.orchestra.run.smithi121.stderr: 63800K .......... .......... .......... .......... .......... 86% 385M 0s 2019-12-09T10:04:33.768 INFO:teuthology.orchestra.run.smithi121.stderr: 63850K .......... .......... .......... .......... .......... 86% 319M 0s 2019-12-09T10:04:33.768 INFO:teuthology.orchestra.run.smithi121.stderr: 63900K .......... .......... .......... .......... .......... 86% 315M 0s 2019-12-09T10:04:33.768 INFO:teuthology.orchestra.run.smithi121.stderr: 63950K .......... .......... .......... .......... .......... 87% 255M 0s 2019-12-09T10:04:33.769 INFO:teuthology.orchestra.run.smithi121.stderr: 64000K .......... .......... .......... .......... .......... 87% 313M 0s 2019-12-09T10:04:33.769 INFO:teuthology.orchestra.run.smithi121.stderr: 64050K .......... .......... .......... .......... .......... 87% 302M 0s 2019-12-09T10:04:33.769 INFO:teuthology.orchestra.run.smithi121.stderr: 64100K .......... .......... .......... .......... .......... 87% 305M 0s 2019-12-09T10:04:33.769 INFO:teuthology.orchestra.run.smithi121.stderr: 64150K .......... .......... .......... .......... .......... 87% 285M 0s 2019-12-09T10:04:33.769 INFO:teuthology.orchestra.run.smithi121.stderr: 64200K .......... .......... .......... .......... .......... 87% 281M 0s 2019-12-09T10:04:33.769 INFO:teuthology.orchestra.run.smithi121.stderr: 64250K .......... .......... .......... .......... .......... 87% 309M 0s 2019-12-09T10:04:33.769 INFO:teuthology.orchestra.run.smithi121.stderr: 64300K .......... .......... .......... .......... .......... 87% 238M 0s 2019-12-09T10:04:33.770 INFO:teuthology.orchestra.run.smithi121.stderr: 64350K .......... .......... .......... .......... .......... 87% 182M 0s 2019-12-09T10:04:33.770 INFO:teuthology.orchestra.run.smithi121.stderr: 64400K .......... .......... .......... .......... .......... 87% 351M 0s 2019-12-09T10:04:33.770 INFO:teuthology.orchestra.run.smithi121.stderr: 64450K .......... .......... .......... .......... .......... 87% 377M 0s 2019-12-09T10:04:33.770 INFO:teuthology.orchestra.run.smithi121.stderr: 64500K .......... .......... .......... .......... .......... 87% 361M 0s 2019-12-09T10:04:33.770 INFO:teuthology.orchestra.run.smithi121.stderr: 64550K .......... .......... .......... .......... .......... 87% 316M 0s 2019-12-09T10:04:33.770 INFO:teuthology.orchestra.run.smithi121.stderr: 64600K .......... .......... .......... .......... .......... 87% 379M 0s 2019-12-09T10:04:33.770 INFO:teuthology.orchestra.run.smithi121.stderr: 64650K .......... .......... .......... .......... .......... 87% 399M 0s 2019-12-09T10:04:33.771 INFO:teuthology.orchestra.run.smithi121.stderr: 64700K .......... .......... .......... .......... .......... 88% 394M 0s 2019-12-09T10:04:33.771 INFO:teuthology.orchestra.run.smithi121.stderr: 64750K .......... .......... .......... .......... .......... 88% 324M 0s 2019-12-09T10:04:33.771 INFO:teuthology.orchestra.run.smithi121.stderr: 64800K .......... .......... .......... .......... .......... 88% 384M 0s 2019-12-09T10:04:33.771 INFO:teuthology.orchestra.run.smithi121.stderr: 64850K .......... .......... .......... .......... .......... 88% 410M 0s 2019-12-09T10:04:33.771 INFO:teuthology.orchestra.run.smithi121.stderr: 64900K .......... .......... .......... .......... .......... 88% 395M 0s 2019-12-09T10:04:33.771 INFO:teuthology.orchestra.run.smithi121.stderr: 64950K .......... .......... .......... .......... .......... 88% 226M 0s 2019-12-09T10:04:33.771 INFO:teuthology.orchestra.run.smithi121.stderr: 65000K .......... .......... .......... .......... .......... 88% 245M 0s 2019-12-09T10:04:33.772 INFO:teuthology.orchestra.run.smithi121.stderr: 65050K .......... .......... .......... .......... .......... 88% 278M 0s 2019-12-09T10:04:33.772 INFO:teuthology.orchestra.run.smithi121.stderr: 65100K .......... .......... .......... .......... .......... 88% 316M 0s 2019-12-09T10:04:33.772 INFO:teuthology.orchestra.run.smithi121.stderr: 65150K .......... .......... .......... .......... .......... 88% 282M 0s 2019-12-09T10:04:33.772 INFO:teuthology.orchestra.run.smithi121.stderr: 65200K .......... .......... .......... .......... .......... 88% 302M 0s 2019-12-09T10:04:33.772 INFO:teuthology.orchestra.run.smithi121.stderr: 65250K .......... .......... .......... .......... .......... 88% 313M 0s 2019-12-09T10:04:33.772 INFO:teuthology.orchestra.run.smithi121.stderr: 65300K .......... .......... .......... .......... .......... 88% 314M 0s 2019-12-09T10:04:33.772 INFO:teuthology.orchestra.run.smithi121.stderr: 65350K .......... .......... .......... .......... .......... 88% 264M 0s 2019-12-09T10:04:33.773 INFO:teuthology.orchestra.run.smithi121.stderr: 65400K .......... .......... .......... .......... .......... 88% 307M 0s 2019-12-09T10:04:33.773 INFO:teuthology.orchestra.run.smithi121.stderr: 65450K .......... .......... .......... .......... .......... 89% 323M 0s 2019-12-09T10:04:33.773 INFO:teuthology.orchestra.run.smithi121.stderr: 65500K .......... .......... .......... .......... .......... 89% 321M 0s 2019-12-09T10:04:33.773 INFO:teuthology.orchestra.run.smithi121.stderr: 65550K .......... .......... .......... .......... .......... 89% 278M 0s 2019-12-09T10:04:33.773 INFO:teuthology.orchestra.run.smithi121.stderr: 65600K .......... .......... .......... .......... .......... 89% 322M 0s 2019-12-09T10:04:33.773 INFO:teuthology.orchestra.run.smithi121.stderr: 65650K .......... .......... .......... .......... .......... 89% 311M 0s 2019-12-09T10:04:33.773 INFO:teuthology.orchestra.run.smithi121.stderr: 65700K .......... .......... .......... .......... .......... 89% 320M 0s 2019-12-09T10:04:33.774 INFO:teuthology.orchestra.run.smithi121.stderr: 65750K .......... .......... .......... .......... .......... 89% 258M 0s 2019-12-09T10:04:33.774 INFO:teuthology.orchestra.run.smithi121.stderr: 65800K .......... .......... .......... .......... .......... 89% 324M 0s 2019-12-09T10:04:33.774 INFO:teuthology.orchestra.run.smithi121.stderr: 65850K .......... .......... .......... .......... .......... 89% 316M 0s 2019-12-09T10:04:33.774 INFO:teuthology.orchestra.run.smithi121.stderr: 65900K .......... .......... .......... .......... .......... 89% 315M 0s 2019-12-09T10:04:33.774 INFO:teuthology.orchestra.run.smithi121.stderr: 65950K .......... .......... .......... .......... .......... 89% 282M 0s 2019-12-09T10:04:33.774 INFO:teuthology.orchestra.run.smithi121.stderr: 66000K .......... .......... .......... .......... .......... 89% 302M 0s 2019-12-09T10:04:33.774 INFO:teuthology.orchestra.run.smithi121.stderr: 66050K .......... .......... .......... .......... .......... 89% 314M 0s 2019-12-09T10:04:33.774 INFO:teuthology.orchestra.run.smithi121.stderr: 66100K .......... .......... .......... .......... .......... 89% 314M 0s 2019-12-09T10:04:33.775 INFO:teuthology.orchestra.run.smithi121.stderr: 66150K .......... .......... .......... .......... .......... 89% 240M 0s 2019-12-09T10:04:33.775 INFO:teuthology.orchestra.run.smithi121.stderr: 66200K .......... .......... .......... .......... .......... 90% 311M 0s 2019-12-09T10:04:33.775 INFO:teuthology.orchestra.run.smithi121.stderr: 66250K .......... .......... .......... .......... .......... 90% 311M 0s 2019-12-09T10:04:33.775 INFO:teuthology.orchestra.run.smithi121.stderr: 66300K .......... .......... .......... .......... .......... 90% 308M 0s 2019-12-09T10:04:33.775 INFO:teuthology.orchestra.run.smithi121.stderr: 66350K .......... .......... .......... .......... .......... 90% 280M 0s 2019-12-09T10:04:33.775 INFO:teuthology.orchestra.run.smithi121.stderr: 66400K .......... .......... .......... .......... .......... 90% 340M 0s 2019-12-09T10:04:33.775 INFO:teuthology.orchestra.run.smithi121.stderr: 66450K .......... .......... .......... .......... .......... 90% 329M 0s 2019-12-09T10:04:33.776 INFO:teuthology.orchestra.run.smithi121.stderr: 66500K .......... .......... .......... .......... .......... 90% 390M 0s 2019-12-09T10:04:33.776 INFO:teuthology.orchestra.run.smithi121.stderr: 66550K .......... .......... .......... .......... .......... 90% 333M 0s 2019-12-09T10:04:33.776 INFO:teuthology.orchestra.run.smithi121.stderr: 66600K .......... .......... .......... .......... .......... 90% 406M 0s 2019-12-09T10:04:33.776 INFO:teuthology.orchestra.run.smithi121.stderr: 66650K .......... .......... .......... .......... .......... 90% 377M 0s 2019-12-09T10:04:33.776 INFO:teuthology.orchestra.run.smithi121.stderr: 66700K .......... .......... .......... .......... .......... 90% 380M 0s 2019-12-09T10:04:33.776 INFO:teuthology.orchestra.run.smithi121.stderr: 66750K .......... .......... .......... .......... .......... 90% 359M 0s 2019-12-09T10:04:33.776 INFO:teuthology.orchestra.run.smithi121.stderr: 66800K .......... .......... .......... .......... .......... 90% 401M 0s 2019-12-09T10:04:33.777 INFO:teuthology.orchestra.run.smithi121.stderr: 66850K .......... .......... .......... .......... .......... 90% 397M 0s 2019-12-09T10:04:33.777 INFO:teuthology.orchestra.run.smithi121.stderr: 66900K .......... .......... .......... .......... .......... 91% 416M 0s 2019-12-09T10:04:33.777 INFO:teuthology.orchestra.run.smithi121.stderr: 66950K .......... .......... .......... .......... .......... 91% 350M 0s 2019-12-09T10:04:33.777 INFO:teuthology.orchestra.run.smithi121.stderr: 67000K .......... .......... .......... .......... .......... 91% 391M 0s 2019-12-09T10:04:33.777 INFO:teuthology.orchestra.run.smithi121.stderr: 67050K .......... .......... .......... .......... .......... 91% 407M 0s 2019-12-09T10:04:33.777 INFO:teuthology.orchestra.run.smithi121.stderr: 67100K .......... .......... .......... .......... .......... 91% 388M 0s 2019-12-09T10:04:33.777 INFO:teuthology.orchestra.run.smithi121.stderr: 67150K .......... .......... .......... .......... .......... 91% 348M 0s 2019-12-09T10:04:33.778 INFO:teuthology.orchestra.run.smithi121.stderr: 67200K .......... .......... .......... .......... .......... 91% 383M 0s 2019-12-09T10:04:33.778 INFO:teuthology.orchestra.run.smithi121.stderr: 67250K .......... .......... .......... .......... .......... 91% 408M 0s 2019-12-09T10:04:33.778 INFO:teuthology.orchestra.run.smithi121.stderr: 67300K .......... .......... .......... .......... .......... 91% 409M 0s 2019-12-09T10:04:33.778 INFO:teuthology.orchestra.run.smithi121.stderr: 67350K .......... .......... .......... .......... .......... 91% 331M 0s 2019-12-09T10:04:33.778 INFO:teuthology.orchestra.run.smithi121.stderr: 67400K .......... .......... .......... .......... .......... 91% 409M 0s 2019-12-09T10:04:33.778 INFO:teuthology.orchestra.run.smithi121.stderr: 67450K .......... .......... .......... .......... .......... 91% 412M 0s 2019-12-09T10:04:33.778 INFO:teuthology.orchestra.run.smithi121.stderr: 67500K .......... .......... .......... .......... .......... 91% 406M 0s 2019-12-09T10:04:33.779 INFO:teuthology.orchestra.run.smithi121.stderr: 67550K .......... .......... .......... .......... .......... 91% 361M 0s 2019-12-09T10:04:33.779 INFO:teuthology.orchestra.run.smithi121.stderr: 67600K .......... .......... .......... .......... .......... 91% 402M 0s 2019-12-09T10:04:33.779 INFO:teuthology.orchestra.run.smithi121.stderr: 67650K .......... .......... .......... .......... .......... 92% 398M 0s 2019-12-09T10:04:33.779 INFO:teuthology.orchestra.run.smithi121.stderr: 67700K .......... .......... .......... .......... .......... 92% 420M 0s 2019-12-09T10:04:33.779 INFO:teuthology.orchestra.run.smithi121.stderr: 67750K .......... .......... .......... .......... .......... 92% 328M 0s 2019-12-09T10:04:33.779 INFO:teuthology.orchestra.run.smithi121.stderr: 67800K .......... .......... .......... .......... .......... 92% 378M 0s 2019-12-09T10:04:33.780 INFO:teuthology.orchestra.run.smithi121.stderr: 67850K .......... .......... .......... .......... .......... 92% 392M 0s 2019-12-09T10:04:33.780 INFO:teuthology.orchestra.run.smithi121.stderr: 67900K .......... .......... .......... .......... .......... 92% 402M 0s 2019-12-09T10:04:33.780 INFO:teuthology.orchestra.run.smithi121.stderr: 67950K .......... .......... .......... .......... .......... 92% 367M 0s 2019-12-09T10:04:33.780 INFO:teuthology.orchestra.run.smithi121.stderr: 68000K .......... .......... .......... .......... .......... 92% 396M 0s 2019-12-09T10:04:33.780 INFO:teuthology.orchestra.run.smithi121.stderr: 68050K .......... .......... .......... .......... .......... 92% 394M 0s 2019-12-09T10:04:33.780 INFO:teuthology.orchestra.run.smithi121.stderr: 68100K .......... .......... .......... .......... .......... 92% 399M 0s 2019-12-09T10:04:33.781 INFO:teuthology.orchestra.run.smithi121.stderr: 68150K .......... .......... .......... .......... .......... 92% 353M 0s 2019-12-09T10:04:33.781 INFO:teuthology.orchestra.run.smithi121.stderr: 68200K .......... .......... .......... .......... .......... 92% 423M 0s 2019-12-09T10:04:33.781 INFO:teuthology.orchestra.run.smithi121.stderr: 68250K .......... .......... .......... .......... .......... 92% 401M 0s 2019-12-09T10:04:33.781 INFO:teuthology.orchestra.run.smithi121.stderr: 68300K .......... .......... .......... .......... .......... 92% 388M 0s 2019-12-09T10:04:33.781 INFO:teuthology.orchestra.run.smithi121.stderr: 68350K .......... .......... .......... .......... .......... 92% 349M 0s 2019-12-09T10:04:33.781 INFO:teuthology.orchestra.run.smithi121.stderr: 68400K .......... .......... .......... .......... .......... 93% 395M 0s 2019-12-09T10:04:33.781 INFO:teuthology.orchestra.run.smithi121.stderr: 68450K .......... .......... .......... .......... .......... 93% 384M 0s 2019-12-09T10:04:33.782 INFO:teuthology.orchestra.run.smithi121.stderr: 68500K .......... .......... .......... .......... .......... 93% 418M 0s 2019-12-09T10:04:33.782 INFO:teuthology.orchestra.run.smithi121.stderr: 68550K .......... .......... .......... .......... .......... 93% 348M 0s 2019-12-09T10:04:33.782 INFO:teuthology.orchestra.run.smithi121.stderr: 68600K .......... .......... .......... .......... .......... 93% 411M 0s 2019-12-09T10:04:33.782 INFO:teuthology.orchestra.run.smithi121.stderr: 68650K .......... .......... .......... .......... .......... 93% 400M 0s 2019-12-09T10:04:33.782 INFO:teuthology.orchestra.run.smithi121.stderr: 68700K .......... .......... .......... .......... .......... 93% 413M 0s 2019-12-09T10:04:33.782 INFO:teuthology.orchestra.run.smithi121.stderr: 68750K .......... .......... .......... .......... .......... 93% 361M 0s 2019-12-09T10:04:33.782 INFO:teuthology.orchestra.run.smithi121.stderr: 68800K .......... .......... .......... .......... .......... 93% 383M 0s 2019-12-09T10:04:33.782 INFO:teuthology.orchestra.run.smithi121.stderr: 68850K .......... .......... .......... .......... .......... 93% 391M 0s 2019-12-09T10:04:33.783 INFO:teuthology.orchestra.run.smithi121.stderr: 68900K .......... .......... .......... .......... .......... 93% 415M 0s 2019-12-09T10:04:33.783 INFO:teuthology.orchestra.run.smithi121.stderr: 68950K .......... .......... .......... .......... .......... 93% 350M 0s 2019-12-09T10:04:33.783 INFO:teuthology.orchestra.run.smithi121.stderr: 69000K .......... .......... .......... .......... .......... 93% 417M 0s 2019-12-09T10:04:33.783 INFO:teuthology.orchestra.run.smithi121.stderr: 69050K .......... .......... .......... .......... .......... 93% 410M 0s 2019-12-09T10:04:33.783 INFO:teuthology.orchestra.run.smithi121.stderr: 69100K .......... .......... .......... .......... .......... 94% 406M 0s 2019-12-09T10:04:33.783 INFO:teuthology.orchestra.run.smithi121.stderr: 69150K .......... .......... .......... .......... .......... 94% 362M 0s 2019-12-09T10:04:33.783 INFO:teuthology.orchestra.run.smithi121.stderr: 69200K .......... .......... .......... .......... .......... 94% 420M 0s 2019-12-09T10:04:33.784 INFO:teuthology.orchestra.run.smithi121.stderr: 69250K .......... .......... .......... .......... .......... 94% 395M 0s 2019-12-09T10:04:33.784 INFO:teuthology.orchestra.run.smithi121.stderr: 69300K .......... .......... .......... .......... .......... 94% 425M 0s 2019-12-09T10:04:33.784 INFO:teuthology.orchestra.run.smithi121.stderr: 69350K .......... .......... .......... .......... .......... 94% 344M 0s 2019-12-09T10:04:33.784 INFO:teuthology.orchestra.run.smithi121.stderr: 69400K .......... .......... .......... .......... .......... 94% 419M 0s 2019-12-09T10:04:33.784 INFO:teuthology.orchestra.run.smithi121.stderr: 69450K .......... .......... .......... .......... .......... 94% 430M 0s 2019-12-09T10:04:33.784 INFO:teuthology.orchestra.run.smithi121.stderr: 69500K .......... .......... .......... .......... .......... 94% 418M 0s 2019-12-09T10:04:33.784 INFO:teuthology.orchestra.run.smithi121.stderr: 69550K .......... .......... .......... .......... .......... 94% 375M 0s 2019-12-09T10:04:33.785 INFO:teuthology.orchestra.run.smithi121.stderr: 69600K .......... .......... .......... .......... .......... 94% 407M 0s 2019-12-09T10:04:33.785 INFO:teuthology.orchestra.run.smithi121.stderr: 69650K .......... .......... .......... .......... .......... 94% 405M 0s 2019-12-09T10:04:33.785 INFO:teuthology.orchestra.run.smithi121.stderr: 69700K .......... .......... .......... .......... .......... 94% 422M 0s 2019-12-09T10:04:33.785 INFO:teuthology.orchestra.run.smithi121.stderr: 69750K .......... .......... .......... .......... .......... 94% 345M 0s 2019-12-09T10:04:33.785 INFO:teuthology.orchestra.run.smithi121.stderr: 69800K .......... .......... .......... .......... .......... 94% 407M 0s 2019-12-09T10:04:33.785 INFO:teuthology.orchestra.run.smithi121.stderr: 69850K .......... .......... .......... .......... .......... 95% 400M 0s 2019-12-09T10:04:33.785 INFO:teuthology.orchestra.run.smithi121.stderr: 69900K .......... .......... .......... .......... .......... 95% 421M 0s 2019-12-09T10:04:33.786 INFO:teuthology.orchestra.run.smithi121.stderr: 69950K .......... .......... .......... .......... .......... 95% 360M 0s 2019-12-09T10:04:33.786 INFO:teuthology.orchestra.run.smithi121.stderr: 70000K .......... .......... .......... .......... .......... 95% 385M 0s 2019-12-09T10:04:33.786 INFO:teuthology.orchestra.run.smithi121.stderr: 70050K .......... .......... .......... .......... .......... 95% 393M 0s 2019-12-09T10:04:33.786 INFO:teuthology.orchestra.run.smithi121.stderr: 70100K .......... .......... .......... .......... .......... 95% 406M 0s 2019-12-09T10:04:33.786 INFO:teuthology.orchestra.run.smithi121.stderr: 70150K .......... .......... .......... .......... .......... 95% 346M 0s 2019-12-09T10:04:33.786 INFO:teuthology.orchestra.run.smithi121.stderr: 70200K .......... .......... .......... .......... .......... 95% 411M 0s 2019-12-09T10:04:33.786 INFO:teuthology.orchestra.run.smithi121.stderr: 70250K .......... .......... .......... .......... .......... 95% 402M 0s 2019-12-09T10:04:33.787 INFO:teuthology.orchestra.run.smithi121.stderr: 70300K .......... .......... .......... .......... .......... 95% 424M 0s 2019-12-09T10:04:33.787 INFO:teuthology.orchestra.run.smithi121.stderr: 70350K .......... .......... .......... .......... .......... 95% 361M 0s 2019-12-09T10:04:33.787 INFO:teuthology.orchestra.run.smithi121.stderr: 70400K .......... .......... .......... .......... .......... 95% 431M 0s 2019-12-09T10:04:33.787 INFO:teuthology.orchestra.run.smithi121.stderr: 70450K .......... .......... .......... .......... .......... 95% 413M 0s 2019-12-09T10:04:33.787 INFO:teuthology.orchestra.run.smithi121.stderr: 70500K .......... .......... .......... .......... .......... 95% 194M 0s 2019-12-09T10:04:33.787 INFO:teuthology.orchestra.run.smithi121.stderr: 70550K .......... .......... .......... .......... .......... 95% 187M 0s 2019-12-09T10:04:33.787 INFO:teuthology.orchestra.run.smithi121.stderr: 70600K .......... .......... .......... .......... .......... 96% 213M 0s 2019-12-09T10:04:33.788 INFO:teuthology.orchestra.run.smithi121.stderr: 70650K .......... .......... .......... .......... .......... 96% 283M 0s 2019-12-09T10:04:33.788 INFO:teuthology.orchestra.run.smithi121.stderr: 70700K .......... .......... .......... .......... .......... 96% 270M 0s 2019-12-09T10:04:33.788 INFO:teuthology.orchestra.run.smithi121.stderr: 70750K .......... .......... .......... .......... .......... 96% 251M 0s 2019-12-09T10:04:33.788 INFO:teuthology.orchestra.run.smithi121.stderr: 70800K .......... .......... .......... .......... .......... 96% 284M 0s 2019-12-09T10:04:33.788 INFO:teuthology.orchestra.run.smithi121.stderr: 70850K .......... .......... .......... .......... .......... 96% 275M 0s 2019-12-09T10:04:33.788 INFO:teuthology.orchestra.run.smithi121.stderr: 70900K .......... .......... .......... .......... .......... 96% 278M 0s 2019-12-09T10:04:33.788 INFO:teuthology.orchestra.run.smithi121.stderr: 70950K .......... .......... .......... .......... .......... 96% 233M 0s 2019-12-09T10:04:33.789 INFO:teuthology.orchestra.run.smithi121.stderr: 71000K .......... .......... .......... .......... .......... 96% 264M 0s 2019-12-09T10:04:33.789 INFO:teuthology.orchestra.run.smithi121.stderr: 71050K .......... .......... .......... .......... .......... 96% 272M 0s 2019-12-09T10:04:33.789 INFO:teuthology.orchestra.run.smithi121.stderr: 71100K .......... .......... .......... .......... .......... 96% 270M 0s 2019-12-09T10:04:33.789 INFO:teuthology.orchestra.run.smithi121.stderr: 71150K .......... .......... .......... .......... .......... 96% 252M 0s 2019-12-09T10:04:33.789 INFO:teuthology.orchestra.run.smithi121.stderr: 71200K .......... .......... .......... .......... .......... 96% 281M 0s 2019-12-09T10:04:33.789 INFO:teuthology.orchestra.run.smithi121.stderr: 71250K .......... .......... .......... .......... .......... 96% 281M 0s 2019-12-09T10:04:33.789 INFO:teuthology.orchestra.run.smithi121.stderr: 71300K .......... .......... .......... .......... .......... 96% 270M 0s 2019-12-09T10:04:33.790 INFO:teuthology.orchestra.run.smithi121.stderr: 71350K .......... .......... .......... .......... .......... 97% 226M 0s 2019-12-09T10:04:33.790 INFO:teuthology.orchestra.run.smithi121.stderr: 71400K .......... .......... .......... .......... .......... 97% 269M 0s 2019-12-09T10:04:33.790 INFO:teuthology.orchestra.run.smithi121.stderr: 71450K .......... .......... .......... .......... .......... 97% 286M 0s 2019-12-09T10:04:33.790 INFO:teuthology.orchestra.run.smithi121.stderr: 71500K .......... .......... .......... .......... .......... 97% 273M 0s 2019-12-09T10:04:33.790 INFO:teuthology.orchestra.run.smithi121.stderr: 71550K .......... .......... .......... .......... .......... 97% 250M 0s 2019-12-09T10:04:33.790 INFO:teuthology.orchestra.run.smithi121.stderr: 71600K .......... .......... .......... .......... .......... 97% 272M 0s 2019-12-09T10:04:33.790 INFO:teuthology.orchestra.run.smithi121.stderr: 71650K .......... .......... .......... .......... .......... 97% 271M 0s 2019-12-09T10:04:33.791 INFO:teuthology.orchestra.run.smithi121.stderr: 71700K .......... .......... .......... .......... .......... 97% 274M 0s 2019-12-09T10:04:33.791 INFO:teuthology.orchestra.run.smithi121.stderr: 71750K .......... .......... .......... .......... .......... 97% 225M 0s 2019-12-09T10:04:33.791 INFO:teuthology.orchestra.run.smithi121.stderr: 71800K .......... .......... .......... .......... .......... 97% 276M 0s 2019-12-09T10:04:33.791 INFO:teuthology.orchestra.run.smithi121.stderr: 71850K .......... .......... .......... .......... .......... 97% 278M 0s 2019-12-09T10:04:33.791 INFO:teuthology.orchestra.run.smithi121.stderr: 71900K .......... .......... .......... .......... .......... 97% 287M 0s 2019-12-09T10:04:33.791 INFO:teuthology.orchestra.run.smithi121.stderr: 71950K .......... .......... .......... .......... .......... 97% 250M 0s 2019-12-09T10:04:33.791 INFO:teuthology.orchestra.run.smithi121.stderr: 72000K .......... .......... .......... .......... .......... 97% 269M 0s 2019-12-09T10:04:33.792 INFO:teuthology.orchestra.run.smithi121.stderr: 72050K .......... .......... .......... .......... .......... 98% 274M 0s 2019-12-09T10:04:33.792 INFO:teuthology.orchestra.run.smithi121.stderr: 72100K .......... .......... .......... .......... .......... 98% 269M 0s 2019-12-09T10:04:33.792 INFO:teuthology.orchestra.run.smithi121.stderr: 72150K .......... .......... .......... .......... .......... 98% 227M 0s 2019-12-09T10:04:33.792 INFO:teuthology.orchestra.run.smithi121.stderr: 72200K .......... .......... .......... .......... .......... 98% 287M 0s 2019-12-09T10:04:33.792 INFO:teuthology.orchestra.run.smithi121.stderr: 72250K .......... .......... .......... .......... .......... 98% 271M 0s 2019-12-09T10:04:33.792 INFO:teuthology.orchestra.run.smithi121.stderr: 72300K .......... .......... .......... .......... .......... 98% 277M 0s 2019-12-09T10:04:33.792 INFO:teuthology.orchestra.run.smithi121.stderr: 72350K .......... .......... .......... .......... .......... 98% 245M 0s 2019-12-09T10:04:33.793 INFO:teuthology.orchestra.run.smithi121.stderr: 72400K .......... .......... .......... .......... .......... 98% 279M 0s 2019-12-09T10:04:33.793 INFO:teuthology.orchestra.run.smithi121.stderr: 72450K .......... .......... .......... .......... .......... 98% 278M 0s 2019-12-09T10:04:33.793 INFO:teuthology.orchestra.run.smithi121.stderr: 72500K .......... .......... .......... .......... .......... 98% 273M 0s 2019-12-09T10:04:33.793 INFO:teuthology.orchestra.run.smithi121.stderr: 72550K .......... .......... .......... .......... .......... 98% 240M 0s 2019-12-09T10:04:33.793 INFO:teuthology.orchestra.run.smithi121.stderr: 72600K .......... .......... .......... .......... .......... 98% 277M 0s 2019-12-09T10:04:33.793 INFO:teuthology.orchestra.run.smithi121.stderr: 72650K .......... .......... .......... .......... .......... 98% 287M 0s 2019-12-09T10:04:33.793 INFO:teuthology.orchestra.run.smithi121.stderr: 72700K .......... .......... .......... .......... .......... 98% 287M 0s 2019-12-09T10:04:33.794 INFO:teuthology.orchestra.run.smithi121.stderr: 72750K .......... .......... .......... .......... .......... 98% 254M 0s 2019-12-09T10:04:33.794 INFO:teuthology.orchestra.run.smithi121.stderr: 72800K .......... .......... .......... .......... .......... 99% 286M 0s 2019-12-09T10:04:33.794 INFO:teuthology.orchestra.run.smithi121.stderr: 72850K .......... .......... .......... .......... .......... 99% 281M 0s 2019-12-09T10:04:33.794 INFO:teuthology.orchestra.run.smithi121.stderr: 72900K .......... .......... .......... .......... .......... 99% 289M 0s 2019-12-09T10:04:33.794 INFO:teuthology.orchestra.run.smithi121.stderr: 72950K .......... .......... .......... .......... .......... 99% 240M 0s 2019-12-09T10:04:33.794 INFO:teuthology.orchestra.run.smithi121.stderr: 73000K .......... .......... .......... .......... .......... 99% 291M 0s 2019-12-09T10:04:33.794 INFO:teuthology.orchestra.run.smithi121.stderr: 73050K .......... .......... .......... .......... .......... 99% 293M 0s 2019-12-09T10:04:33.795 INFO:teuthology.orchestra.run.smithi121.stderr: 73100K .......... .......... .......... .......... .......... 99% 293M 0s 2019-12-09T10:04:33.795 INFO:teuthology.orchestra.run.smithi121.stderr: 73150K .......... .......... .......... .......... .......... 99% 247M 0s 2019-12-09T10:04:33.795 INFO:teuthology.orchestra.run.smithi121.stderr: 73200K .......... .......... .......... .......... .......... 99% 286M 0s 2019-12-09T10:04:33.795 INFO:teuthology.orchestra.run.smithi121.stderr: 73250K .......... .......... .......... .......... .......... 99% 287M 0s 2019-12-09T10:04:33.795 INFO:teuthology.orchestra.run.smithi121.stderr: 73300K .......... .......... .......... .......... .......... 99% 289M 0s 2019-12-09T10:04:33.795 INFO:teuthology.orchestra.run.smithi121.stderr: 73350K .......... .......... .......... .......... .......... 99% 243M 0s 2019-12-09T10:04:33.795 INFO:teuthology.orchestra.run.smithi121.stderr: 73400K .......... .......... .......... .......... .......... 99% 288M 0s 2019-12-09T10:04:33.795 INFO:teuthology.orchestra.run.smithi121.stderr: 73450K .......... .......... .......... .......... .......... 99% 286M 0s 2019-12-09T10:04:33.796 INFO:teuthology.orchestra.run.smithi121.stderr: 73500K .......... .......... .......... .......... .......... 99% 292M 0s 2019-12-09T10:04:33.796 INFO:teuthology.orchestra.run.smithi121.stderr: 73550K ........ 100% 345M=0.3s 2019-12-09T10:04:33.796 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T10:04:33.796 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09 10:04:32 (256 MB/s) - ‘gradle-4.7-bin.zip’ saved [75323957/75323957] 2019-12-09T10:04:33.796 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T10:04:33.796 INFO:teuthology.orchestra.run.smithi121.stdout:Archive: gradle-4.7-bin.zip 2019-12-09T10:04:33.797 INFO:teuthology.orchestra.run.smithi121.stdout: creating: /opt/gradle/gradle-4.7/ 2019-12-09T10:04:33.797 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/getting-started.html 2019-12-09T10:04:33.797 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/LICENSE 2019-12-09T10:04:33.797 INFO:teuthology.orchestra.run.smithi121.stdout: creating: /opt/gradle/gradle-4.7/media/ 2019-12-09T10:04:33.797 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-64x64.png 2019-12-09T10:04:33.797 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-48x48.png 2019-12-09T10:04:33.798 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle.icns 2019-12-09T10:04:33.798 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-24x24.png 2019-12-09T10:04:33.798 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-256x256.png 2019-12-09T10:04:33.798 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-512x512.png 2019-12-09T10:04:33.798 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-16x16.png 2019-12-09T10:04:33.798 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-32x32.png 2019-12-09T10:04:33.798 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-128x128.png 2019-12-09T10:04:33.798 INFO:teuthology.orchestra.run.smithi121.stdout: creating: /opt/gradle/gradle-4.7/init.d/ 2019-12-09T10:04:33.799 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/init.d/readme.txt 2019-12-09T10:04:33.799 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/NOTICE 2019-12-09T10:04:33.799 INFO:teuthology.orchestra.run.smithi121.stdout: creating: /opt/gradle/gradle-4.7/bin/ 2019-12-09T10:04:33.799 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle.bat 2019-12-09T10:04:33.799 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle 2019-12-09T10:04:33.799 INFO:teuthology.orchestra.run.smithi121.stdout: creating: /opt/gradle/gradle-4.7/lib/ 2019-12-09T10:04:33.799 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/annotations-13.0.jar 2019-12-09T10:04:33.800 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-0.16.3.jar 2019-12-09T10:04:33.800 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-builders-0.16.3.jar 2019-12-09T10:04:33.800 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-models-0.16.3.jar 2019-12-09T10:04:33.800 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-compiler-embeddable-1.2.31.jar 2019-12-09T10:04:33.800 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-reflect-1.2.31.jar 2019-12-09T10:04:33.800 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-sam-with-receiver-compiler-plugin-1.2.31.jar 2019-12-09T10:04:33.800 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-script-runtime-1.2.31.jar 2019-12-09T10:04:33.801 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-1.2.31.jar 2019-12-09T10:04:33.801 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk7-1.2.31.jar 2019-12-09T10:04:33.801 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk8-1.2.31.jar 2019-12-09T10:04:33.801 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-launcher-4.7.jar 2019-12-09T10:04:33.801 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-runtime-api-info-4.7.jar 2019-12-09T10:04:33.801 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-tooling-api-4.7.jar 2019-12-09T10:04:33.801 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-wrapper-4.7.jar 2019-12-09T10:04:33.802 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-installation-beacon-4.7.jar 2019-12-09T10:04:33.802 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-4.7.jar 2019-12-09T10:04:33.802 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-jvm-services-4.7.jar 2019-12-09T10:04:33.802 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-api-4.7.jar 2019-12-09T10:04:33.802 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-cache-4.7.jar 2019-12-09T10:04:33.802 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-logging-4.7.jar 2019-12-09T10:04:33.802 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-process-services-4.7.jar 2019-12-09T10:04:33.803 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-resources-4.7.jar 2019-12-09T10:04:33.803 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-persistent-cache-4.7.jar 2019-12-09T10:04:33.803 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-native-4.7.jar 2019-12-09T10:04:33.803 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-groovy-4.7.jar 2019-12-09T10:04:33.803 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-core-4.7.jar 2019-12-09T10:04:33.803 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-groovy-4.7.jar 2019-12-09T10:04:33.803 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-messaging-4.7.jar 2019-12-09T10:04:33.804 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-4.7.jar 2019-12-09T10:04:33.804 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-option-4.7.jar 2019-12-09T10:04:33.804 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-cli-4.7.jar 2019-12-09T10:04:33.804 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-docs-4.7.jar 2019-12-09T10:04:33.804 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-commons-6.1.1.jar 2019-12-09T10:04:33.804 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-analysis-6.1.1.jar 2019-12-09T10:04:33.804 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-tree-6.1.1.jar 2019-12-09T10:04:33.805 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/kryo-2.20.jar 2019-12-09T10:04:33.805 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/reflectasm-1.07-shaded.jar 2019-12-09T10:04:33.805 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-6.1.1.jar 2019-12-09T10:04:33.805 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-io-2.4.jar 2019-12-09T10:04:33.805 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcl-over-slf4j-1.7.16.jar 2019-12-09T10:04:33.805 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/jul-to-slf4j-1.7.16.jar 2019-12-09T10:04:33.805 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/log4j-over-slf4j-1.7.16.jar 2019-12-09T10:04:33.806 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/slf4j-api-1.7.16.jar 2019-12-09T10:04:33.806 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/guava-jdk5-17.0.jar 2019-12-09T10:04:33.806 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/jsr305-2.0.1.jar 2019-12-09T10:04:33.806 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/fastutil-7.2.1-min.jar 2019-12-09T10:04:33.806 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-lang-2.6.jar 2019-12-09T10:04:33.806 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcip-annotations-1.0.jar 2019-12-09T10:04:33.806 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/groovy-all-2.4.12.jar 2019-12-09T10:04:33.807 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-1.9.9.jar 2019-12-09T10:04:33.807 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/javax.inject-1.jar 2019-12-09T10:04:33.807 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-collections-3.2.2.jar 2019-12-09T10:04:33.807 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-0.14.jar 2019-12-09T10:04:33.807 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-compress-1.14.jar 2019-12-09T10:04:33.807 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/xml-apis-1.4.01.jar 2019-12-09T10:04:33.807 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/jansi-1.14.jar 2019-12-09T10:04:33.808 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-launcher-1.9.9.jar 2019-12-09T10:04:33.808 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libcpp-0.14.jar 2019-12-09T10:04:33.808 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libstdcpp-0.14.jar 2019-12-09T10:04:33.808 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libcpp-0.14.jar 2019-12-09T10:04:33.808 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libstdcpp-0.14.jar 2019-12-09T10:04:33.808 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-0.14.jar 2019-12-09T10:04:33.808 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-0.14.jar 2019-12-09T10:04:33.809 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-amd64-0.14.jar 2019-12-09T10:04:33.809 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-i386-0.14.jar 2019-12-09T10:04:33.809 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-amd64-0.14.jar 2019-12-09T10:04:33.809 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-i386-0.14.jar 2019-12-09T10:04:33.809 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses5-0.14.jar 2019-12-09T10:04:33.809 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses6-0.14.jar 2019-12-09T10:04:33.809 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses5-0.14.jar 2019-12-09T10:04:33.810 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses6-0.14.jar 2019-12-09T10:04:33.810 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/minlog-1.2.jar 2019-12-09T10:04:33.810 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/objenesis-1.2.jar 2019-12-09T10:04:33.810 INFO:teuthology.orchestra.run.smithi121.stdout: creating: /opt/gradle/gradle-4.7/lib/plugins/ 2019-12-09T10:04:33.810 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-announce-4.7.jar 2019-12-09T10:04:33.810 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-antlr-4.7.jar 2019-12-09T10:04:33.810 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-code-quality-4.7.jar 2019-12-09T10:04:33.810 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-osgi-4.7.jar 2019-12-09T10:04:33.811 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-signing-4.7.jar 2019-12-09T10:04:33.811 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-native-4.7.jar 2019-12-09T10:04:33.811 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-native-4.7.jar 2019-12-09T10:04:33.811 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-native-4.7.jar 2019-12-09T10:04:33.811 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-development-4.7.jar 2019-12-09T10:04:33.811 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-maven-4.7.jar 2019-12-09T10:04:33.811 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-play-4.7.jar 2019-12-09T10:04:33.812 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-4.7.jar 2019-12-09T10:04:33.812 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-scala-4.7.jar 2019-12-09T10:04:33.812 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-comparison-4.7.jar 2019-12-09T10:04:33.812 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ear-4.7.jar 2019-12-09T10:04:33.812 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-play-4.7.jar 2019-12-09T10:04:33.812 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-javascript-4.7.jar 2019-12-09T10:04:33.812 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ivy-4.7.jar 2019-12-09T10:04:33.813 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-jacoco-4.7.jar 2019-12-09T10:04:33.813 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-init-4.7.jar 2019-12-09T10:04:33.813 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugins-4.7.jar 2019-12-09T10:04:33.813 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-tooling-api-builders-4.7.jar 2019-12-09T10:04:33.813 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-test-kit-4.7.jar 2019-12-09T10:04:33.813 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-composite-builds-4.7.jar 2019-12-09T10:04:33.813 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-groovy-4.7.jar 2019-12-09T10:04:33.814 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-scala-4.7.jar 2019-12-09T10:04:33.814 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-junit-platform-4.7.jar 2019-12-09T10:04:33.814 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-jvm-4.7.jar 2019-12-09T10:04:33.814 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-java-4.7.jar 2019-12-09T10:04:33.814 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-jvm-4.7.jar 2019-12-09T10:04:33.814 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-jvm-4.7.jar 2019-12-09T10:04:33.814 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-native-4.7.jar 2019-12-09T10:04:33.815 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-diagnostics-4.7.jar 2019-12-09T10:04:33.815 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-base-4.7.jar 2019-12-09T10:04:33.815 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-reporting-4.7.jar 2019-12-09T10:04:33.815 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-publish-4.7.jar 2019-12-09T10:04:33.815 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-base-4.7.jar 2019-12-09T10:04:33.815 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-use-4.7.jar 2019-12-09T10:04:33.815 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-s3-4.7.jar 2019-12-09T10:04:33.816 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-gcs-4.7.jar 2019-12-09T10:04:33.816 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-cache-http-4.7.jar 2019-12-09T10:04:33.816 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-dependency-management-4.7.jar 2019-12-09T10:04:33.816 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-http-4.7.jar 2019-12-09T10:04:33.816 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-sftp-4.7.jar 2019-12-09T10:04:33.816 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-workers-4.7.jar 2019-12-09T10:04:33.816 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-version-control-4.7.jar 2019-12-09T10:04:33.817 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-s3-1.11.267.jar 2019-12-09T10:04:33.817 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-kms-1.11.267.jar 2019-12-09T10:04:33.817 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-core-1.11.267.jar 2019-12-09T10:04:33.817 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/org.eclipse.jgit-4.5.3.201708160445-r.jar 2019-12-09T10:04:33.817 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-2.4.jar 2019-12-09T10:04:33.817 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-shared4-2.4.jar 2019-12-09T10:04:33.817 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-services-storage-v1-rev116-1.23.0.jar 2019-12-09T10:04:33.818 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-client-1.23.0.jar 2019-12-09T10:04:33.818 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-oauth-client-1.23.0.jar 2019-12-09T10:04:33.818 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-jackson2-1.23.0.jar 2019-12-09T10:04:33.818 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-1.23.0.jar 2019-12-09T10:04:33.818 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpclient-4.5.5.jar 2019-12-09T10:04:33.818 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-codec-1.10.jar 2019-12-09T10:04:33.818 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-container-default-1.5.5.jar 2019-12-09T10:04:33.819 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xbean-reflect-3.4.jar 2019-12-09T10:04:33.819 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/asm-util-6.1.1.jar 2019-12-09T10:04:33.819 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jatl-0.2.2.jar 2019-12-09T10:04:33.819 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-cli-1.2.jar 2019-12-09T10:04:33.819 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/biz.aQute.bndlib-3.4.0.jar 2019-12-09T10:04:33.819 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ivy-2.2.0.jar 2019-12-09T10:04:33.819 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-compat-3.0.4.jar 2019-12-09T10:04:33.820 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-core-3.0.4.jar 2019-12-09T10:04:33.820 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-common-0.8-20100325.jar 2019-12-09T10:04:33.820 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-groovy-0.8-20100325.jar 2019-12-09T10:04:33.820 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-file-2.4.jar 2019-12-09T10:04:33.820 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-connector-wagon-1.13.1.jar 2019-12-09T10:04:33.820 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcpg-jdk15on-1.58.jar 2019-12-09T10:04:33.820 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/rhino-1.7R3.jar 2019-12-09T10:04:33.821 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gson-2.7.jar 2019-12-09T10:04:33.821 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/simple-4.1.21.jar 2019-12-09T10:04:33.821 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-plugin-api-3.0.4.jar 2019-12-09T10:04:33.821 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/testng-6.3.1.jar 2019-12-09T10:04:33.821 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/snakeyaml-1.6.jar 2019-12-09T10:04:33.821 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/dd-plist-1.20.jar 2019-12-09T10:04:33.821 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-4.12.jar 2019-12-09T10:04:33.822 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bsh-2.0b6.jar 2019-12-09T10:04:33.822 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-launcher-1.0.3.jar 2019-12-09T10:04:33.822 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcifs-1.3.17.jar 2019-12-09T10:04:33.822 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/nekohtml-1.9.20.jar 2019-12-09T10:04:33.822 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xercesImpl-2.11.0.jar 2019-12-09T10:04:33.822 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jsch-0.1.54.jar 2019-12-09T10:04:33.822 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jmespath-java-1.11.267.jar 2019-12-09T10:04:33.823 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-databind-2.8.11.jar 2019-12-09T10:04:33.823 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-core-2.8.11.jar 2019-12-09T10:04:33.823 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-annotations-2.8.11.jar 2019-12-09T10:04:33.823 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/joda-time-2.8.2.jar 2019-12-09T10:04:33.823 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcprov-jdk15on-1.58.jar 2019-12-09T10:04:33.823 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-aether-provider-3.0.4.jar 2019-12-09T10:04:33.823 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-impl-1.13.1.jar 2019-12-09T10:04:33.824 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-spi-1.13.1.jar 2019-12-09T10:04:33.824 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-util-1.13.1.jar 2019-12-09T10:04:33.824 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-api-1.13.1.jar 2019-12-09T10:04:33.824 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-provider-api-2.4.jar 2019-12-09T10:04:33.824 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-classworlds-2.4.jar 2019-12-09T10:04:33.824 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-builder-3.0.4.jar 2019-12-09T10:04:33.824 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-3.0.4.jar 2019-12-09T10:04:33.825 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-builder-3.0.4.jar 2019-12-09T10:04:33.825 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-artifact-3.0.4.jar 2019-12-09T10:04:33.825 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-3.0.4.jar 2019-12-09T10:04:33.825 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-sec-dispatcher-1.3.jar 2019-12-09T10:04:33.825 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-repository-metadata-3.0.4.jar 2019-12-09T10:04:33.825 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-utils-3.0.8.jar 2019-12-09T10:04:33.825 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ion-java-1.0.2.jar 2019-12-09T10:04:33.825 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpcore-4.4.9.jar 2019-12-09T10:04:33.826 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/hamcrest-core-1.3.jar 2019-12-09T10:04:33.826 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-engine-1.0.3.jar 2019-12-09T10:04:33.826 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-commons-1.0.3.jar 2019-12-09T10:04:33.826 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/apiguardian-api-1.0.0.jar 2019-12-09T10:04:33.826 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcommander-1.47.jar 2019-12-09T10:04:33.826 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-interpolation-1.14.jar 2019-12-09T10:04:33.826 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-component-annotations-1.5.5.jar 2019-12-09T10:04:33.827 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/opentest4j-1.0.0.jar 2019-12-09T10:04:33.827 INFO:teuthology.orchestra.run.smithi121.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-cipher-1.7.jar 2019-12-09T10:04:33.827 INFO:teuthology.orchestra.run.smithi121.stdout:export PATH=/opt/gradle/gradle-4.7/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin 2019-12-09T10:04:34.387 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:04:34.387 INFO:teuthology.orchestra.run.smithi121.stdout:Welcome to Gradle 4.7! 2019-12-09T10:04:34.387 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:04:34.388 INFO:teuthology.orchestra.run.smithi121.stdout:Here are the highlights of this release: 2019-12-09T10:04:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: - Incremental annotation processing 2019-12-09T10:04:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: - JDK 10 support 2019-12-09T10:04:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: - Grouped non-interactive console logs 2019-12-09T10:04:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: - Failed tests are re-run first for quicker feedback 2019-12-09T10:04:34.389 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:04:34.389 INFO:teuthology.orchestra.run.smithi121.stdout:For more details see https://docs.gradle.org/4.7/release-notes.html 2019-12-09T10:04:34.389 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:04:34.645 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:04:34.645 INFO:teuthology.orchestra.run.smithi121.stdout:------------------------------------------------------------ 2019-12-09T10:04:34.645 INFO:teuthology.orchestra.run.smithi121.stdout:Gradle 4.7 2019-12-09T10:04:34.645 INFO:teuthology.orchestra.run.smithi121.stdout:------------------------------------------------------------ 2019-12-09T10:04:34.645 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:04:34.645 INFO:teuthology.orchestra.run.smithi121.stdout:Build time: 2018-04-18 09:09:12 UTC 2019-12-09T10:04:34.646 INFO:teuthology.orchestra.run.smithi121.stdout:Revision: b9a962bf70638332300e7f810689cb2febbd4a6c 2019-12-09T10:04:34.646 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:04:34.646 INFO:teuthology.orchestra.run.smithi121.stdout:Groovy: 2.4.12 2019-12-09T10:04:34.646 INFO:teuthology.orchestra.run.smithi121.stdout:Ant: Apache Ant(TM) version 1.9.9 compiled on February 2 2017 2019-12-09T10:04:34.646 INFO:teuthology.orchestra.run.smithi121.stdout:JVM: 1.8.0_232 (Oracle Corporation 25.232-b09) 2019-12-09T10:04:34.646 INFO:teuthology.orchestra.run.smithi121.stdout:OS: Linux 3.10.0-1062.9.1.el7.x86_64 amd64 2019-12-09T10:04:34.646 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:04:34.672 INFO:teuthology.orchestra.run.smithi121:> sudo keytool -import -alias smithi121.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2019-12-09T10:04:35.106 INFO:teuthology.orchestra.run.smithi121.stderr:Certificate was added to keystore 2019-12-09T10:04:35.127 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2019-12-09T10:04:35.127 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-12-09T10:04:35.127 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi121.front.sepia.ceph.com 2019-12-09T10:04:35.127 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-12-09T10:04:35.127 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi132.front.sepia.ceph.com 2019-12-09T10:04:35.127 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2019-12-09T10:04:35.535 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 's3dir': 'folder', 'endpoint': None, 'display_name': None, 'region': 'mexico', 'port': None, 'access_secret': None, 'SSE': 'AES256', 'is_secure': None, 'email': None, 'dir': '../data'}} 2019-12-09T10:04:35.536 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2019-12-09T10:04:35.536 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'HMBSDRQSWDHQYYCSTRZO', 's3dir': 'folder', 'endpoint': 'smithi121.front.sepia.ceph.com:443', 'display_name': 'Ms. tester.client.0', 'user_id': 'tester.client.0', 'region': 'mexico', 'port': 443, 'access_secret': 'sGqbDpgRlXMLya9Ixh4H9ccDgay0k55Lfv913AyFNS/FMCQ8A+QQzQ==', 'host': 'smithi121.front.sepia.ceph.com', 'SSE': 'AES256', 'is_secure': True, 'email': 'tester.client.0_test@test.test', 'dir': '../data'} 2019-12-09T10:04:35.536 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2019-12-09T10:04:35.537 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'HMBSDRQSWDHQYYCSTRZO', '--secret', 'sGqbDpgRlXMLya9Ixh4H9ccDgay0k55Lfv913AyFNS/FMCQ8A+QQzQ==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2019-12-09T10:04:35.537 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key HMBSDRQSWDHQYYCSTRZO --secret sGqbDpgRlXMLya9Ixh4H9ccDgay0k55Lfv913AyFNS/FMCQ8A+QQzQ== --email tester.client.0_test@test.test --cluster ceph 2019-12-09T10:04:35.664 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.678+0000 7f1ede0c7ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:35.695 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.709+0000 7f1ede0c7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:35.695 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.709+0000 7f1ede0c7ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:35.703 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.717+0000 7f1ede0c7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:35.704 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.717+0000 7f1ede0c7ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:35.720 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.734+0000 7f1ede0c7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:35.720 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.734+0000 7f1ede0c7ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:35.742 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.756+0000 7f1ede0c7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:04:35.930 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.943+0000 7f1ede0c7ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T10:04:35.930 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.943+0000 7f1ede0c7ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T10:04:35.930 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.943+0000 7f1ede0c7ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T10:04:35.930 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.943+0000 7f1ede0c7ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T10:04:35.930 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.943+0000 7f1ede0c7ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:35.937 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.951+0000 7f1ede0c7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:04:35.937 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.951+0000 7f1ede0c7ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:35.947 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.960+0000 7f1ede0c7ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:04:35.947 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.960+0000 7f1ede0c7ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.972+0000 7f1ede0c7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:04:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.972+0000 7f1ede0c7ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.986+0000 7f1ede0c7ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:04:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.986+0000 7f1ede0c7ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:35.977 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.991+0000 7f1ede0c7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:35.977 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.991+0000 7f1ede0c7ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T10:04:35.978 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.991+0000 7f1ede0c7ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:35.983 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.997+0000 7f1ede0c7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:35.983 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:35.997+0000 7f1ede0c7ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:35.991 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.005+0000 7f1ede0c7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:04:35.992 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.005+0000 7f1ede0c7ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:36.011 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.025+0000 7f1ede0c7ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:04:36.012 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.025+0000 7f1ede0c7ec0 20 zonegroup default 2019-12-09T10:04:36.012 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.025+0000 7f1ede0c7ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:36.017 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.031+0000 7f1ede0c7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:36.017 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.031+0000 7f1ede0c7ec0 10 Cannot find current period zone using local zone 2019-12-09T10:04:36.017 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.031+0000 7f1ede0c7ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:36.022 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.036+0000 7f1ede0c7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:36.022 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.036+0000 7f1ede0c7ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:36.030 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.044+0000 7f1ede0c7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:04:36.030 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.044+0000 7f1ede0c7ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:36.040 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.054+0000 7f1ede0c7ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:04:36.040 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.054+0000 7f1ede0c7ec0 20 zone default found 2019-12-09T10:04:36.041 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.054+0000 7f1ede0c7ec0 20 started sync module instance, tier type = 2019-12-09T10:04:36.041 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.054+0000 7f1ede0c7ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T10:04:36.389 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.402+0000 7f1ede0c7ec0 20 add_watcher() i=0 2019-12-09T10:04:36.389 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.402+0000 7f1ede0c7ec0 20 add_watcher() i=1 2019-12-09T10:04:36.389 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.402+0000 7f1ede0c7ec0 20 add_watcher() i=2 2019-12-09T10:04:36.390 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.402+0000 7f1ede0c7ec0 20 add_watcher() i=3 2019-12-09T10:04:36.390 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.402+0000 7f1ede0c7ec0 20 add_watcher() i=4 2019-12-09T10:04:36.390 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.402+0000 7f1ede0c7ec0 20 add_watcher() i=5 2019-12-09T10:04:36.390 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.403+0000 7f1ede0c7ec0 20 add_watcher() i=6 2019-12-09T10:04:36.418 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.432+0000 7f1ede0c7ec0 20 add_watcher() i=7 2019-12-09T10:04:36.418 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.432+0000 7f1ede0c7ec0 2 all 8 watchers are set, enabling cache 2019-12-09T10:04:36.418 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.432+0000 7f1e9bfdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T10:04:36.425 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.438+0000 7f1ecb2f1700 0 -- 172.21.15.121:0/3885076448 >> v2:172.21.15.121:3300/0 conn(0x561ca3bde7f0 msgr2=0x561ca3be0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T10:04:36.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:36.475+0000 7f1ecbaf2700 0 -- 172.21.15.121:0/739882319 >> [v2:172.21.15.132:6800/8843,v1:172.21.15.132:6801/8843] conn(0x7f1e0c022490 msgr2=0x7f1e0c024960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T10:04:37.665 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.678+0000 7f1e0a7fc700 20 reqs_thread_entry: start 2019-12-09T10:04:37.666 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.679+0000 7f1e03fff700 20 reqs_thread_entry: start 2019-12-09T10:04:37.666 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.679+0000 7f1ede0c7ec0 20 init_complete bucket index max shards: 0 2019-12-09T10:04:37.666 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.679+0000 7f1e027fc700 20 reqs_thread_entry: start 2019-12-09T10:04:37.666 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.679+0000 7f1ede0c7ec0 20 get_system_obj_state: rctx=0x7fff98f15f38 obj=default.rgw.meta:users.uid:tester.client.0 state=0x561ca3c5d160 s->prefetch_data=0 2019-12-09T10:04:37.666 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.680+0000 7f1ede0c7ec0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2019-12-09T10:04:37.675 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.689+0000 7f1ede0c7ec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2019-12-09T10:04:37.676 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.689+0000 7f1ede0c7ec0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-12-09T10:04:37.676 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.689+0000 7f1ede0c7ec0 20 get_system_obj_state: rctx=0x7fff98f15f48 obj=default.rgw.meta:users.email:tester.client.0_test@test.test state=0x561ca3c5eef0 s->prefetch_data=0 2019-12-09T10:04:37.676 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.689+0000 7f1ede0c7ec0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2019-12-09T10:04:37.684 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.697+0000 7f1ede0c7ec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2019-12-09T10:04:37.684 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.697+0000 7f1ede0c7ec0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-12-09T10:04:37.684 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.697+0000 7f1ede0c7ec0 20 get_system_obj_state: rctx=0x7fff98f15f48 obj=default.rgw.meta:users.keys:HMBSDRQSWDHQYYCSTRZO state=0x561ca3c5eef0 s->prefetch_data=0 2019-12-09T10:04:37.684 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.697+0000 7f1ede0c7ec0 10 cache get: name=default.rgw.meta+users.keys+HMBSDRQSWDHQYYCSTRZO : miss 2019-12-09T10:04:37.691 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.705+0000 7f1ede0c7ec0 10 cache put: name=default.rgw.meta+users.keys+HMBSDRQSWDHQYYCSTRZO info.flags=0x0 2019-12-09T10:04:37.691 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.705+0000 7f1ede0c7ec0 10 adding default.rgw.meta+users.keys+HMBSDRQSWDHQYYCSTRZO to cache LRU end 2019-12-09T10:04:37.691 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.705+0000 7f1ede0c7ec0 20 get_system_obj_state: rctx=0x7fff98f15b58 obj=default.rgw.meta:users.keys:HMBSDRQSWDHQYYCSTRZO state=0x561ca3c5eef0 s->prefetch_data=0 2019-12-09T10:04:37.692 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.705+0000 7f1ede0c7ec0 10 cache get: name=default.rgw.meta+users.keys+HMBSDRQSWDHQYYCSTRZO : type miss (requested=0x6, cached=0x0) 2019-12-09T10:04:37.697 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.711+0000 7f1ede0c7ec0 10 cache put: name=default.rgw.meta+users.keys+HMBSDRQSWDHQYYCSTRZO info.flags=0x0 2019-12-09T10:04:37.698 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.711+0000 7f1ede0c7ec0 10 moving default.rgw.meta+users.keys+HMBSDRQSWDHQYYCSTRZO to cache LRU end 2019-12-09T10:04:37.698 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.711+0000 7f1ede0c7ec0 20 get_system_obj_state: rctx=0x7fff98f15cd8 obj=default.rgw.meta:users.keys:HMBSDRQSWDHQYYCSTRZO state=0x561ca3c5eef0 s->prefetch_data=0 2019-12-09T10:04:37.698 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.711+0000 7f1ede0c7ec0 10 cache get: name=default.rgw.meta+users.keys+HMBSDRQSWDHQYYCSTRZO : type miss (requested=0x6, cached=0x0) 2019-12-09T10:04:37.704 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.718+0000 7f1ede0c7ec0 10 cache put: name=default.rgw.meta+users.keys+HMBSDRQSWDHQYYCSTRZO info.flags=0x0 2019-12-09T10:04:37.704 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.718+0000 7f1ede0c7ec0 10 moving default.rgw.meta+users.keys+HMBSDRQSWDHQYYCSTRZO to cache LRU end 2019-12-09T10:04:37.740 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.753+0000 7f1ede0c7ec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-12-09T10:04:37.740 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.753+0000 7f1ede0c7ec0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-12-09T10:04:37.740 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.753+0000 7f1ede0c7ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=632 2019-12-09T10:04:37.748 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.761+0000 7f1eb0ff9700 10 RGWWatcher::handle_notify() notify_id 571230650372 cookie 94681006139520 notifier 4758 bl.length()=632 2019-12-09T10:04:37.748 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.761+0000 7f1eb0ff9700 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-12-09T10:04:37.748 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.761+0000 7f1eb0ff9700 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-12-09T10:04:37.983 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.997+0000 7f1ede0c7ec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-12-09T10:04:37.984 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.997+0000 7f1ede0c7ec0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-12-09T10:04:37.984 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:37.997+0000 7f1ede0c7ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=200 2019-12-09T10:04:37.991 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.005+0000 7f1eb0ff9700 10 RGWWatcher::handle_notify() notify_id 571230650372 cookie 94681006133040 notifier 4758 bl.length()=200 2019-12-09T10:04:37.991 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.005+0000 7f1eb0ff9700 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-12-09T10:04:37.992 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.005+0000 7f1eb0ff9700 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-12-09T10:04:38.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.172+0000 7f1ede0c7ec0 10 cache put: name=default.rgw.meta+users.keys+HMBSDRQSWDHQYYCSTRZO info.flags=0x7 2019-12-09T10:04:38.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.172+0000 7f1ede0c7ec0 10 moving default.rgw.meta+users.keys+HMBSDRQSWDHQYYCSTRZO to cache LRU end 2019-12-09T10:04:38.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.172+0000 7f1ede0c7ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=189 2019-12-09T10:04:38.171 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.185+0000 7f1eb0ff9700 10 RGWWatcher::handle_notify() notify_id 571230650370 cookie 94681006141488 notifier 4758 bl.length()=189 2019-12-09T10:04:38.171 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.185+0000 7f1eb0ff9700 10 cache put: name=default.rgw.meta+users.keys+HMBSDRQSWDHQYYCSTRZO info.flags=0x7 2019-12-09T10:04:38.171 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.185+0000 7f1eb0ff9700 10 moving default.rgw.meta+users.keys+HMBSDRQSWDHQYYCSTRZO to cache LRU end 2019-12-09T10:04:38.216 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2019-12-09T10:04:38.216 INFO:teuthology.orchestra.run.smithi121.stdout: "user_id": "tester.client.0", 2019-12-09T10:04:38.216 INFO:teuthology.orchestra.run.smithi121.stdout: "display_name": "Ms. tester.client.0", 2019-12-09T10:04:38.216 INFO:teuthology.orchestra.run.smithi121.stdout: "email": "tester.client.0_test@test.test", 2019-12-09T10:04:38.216 INFO:teuthology.orchestra.run.smithi121.stdout: "suspended": 0, 2019-12-09T10:04:38.217 INFO:teuthology.orchestra.run.smithi121.stdout: "max_buckets": 1000, 2019-12-09T10:04:38.217 INFO:teuthology.orchestra.run.smithi121.stdout: "subusers": [], 2019-12-09T10:04:38.217 INFO:teuthology.orchestra.run.smithi121.stdout: "keys": [ 2019-12-09T10:04:38.217 INFO:teuthology.orchestra.run.smithi121.stdout: { 2019-12-09T10:04:38.217 INFO:teuthology.orchestra.run.smithi121.stdout: "user": "tester.client.0", 2019-12-09T10:04:38.217 INFO:teuthology.orchestra.run.smithi121.stdout: "access_key": "HMBSDRQSWDHQYYCSTRZO", 2019-12-09T10:04:38.217 INFO:teuthology.orchestra.run.smithi121.stdout: "secret_key": "sGqbDpgRlXMLya9Ixh4H9ccDgay0k55Lfv913AyFNS/FMCQ8A+QQzQ==" 2019-12-09T10:04:38.218 INFO:teuthology.orchestra.run.smithi121.stdout: } 2019-12-09T10:04:38.218 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2019-12-09T10:04:38.218 INFO:teuthology.orchestra.run.smithi121.stdout: "swift_keys": [], 2019-12-09T10:04:38.218 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": [], 2019-12-09T10:04:38.218 INFO:teuthology.orchestra.run.smithi121.stdout: "op_mask": "read, write, delete", 2019-12-09T10:04:38.218 INFO:teuthology.orchestra.run.smithi121.stdout: "default_placement": "", 2019-12-09T10:04:38.218 INFO:teuthology.orchestra.run.smithi121.stdout: "default_storage_class": "", 2019-12-09T10:04:38.219 INFO:teuthology.orchestra.run.smithi121.stdout: "placement_tags": [], 2019-12-09T10:04:38.219 INFO:teuthology.orchestra.run.smithi121.stdout: "bucket_quota": { 2019-12-09T10:04:38.219 INFO:teuthology.orchestra.run.smithi121.stdout: "enabled": false, 2019-12-09T10:04:38.219 INFO:teuthology.orchestra.run.smithi121.stdout: "check_on_raw": false, 2019-12-09T10:04:38.219 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size": -1, 2019-12-09T10:04:38.219 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size_kb": 0, 2019-12-09T10:04:38.219 INFO:teuthology.orchestra.run.smithi121.stdout: "max_objects": -1 2019-12-09T10:04:38.219 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2019-12-09T10:04:38.220 INFO:teuthology.orchestra.run.smithi121.stdout: "user_quota": { 2019-12-09T10:04:38.220 INFO:teuthology.orchestra.run.smithi121.stdout: "enabled": false, 2019-12-09T10:04:38.220 INFO:teuthology.orchestra.run.smithi121.stdout: "check_on_raw": false, 2019-12-09T10:04:38.220 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size": -1, 2019-12-09T10:04:38.220 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size_kb": 0, 2019-12-09T10:04:38.220 INFO:teuthology.orchestra.run.smithi121.stdout: "max_objects": -1 2019-12-09T10:04:38.220 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2019-12-09T10:04:38.221 INFO:teuthology.orchestra.run.smithi121.stdout: "temp_url_keys": [], 2019-12-09T10:04:38.221 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "rgw", 2019-12-09T10:04:38.221 INFO:teuthology.orchestra.run.smithi121.stdout: "mfa_ids": [] 2019-12-09T10:04:38.221 INFO:teuthology.orchestra.run.smithi121.stdout:} 2019-12-09T10:04:38.221 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:04:38.258 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.271+0000 7f1ede0c7ec0 20 remove_watcher() i=0 2019-12-09T10:04:38.258 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.271+0000 7f1ede0c7ec0 2 removed watcher, disabling cache 2019-12-09T10:04:38.310 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.324+0000 7f1ede0c7ec0 20 remove_watcher() i=1 2019-12-09T10:04:38.356 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.369+0000 7f1ede0c7ec0 20 remove_watcher() i=2 2019-12-09T10:04:38.396 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.410+0000 7f1ede0c7ec0 20 remove_watcher() i=3 2019-12-09T10:04:38.441 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.455+0000 7f1ede0c7ec0 20 remove_watcher() i=4 2019-12-09T10:04:38.488 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.502+0000 7f1ede0c7ec0 20 remove_watcher() i=5 2019-12-09T10:04:38.542 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.556+0000 7f1ede0c7ec0 20 remove_watcher() i=6 2019-12-09T10:04:38.590 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.604+0000 7f1ede0c7ec0 20 remove_watcher() i=7 2019-12-09T10:04:38.602 INFO:teuthology.orchestra.run.smithi121:> cat > /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2019-12-09T10:04:38.668 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2019-12-09T10:04:38.669 INFO:teuthology.orchestra.run.smithi121:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2019-12-09T10:04:38.766 INFO:teuthology.orchestra.run.smithi121:> radosgw-admin gc process --include-all 2019-12-09T10:04:38.894 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.908+0000 7faeab61fec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:38.934 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.947+0000 7faeab61fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:38.934 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.948+0000 7faeab61fec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:38.951 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.959+0000 7faeab61fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:38.951 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.959+0000 7faeab61fec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:38.954 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.967+0000 7faeab61fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:38.954 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.967+0000 7faeab61fec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:38.973 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:38.986+0000 7faeab61fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:04:39.187 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.200+0000 7faeab61fec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T10:04:39.187 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.200+0000 7faeab61fec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T10:04:39.187 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.200+0000 7faeab61fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T10:04:39.187 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.200+0000 7faeab61fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T10:04:39.188 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.200+0000 7faeab61fec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:39.203 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.217+0000 7faeab61fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:04:39.203 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.217+0000 7faeab61fec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:39.218 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.231+0000 7faeab61fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:04:39.218 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.231+0000 7faeab61fec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:39.234 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.248+0000 7faeab61fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:04:39.234 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.248+0000 7faeab61fec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:39.247 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.261+0000 7faeab61fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:04:39.248 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.261+0000 7faeab61fec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:39.258 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.272+0000 7faeab61fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:39.259 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.272+0000 7faeab61fec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T10:04:39.259 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.272+0000 7faeab61fec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:39.268 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.282+0000 7faeab61fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:39.269 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.282+0000 7faeab61fec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:39.283 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.297+0000 7faeab61fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:04:39.283 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.297+0000 7faeab61fec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:39.299 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.312+0000 7faeab61fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:04:39.299 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.312+0000 7faeab61fec0 20 zonegroup default 2019-12-09T10:04:39.299 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.312+0000 7faeab61fec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:39.310 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.324+0000 7faeab61fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:39.310 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.324+0000 7faeab61fec0 10 Cannot find current period zone using local zone 2019-12-09T10:04:39.310 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.324+0000 7faeab61fec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:39.320 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.334+0000 7faeab61fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:39.320 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.334+0000 7faeab61fec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:39.335 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.348+0000 7faeab61fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:04:39.335 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.348+0000 7faeab61fec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:39.355 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.369+0000 7faeab61fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:04:39.356 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.369+0000 7faeab61fec0 20 zone default found 2019-12-09T10:04:39.356 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.369+0000 7faeab61fec0 20 started sync module instance, tier type = 2019-12-09T10:04:39.356 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.369+0000 7faeab61fec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T10:04:39.693 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.706+0000 7faeab61fec0 20 add_watcher() i=0 2019-12-09T10:04:39.693 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.706+0000 7faeab61fec0 20 add_watcher() i=1 2019-12-09T10:04:39.693 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.706+0000 7faeab61fec0 20 add_watcher() i=2 2019-12-09T10:04:39.693 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.706+0000 7faeab61fec0 20 add_watcher() i=3 2019-12-09T10:04:39.693 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.706+0000 7faeab61fec0 20 add_watcher() i=4 2019-12-09T10:04:39.693 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.706+0000 7faeab61fec0 20 add_watcher() i=5 2019-12-09T10:04:39.697 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.711+0000 7faeab61fec0 20 add_watcher() i=6 2019-12-09T10:04:39.721 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.735+0000 7faeab61fec0 20 add_watcher() i=7 2019-12-09T10:04:39.722 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.735+0000 7faeab61fec0 2 all 8 watchers are set, enabling cache 2019-12-09T10:04:39.722 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.735+0000 7fae68fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T10:04:39.723 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.737+0000 7fae9904a700 0 -- >> v2:172.21.15.132:3300/0 conn(0x5602c3050b50 msgr2=0x5602c3064b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T10:04:39.766 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:39.780+0000 7fae98849700 0 -- 172.21.15.121:0/725953122 >> [v2:172.21.15.132:6800/8843,v1:172.21.15.132:6801/8843] conn(0x7faddc022470 msgr2=0x7faddc024960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T10:04:41.430 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.443+0000 7faddaffd700 20 reqs_thread_entry: start 2019-12-09T10:04:41.430 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.443+0000 7fadd8ff9700 20 reqs_thread_entry: start 2019-12-09T10:04:41.430 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.443+0000 7faeab61fec0 20 init_complete bucket index max shards: 0 2019-12-09T10:04:41.430 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.444+0000 7fadceffd700 20 reqs_thread_entry: start 2019-12-09T10:04:41.431 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.444+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T10:04:41.491 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.504+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:41.517 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.531+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:41.555 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.569+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:04:41.555 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.569+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='_V_LYSzb6g5ykuNWX9lhtMKFDbqabz5C', time=2019-12-09T12:04:09.086820+0000, chain.objs.size()=2 2019-12-09T10:04:41.556 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.569+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.bVRof8_MV7nRgQ-cHP1ekobiUZYtLcK_0 2019-12-09T10:04:41.556 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.569+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.bVRof8_MV7nRgQ-cHP1ekobiUZYtLcK_1 2019-12-09T10:04:41.630 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.644+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:41.779 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.792+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T10:04:41.857 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.870+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:41.872 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.886+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:41.911 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.924+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:04:41.911 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.924+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.204', time=2019-12-09T12:04:15.782925+0000, chain.objs.size()=5 2019-12-09T10:04:41.911 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.924+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8__multipart_foo-LUKEWARM.2~tQTt8-tS4tONELgu2DgBNlf2O13dXka.1 2019-12-09T10:04:41.911 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.924+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8__shadow_foo-LUKEWARM.2~tQTt8-tS4tONELgu2DgBNlf2O13dXka.1_1 2019-12-09T10:04:41.911 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.924+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8__multipart_foo-LUKEWARM.2~tQTt8-tS4tONELgu2DgBNlf2O13dXka.2 2019-12-09T10:04:41.911 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.924+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8__shadow_foo-LUKEWARM.2~tQTt8-tS4tONELgu2DgBNlf2O13dXka.2_1 2019-12-09T10:04:41.912 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:41.924+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8__multipart_foo-LUKEWARM.2~tQTt8-tS4tONELgu2DgBNlf2O13dXka.3 2019-12-09T10:04:42.001 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.014+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:42.241 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.254+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T10:04:42.321 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.334+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:42.343 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.357+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:42.356 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.370+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:04:42.356 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.370+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.108', time=2019-12-09T12:04:08.663171+0000, chain.objs.size()=2 2019-12-09T10:04:42.357 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.370+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.YevdKJ1plQ3bJQRFq8QoLWNH7NOtfLu_0 2019-12-09T10:04:42.357 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.370+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.YevdKJ1plQ3bJQRFq8QoLWNH7NOtfLu_1 2019-12-09T10:04:42.416 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.429+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:42.564 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.577+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T10:04:42.647 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.660+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:42.685 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.698+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:42.702 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.716+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:42.768 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.782+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T10:04:42.833 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.847+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:42.861 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.875+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:42.913 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.926+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:04:42.913 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.926+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.40', time=2019-12-09T12:04:04.691903+0000, chain.objs.size()=4 2019-12-09T10:04:42.913 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.926+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.3__multipart_foo.2~gPjbYuVgx15mnqKsbEuFIT1wlfEz25U.1 2019-12-09T10:04:42.913 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.926+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.3__multipart_foo.2~gPjbYuVgx15mnqKsbEuFIT1wlfEz25U.2 2019-12-09T10:04:42.914 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.926+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.3__multipart_foo.2~gPjbYuVgx15mnqKsbEuFIT1wlfEz25U.3 2019-12-09T10:04:42.914 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:42.926+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.3__multipart_foo.2~gPjbYuVgx15mnqKsbEuFIT1wlfEz25U.4 2019-12-09T10:04:43.044 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.058+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:43.140 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.154+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T10:04:43.185 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.199+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:43.201 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.215+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:43.209 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.223+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:43.251 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.265+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T10:04:43.332 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.345+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:43.370 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.383+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:43.392 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.405+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:43.456 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.469+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T10:04:43.532 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.546+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:43.574 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.588+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:43.592 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.605+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:43.651 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.665+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T10:04:43.727 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.740+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:43.754 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.767+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:43.782 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.795+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2019-12-09T10:04:43.782 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.795+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.114', time=2019-12-09T12:04:09.776223+0000, chain.objs.size()=2 2019-12-09T10:04:43.782 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.795+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.YlW1jbdexq9RxljVTx1bT7UBxttNk4X_0 2019-12-09T10:04:43.783 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.795+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.YlW1jbdexq9RxljVTx1bT7UBxttNk4X_1 2019-12-09T10:04:43.783 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.795+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.116', time=2019-12-09T12:04:10.198613+0000, chain.objs.size()=1 2019-12-09T10:04:43.783 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.795+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.WRaLtQ2gh_gLkoS5cfx5cE_Q596-W69_1 2019-12-09T10:04:43.783 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.795+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.226', time=2019-12-09T12:04:12.487515+0000, chain.objs.size()=5 2019-12-09T10:04:43.783 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.795+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-FROZEN.2~Dx0j0SX70LIvZIVqji9Oru-fTic6njy.1 2019-12-09T10:04:43.783 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.795+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_foo-FROZEN.2~Dx0j0SX70LIvZIVqji9Oru-fTic6njy.1_1 2019-12-09T10:04:43.783 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.795+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-FROZEN.2~Dx0j0SX70LIvZIVqji9Oru-fTic6njy.2 2019-12-09T10:04:43.784 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.795+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_foo-FROZEN.2~Dx0j0SX70LIvZIVqji9Oru-fTic6njy.2_1 2019-12-09T10:04:43.784 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.795+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-FROZEN.2~Dx0j0SX70LIvZIVqji9Oru-fTic6njy.3 2019-12-09T10:04:43.784 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.795+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.84', time=2019-12-09T12:04:17.199782+0000, chain.objs.size()=3 2019-12-09T10:04:43.784 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.795+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.6__shadow_.aBVvHOHNsMi102Ytr6uNw8xRds38tff_0 2019-12-09T10:04:43.784 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.795+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.6__shadow_.aBVvHOHNsMi102Ytr6uNw8xRds38tff_1 2019-12-09T10:04:43.784 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:43.795+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.6__shadow_.aBVvHOHNsMi102Ytr6uNw8xRds38tff_2 2019-12-09T10:04:43.992 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.005+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:44.083 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.097+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T10:04:44.124 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.137+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:44.139 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.153+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:44.157 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.170+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-12-09T10:04:44.157 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.170+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.234', time=2019-12-09T12:04:12.956548+0000, chain.objs.size()=5 2019-12-09T10:04:44.157 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.170+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-LUKEWARM.2~wEQbodWMK9UauhL0Ixd5yi-dV6pix0l.1 2019-12-09T10:04:44.158 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.170+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_foo-LUKEWARM.2~wEQbodWMK9UauhL0Ixd5yi-dV6pix0l.1_1 2019-12-09T10:04:44.158 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.170+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-LUKEWARM.2~wEQbodWMK9UauhL0Ixd5yi-dV6pix0l.2 2019-12-09T10:04:44.158 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.170+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_foo-LUKEWARM.2~wEQbodWMK9UauhL0Ixd5yi-dV6pix0l.2_1 2019-12-09T10:04:44.158 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.170+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-LUKEWARM.2~wEQbodWMK9UauhL0Ixd5yi-dV6pix0l.3 2019-12-09T10:04:44.158 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.170+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='_CAYivDzGgveju4hfnaptF1SXjorAyfR', time=2019-12-09T12:04:13.122018+0000, chain.objs.size()=3 2019-12-09T10:04:44.158 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.170+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_.-cZrDMwqnLJyLhuGVTmkI51YYEo23m4_0 2019-12-09T10:04:44.158 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.170+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_.-cZrDMwqnLJyLhuGVTmkI51YYEo23m4_1 2019-12-09T10:04:44.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.170+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_.-cZrDMwqnLJyLhuGVTmkI51YYEo23m4_2 2019-12-09T10:04:44.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.170+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.236', time=2019-12-09T12:04:13.288759+0000, chain.objs.size()=5 2019-12-09T10:04:44.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.170+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-LUKEWARM.2~wEQbodWMK9UauhL0Ixd5yi-dV6pix0l.1 2019-12-09T10:04:44.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.170+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_foo-LUKEWARM.2~wEQbodWMK9UauhL0Ixd5yi-dV6pix0l.1_1 2019-12-09T10:04:44.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.170+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-LUKEWARM.2~wEQbodWMK9UauhL0Ixd5yi-dV6pix0l.2 2019-12-09T10:04:44.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.170+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_foo-LUKEWARM.2~wEQbodWMK9UauhL0Ixd5yi-dV6pix0l.2_1 2019-12-09T10:04:44.213 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.227+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-LUKEWARM.2~wEQbodWMK9UauhL0Ixd5yi-dV6pix0l.3 2019-12-09T10:04:44.346 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.360+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:44.451 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.463+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T10:04:44.510 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.523+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:44.527 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.541+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:44.567 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.580+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T10:04:44.568 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.580+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.246', time=2019-12-09T12:04:14.242827+0000, chain.objs.size()=3 2019-12-09T10:04:44.568 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.580+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-STANDARD.2~PonnvK0tHiVVoXRsFcWx0tKAvT8zmNs.1 2019-12-09T10:04:44.568 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.580+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-STANDARD.2~PonnvK0tHiVVoXRsFcWx0tKAvT8zmNs.2 2019-12-09T10:04:44.568 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.580+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-STANDARD.2~PonnvK0tHiVVoXRsFcWx0tKAvT8zmNs.3 2019-12-09T10:04:44.568 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.580+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.197', time=2019-12-09T12:04:15.569555+0000, chain.objs.size()=5 2019-12-09T10:04:44.569 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.580+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8__multipart_foo-FROZEN.2~h7aDvhaOIahods4t4kpcSBQoVaFedn6.1 2019-12-09T10:04:44.569 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.580+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8__shadow_foo-FROZEN.2~h7aDvhaOIahods4t4kpcSBQoVaFedn6.1_1 2019-12-09T10:04:44.569 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.581+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8__multipart_foo-FROZEN.2~h7aDvhaOIahods4t4kpcSBQoVaFedn6.2 2019-12-09T10:04:44.569 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.581+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8__shadow_foo-FROZEN.2~h7aDvhaOIahods4t4kpcSBQoVaFedn6.2_1 2019-12-09T10:04:44.569 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.581+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8__multipart_foo-FROZEN.2~h7aDvhaOIahods4t4kpcSBQoVaFedn6.3 2019-12-09T10:04:44.733 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.746+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:44.819 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.833+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T10:04:44.852 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.866+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:44.867 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.880+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:44.875 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.889+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:44.916 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:44.929+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T10:04:44.999 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.012+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:45.027 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.040+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:45.042 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.055+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:45.091 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.104+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T10:04:45.154 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.168+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:45.177 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.191+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:45.211 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.222+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:04:45.211 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.222+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.112', time=2019-12-09T12:04:09.422307+0000, chain.objs.size()=2 2019-12-09T10:04:45.211 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.222+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.YlW1jbdexq9RxljVTx1bT7UBxttNk4X_0 2019-12-09T10:04:45.212 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.222+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.YlW1jbdexq9RxljVTx1bT7UBxttNk4X_1 2019-12-09T10:04:45.307 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.320+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:45.437 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.451+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T10:04:45.496 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.510+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:45.517 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.531+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:45.526 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.540+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:45.562 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.575+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T10:04:45.609 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.619+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:45.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.639+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:45.639 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.652+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-12-09T10:04:45.639 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.652+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='_RgN6fdpIqRNa5ID3Z8-yNJpZLAZffxV', time=2019-12-09T12:04:10.022314+0000, chain.objs.size()=1 2019-12-09T10:04:45.639 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.652+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.qhSAjfv4V7k7SdHDGy3-nvJbetRpBce_1 2019-12-09T10:04:45.639 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.652+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='_9jblPwC6Oznpc8vy9ZNi27J4toJs3m3', time=2019-12-09T12:04:10.403613+0000, chain.objs.size()=2 2019-12-09T10:04:45.639 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.652+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.lToNx_p6vjfgGw6yq774R1ga9Z9_uYU_0 2019-12-09T10:04:45.640 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.652+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.lToNx_p6vjfgGw6yq774R1ga9Z9_uYU_1 2019-12-09T10:04:45.640 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.652+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='_WqXCXGgG-tLAIv2Nc3_xKnUXGc6jLlf', time=2019-12-09T12:04:14.054074+0000, chain.objs.size()=1 2019-12-09T10:04:45.640 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.652+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_.FaEg9t0zACfb4dQGxJ2N5y4f0kWOGwl_0 2019-12-09T10:04:45.705 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.718+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:45.784 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.798+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T10:04:45.838 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.852+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:45.875 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.889+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:45.898 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.911+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T10:04:45.898 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.911+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.55', time=2019-12-09T12:04:06.266938+0000, chain.objs.size()=4 2019-12-09T10:04:45.899 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.911+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.4__multipart_foo.2~zjgB2lIDWQpTvLroVhF0cMuw4DC4KKJ.1 2019-12-09T10:04:45.899 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.912+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.4__multipart_foo.2~zjgB2lIDWQpTvLroVhF0cMuw4DC4KKJ.2 2019-12-09T10:04:45.899 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.912+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.4__multipart_foo.2~zjgB2lIDWQpTvLroVhF0cMuw4DC4KKJ.3 2019-12-09T10:04:45.899 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.912+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.4__multipart_foo.2~zjgB2lIDWQpTvLroVhF0cMuw4DC4KKJ.4 2019-12-09T10:04:45.899 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.912+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='_CboP3y8NVETfguNSUUkW3pLuhOKDDVf', time=2019-12-09T12:04:13.480510+0000, chain.objs.size()=2 2019-12-09T10:04:45.899 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.912+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_.gUxEma4ZQlNEbWFBpA3CpDHg2icIH7f_1 2019-12-09T10:04:45.899 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:45.912+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_.gUxEma4ZQlNEbWFBpA3CpDHg2icIH7f_2 2019-12-09T10:04:46.151 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.165+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:46.246 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.260+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T10:04:46.295 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.309+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:46.313 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.327+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:46.321 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.335+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:46.371 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.385+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T10:04:46.447 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.460+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:46.480 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.493+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:46.541 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.554+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:04:46.541 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.554+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.109', time=2019-12-09T12:04:08.850086+0000, chain.objs.size()=2 2019-12-09T10:04:46.541 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.554+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.YevdKJ1plQ3bJQRFq8QoLWNH7NOtfLu_0 2019-12-09T10:04:46.541 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.554+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.YevdKJ1plQ3bJQRFq8QoLWNH7NOtfLu_1 2019-12-09T10:04:46.607 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.620+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:46.746 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.760+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T10:04:46.804 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.818+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:46.833 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.847+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:46.853 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.866+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2019-12-09T10:04:46.853 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.866+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='_KuxecBV-63nhFoX_5zMk-2Hr7z4RIHx', time=2019-12-09T12:04:09.227180+0000, chain.objs.size()=1 2019-12-09T10:04:46.853 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.866+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.ObqZeayiQdrGv5O8VvOC5S7DxhhY2ub_1 2019-12-09T10:04:46.853 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.866+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.119', time=2019-12-09T12:04:10.876056+0000, chain.objs.size()=1 2019-12-09T10:04:46.854 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.866+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.WRaLtQ2gh_gLkoS5cfx5cE_Q596-W69_1 2019-12-09T10:04:46.854 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.866+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='_30-bccb5US_W4-S9ptyqhP224kp1GHg', time=2019-12-09T12:04:12.665720+0000, chain.objs.size()=3 2019-12-09T10:04:46.854 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.866+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_.8bXTX9Wtxh0n2Tae5qLXTH_Q0w1Z_j2_0 2019-12-09T10:04:46.854 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.866+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_.8bXTX9Wtxh0n2Tae5qLXTH_Q0w1Z_j2_1 2019-12-09T10:04:46.854 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.866+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_.8bXTX9Wtxh0n2Tae5qLXTH_Q0w1Z_j2_2 2019-12-09T10:04:46.854 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.866+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='_hydaSHy8S_Po22RSCEsuY8WocuyFyn2', time=2019-12-09T12:04:12.818153+0000, chain.objs.size()=2 2019-12-09T10:04:46.855 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.866+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_.cudlvjnGap4hniKIJPlOwso-BPZks7W_1 2019-12-09T10:04:46.855 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:46.866+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_.cudlvjnGap4hniKIJPlOwso-BPZks7W_2 2019-12-09T10:04:47.051 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.065+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:47.124 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.137+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T10:04:47.166 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.179+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:47.182 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.196+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:47.191 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.204+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:47.218 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.232+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T10:04:47.268 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.282+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:47.293 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.307+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:47.305 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.318+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:47.349 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.362+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T10:04:47.426 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.439+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:47.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.475+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:47.478 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.491+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:47.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.571+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T10:04:47.641 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.655+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:47.666 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.679+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:47.682 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.695+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:04:47.682 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.695+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.211', time=2019-12-09T12:04:15.952927+0000, chain.objs.size()=3 2019-12-09T10:04:47.682 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.695+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8__multipart_foo-STANDARD.2~AiKonqXFNwv1dLld_GHf8oGtuWQk5Mp.1 2019-12-09T10:04:47.682 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.695+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8__multipart_foo-STANDARD.2~AiKonqXFNwv1dLld_GHf8oGtuWQk5Mp.2 2019-12-09T10:04:47.682 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.695+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.8__multipart_foo-STANDARD.2~AiKonqXFNwv1dLld_GHf8oGtuWQk5Mp.3 2019-12-09T10:04:47.845 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.858+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:47.933 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.947+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T10:04:47.976 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:47.990+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:47.993 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.006+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:48.007 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.020+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T10:04:48.007 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.020+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.225', time=2019-12-09T12:04:12.323287+0000, chain.objs.size()=5 2019-12-09T10:04:48.007 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.020+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-FROZEN.2~Dx0j0SX70LIvZIVqji9Oru-fTic6njy.1 2019-12-09T10:04:48.007 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.020+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_foo-FROZEN.2~Dx0j0SX70LIvZIVqji9Oru-fTic6njy.1_1 2019-12-09T10:04:48.007 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.020+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-FROZEN.2~Dx0j0SX70LIvZIVqji9Oru-fTic6njy.2 2019-12-09T10:04:48.008 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.020+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_foo-FROZEN.2~Dx0j0SX70LIvZIVqji9Oru-fTic6njy.2_1 2019-12-09T10:04:48.008 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.020+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-FROZEN.2~Dx0j0SX70LIvZIVqji9Oru-fTic6njy.3 2019-12-09T10:04:48.008 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.020+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.85', time=2019-12-09T12:04:17.387597+0000, chain.objs.size()=3 2019-12-09T10:04:48.008 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.020+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.6__shadow_.sO5JndAJwS0j4KsZhaJ7bZ8LbBb0aeg_0 2019-12-09T10:04:48.008 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.020+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.6__shadow_.sO5JndAJwS0j4KsZhaJ7bZ8LbBb0aeg_1 2019-12-09T10:04:48.009 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.020+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.6__shadow_.sO5JndAJwS0j4KsZhaJ7bZ8LbBb0aeg_2 2019-12-09T10:04:48.136 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.150+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:48.204 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.217+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T10:04:48.243 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.256+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:48.260 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.273+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:48.270 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.283+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:04:48.270 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.283+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='__wJr9UGtsYFYVJlj1q15SKkwvtN1Ioc', time=2019-12-09T12:04:13.804920+0000, chain.objs.size()=1 2019-12-09T10:04:48.270 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.283+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__shadow_.vnguvSHP7PX-X5aiQ8DzhprKjep-XlV_0 2019-12-09T10:04:48.316 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.329+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:48.439 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.453+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T10:04:48.505 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.519+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:48.525 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.539+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:48.539 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.553+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:04:48.540 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.553+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='_TlvdcOOzZQf73R8x4YbIiaCHfN_MjwV', time=2019-12-09T12:04:09.574588+0000, chain.objs.size()=2 2019-12-09T10:04:48.540 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.553+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.1wi-ujzWgCcwi-LM_cx-i104bsQFMUE_0 2019-12-09T10:04:48.540 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.553+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_.1wi-ujzWgCcwi-LM_cx-i104bsQFMUE_1 2019-12-09T10:04:48.596 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.610+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:48.659 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.673+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T10:04:48.748 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.762+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:48.780 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.794+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:48.797 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.810+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:48.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.861+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T10:04:48.924 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.937+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:48.957 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:48.971+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:49.006 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.019+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:04:49.006 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.019+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.71', time=2019-12-09T12:04:07.585374+0000, chain.objs.size()=4 2019-12-09T10:04:49.006 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.019+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.5__multipart_foo.2~HqlCV7zg9TPeD-O4ZCZwsDA8gf4OfP5.1 2019-12-09T10:04:49.006 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.019+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.5__multipart_foo.2~HqlCV7zg9TPeD-O4ZCZwsDA8gf4OfP5.2 2019-12-09T10:04:49.006 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.019+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.5__multipart_foo.2~HqlCV7zg9TPeD-O4ZCZwsDA8gf4OfP5.3 2019-12-09T10:04:49.006 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.019+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.5__multipart_foo.2~HqlCV7zg9TPeD-O4ZCZwsDA8gf4OfP5.4 2019-12-09T10:04:49.191 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.204+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:49.297 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.310+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T10:04:49.336 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.349+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:49.351 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.365+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:49.361 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.374+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:04:49.361 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.374+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.20', time=2019-12-09T12:04:03.728880+0000, chain.objs.size()=4 2019-12-09T10:04:49.361 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.374+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.2__multipart_foo.2~8wcPIDHjkkSIQJpQdh1sveSmPpJSbn7.1 2019-12-09T10:04:49.361 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.375+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.2__multipart_foo.2~8wcPIDHjkkSIQJpQdh1sveSmPpJSbn7.2 2019-12-09T10:04:49.362 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.375+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.2__multipart_foo.2~8wcPIDHjkkSIQJpQdh1sveSmPpJSbn7.3 2019-12-09T10:04:49.362 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.375+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.2__multipart_foo.2~8wcPIDHjkkSIQJpQdh1sveSmPpJSbn7.4 2019-12-09T10:04:49.476 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.490+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:49.568 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.581+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T10:04:49.605 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.618+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:49.620 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.634+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:49.630 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.644+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:04:49.630 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.644+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='_a61aV3WeRNrgMgFKuQT576nK1MQizUf', time=2019-12-09T12:04:10.616144+0000, chain.objs.size()=2 2019-12-09T10:04:49.631 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.644+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_._5HcRlrY1dXJEYZLdO9Nq0Lw1V_878T_0 2019-12-09T10:04:49.631 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.644+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a55fd90f-db62-40cd-9264-5916c91f1695.4358.7__shadow_._5HcRlrY1dXJEYZLdO9Nq0Lw1V_878T_1 2019-12-09T10:04:49.710 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.723+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:49.796 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.810+0000 7faeab61fec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T10:04:49.842 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.855+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:49.862 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.875+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:49.873 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.886+0000 7faeab61fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:04:49.873 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.886+0000 7faeab61fec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.243', time=2019-12-09T12:04:13.632442+0000, chain.objs.size()=3 2019-12-09T10:04:49.873 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.886+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-STANDARD.2~PonnvK0tHiVVoXRsFcWx0tKAvT8zmNs.1 2019-12-09T10:04:49.873 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.886+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-STANDARD.2~PonnvK0tHiVVoXRsFcWx0tKAvT8zmNs.2 2019-12-09T10:04:49.874 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.886+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.9__multipart_foo-STANDARD.2~PonnvK0tHiVVoXRsFcWx0tKAvT8zmNs.3 2019-12-09T10:04:49.969 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:49.983+0000 7faeab61fec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:04:50.097 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.110+0000 7faeab61fec0 20 remove_watcher() i=0 2019-12-09T10:04:50.097 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.111+0000 7faeab61fec0 2 removed watcher, disabling cache 2019-12-09T10:04:50.130 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.143+0000 7faeab61fec0 20 remove_watcher() i=1 2019-12-09T10:04:50.177 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.191+0000 7faeab61fec0 20 remove_watcher() i=2 2019-12-09T10:04:50.211 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.225+0000 7faeab61fec0 20 remove_watcher() i=3 2019-12-09T10:04:50.244 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.258+0000 7faeab61fec0 20 remove_watcher() i=4 2019-12-09T10:04:50.279 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.293+0000 7faeab61fec0 20 remove_watcher() i=5 2019-12-09T10:04:50.325 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.339+0000 7faeab61fec0 20 remove_watcher() i=6 2019-12-09T10:04:50.355 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.369+0000 7faeab61fec0 20 remove_watcher() i=7 2019-12-09T10:04:50.363 INFO:teuthology.orchestra.run.smithi121:> radosgw-admin gc process --include-all 2019-12-09T10:04:50.474 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.487+0000 7fee0e7b2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:50.502 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.515+0000 7fee0e7b2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:50.502 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.515+0000 7fee0e7b2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:50.510 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.524+0000 7fee0e7b2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:50.510 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.524+0000 7fee0e7b2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:50.519 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.532+0000 7fee0e7b2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:50.519 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.532+0000 7fee0e7b2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:50.543 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.556+0000 7fee0e7b2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:04:50.739 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.752+0000 7fee0e7b2ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T10:04:50.739 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.752+0000 7fee0e7b2ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T10:04:50.740 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.752+0000 7fee0e7b2ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T10:04:50.740 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.752+0000 7fee0e7b2ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T10:04:50.740 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.752+0000 7fee0e7b2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:50.752 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.765+0000 7fee0e7b2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:04:50.752 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.765+0000 7fee0e7b2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:50.771 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.784+0000 7fee0e7b2ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:04:50.771 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.784+0000 7fee0e7b2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:50.786 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.800+0000 7fee0e7b2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:04:50.786 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.800+0000 7fee0e7b2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:50.801 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.814+0000 7fee0e7b2ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:04:50.801 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.814+0000 7fee0e7b2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:50.815 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.828+0000 7fee0e7b2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:50.815 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.828+0000 7fee0e7b2ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T10:04:50.815 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.828+0000 7fee0e7b2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:50.825 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.839+0000 7fee0e7b2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:50.825 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.839+0000 7fee0e7b2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:50.837 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.851+0000 7fee0e7b2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:04:50.837 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.851+0000 7fee0e7b2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:50.853 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.867+0000 7fee0e7b2ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:04:50.853 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.867+0000 7fee0e7b2ec0 20 zonegroup default 2019-12-09T10:04:50.853 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.867+0000 7fee0e7b2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:50.861 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.874+0000 7fee0e7b2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:50.861 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.874+0000 7fee0e7b2ec0 10 Cannot find current period zone using local zone 2019-12-09T10:04:50.861 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.874+0000 7fee0e7b2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:50.867 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.881+0000 7fee0e7b2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:04:50.867 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.881+0000 7fee0e7b2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:50.881 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.895+0000 7fee0e7b2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:04:50.881 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.895+0000 7fee0e7b2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:04:50.892 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.905+0000 7fee0e7b2ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:04:50.892 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.906+0000 7fee0e7b2ec0 20 zone default found 2019-12-09T10:04:50.892 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.906+0000 7fee0e7b2ec0 20 started sync module instance, tier type = 2019-12-09T10:04:50.893 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:50.906+0000 7fee0e7b2ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T10:04:51.263 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:51.276+0000 7fee0e7b2ec0 20 add_watcher() i=0 2019-12-09T10:04:51.263 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:51.276+0000 7fee0e7b2ec0 20 add_watcher() i=1 2019-12-09T10:04:51.263 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:51.276+0000 7fee0e7b2ec0 20 add_watcher() i=2 2019-12-09T10:04:51.263 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:51.276+0000 7fee0e7b2ec0 20 add_watcher() i=3 2019-12-09T10:04:51.263 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:51.276+0000 7fee0e7b2ec0 20 add_watcher() i=4 2019-12-09T10:04:51.263 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:51.276+0000 7fee0e7b2ec0 20 add_watcher() i=5 2019-12-09T10:04:51.264 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:51.276+0000 7fee0e7b2ec0 20 add_watcher() i=6 2019-12-09T10:04:51.305 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:51.319+0000 7fee0e7b2ec0 20 add_watcher() i=7 2019-12-09T10:04:51.306 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:51.319+0000 7fee0e7b2ec0 2 all 8 watchers are set, enabling cache 2019-12-09T10:04:51.306 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:51.319+0000 7fed4ffff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T10:04:51.318 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:51.331+0000 7fedfb9dc700 0 -- 172.21.15.121:0/383536885 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x555d9c526ff0 msgr2=0x555d9c527400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T10:04:51.338 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:51.352+0000 7fedfb9dc700 0 -- >> v2:172.21.15.121:3300/0 conn(0x555d9c51d8f0 msgr2=0x555d9c524b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T10:04:52.020 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:25:50.063 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:04:52.037 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:25:50.081 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:04:52.057 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:25:50.014 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:04:52.072 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:25:50.115 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:04:52.086 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:25:50.043 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:04:52.133 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:25:50.177 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:04:52.183 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:25:50.140 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:04:52.210 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:25:50.253 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:04:52.283 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:25:50.326 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:04:52.618 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.631+0000 7fed3a7fc700 20 reqs_thread_entry: start 2019-12-09T10:04:52.618 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.632+0000 7fed33fff700 20 reqs_thread_entry: start 2019-12-09T10:04:52.619 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.632+0000 7fee0e7b2ec0 20 init_complete bucket index max shards: 0 2019-12-09T10:04:52.619 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.632+0000 7fed327fc700 20 reqs_thread_entry: start 2019-12-09T10:04:52.619 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.632+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T10:04:52.659 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.673+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:52.674 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.688+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:52.683 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.697+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:52.723 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.736+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T10:04:52.764 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.778+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:52.780 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.794+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:52.789 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.802+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:52.820 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.833+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T10:04:52.862 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.876+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:52.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.893+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:52.887 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.901+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:52.918 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.932+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T10:04:52.978 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:52.992+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:53.001 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.014+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:53.010 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.024+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:53.051 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.065+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T10:04:53.123 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.136+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:53.150 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.163+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:53.162 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.175+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:53.241 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.255+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T10:04:53.288 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.301+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:53.308 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.322+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:53.317 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.330+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:53.356 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.370+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T10:04:53.430 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.444+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:53.454 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.468+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:53.466 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.479+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:53.512 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.525+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T10:04:53.567 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.581+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:53.584 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.597+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:53.593 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.606+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:53.682 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.696+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T10:04:53.738 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.751+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:53.763 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.777+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:53.776 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.789+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:53.820 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.834+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T10:04:53.880 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.894+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:53.913 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.927+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:53.926 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.940+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:53.967 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:53.981+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T10:04:54.012 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.025+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:54.032 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.046+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:54.043 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.056+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:54.093 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.106+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T10:04:54.147 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.160+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:54.177 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.190+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:54.188 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.202+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:54.234 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.247+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T10:04:54.271 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.285+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:54.286 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.300+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:54.296 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.309+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:54.339 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.352+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T10:04:54.400 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.413+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:54.421 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.435+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:54.430 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.443+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:54.474 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.487+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T10:04:54.519 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.532+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:54.539 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.553+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:54.549 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.563+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:54.606 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.620+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T10:04:54.683 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.697+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:54.706 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.719+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:54.725 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.738+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:54.772 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.786+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T10:04:54.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.860+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:54.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.893+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:54.890 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.904+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:54.947 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:54.960+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T10:04:55.032 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.045+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:55.062 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.076+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:55.075 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.088+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:55.133 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.147+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T10:04:55.209 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.223+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:55.239 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.253+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:55.257 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.270+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:55.320 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.334+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T10:04:55.397 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.410+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:55.426 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.439+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.455+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:55.487 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.501+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T10:04:55.557 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.570+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:55.577 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.591+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:55.590 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.603+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:55.631 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.645+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T10:04:55.677 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.691+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:55.696 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.709+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:55.706 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.719+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:55.741 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.755+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T10:04:55.817 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.830+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:55.843 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.855+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:55.858 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.871+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:55.907 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.921+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T10:04:55.977 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:55.991+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:56.001 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.015+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:56.017 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.030+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:56.055 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.069+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T10:04:56.126 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.139+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:56.152 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.165+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:56.164 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.177+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:56.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.209+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T10:04:56.252 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.266+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:56.295 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.309+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:56.310 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.324+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:56.349 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.362+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T10:04:56.391 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.405+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:56.412 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.422+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:56.417 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.430+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:56.449 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.463+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T10:04:56.500 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.514+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:56.516 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.529+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:56.526 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.539+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:56.579 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.593+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T10:04:56.623 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.637+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:56.641 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.652+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:56.647 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.661+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:56.688 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.702+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T10:04:56.731 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.744+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:56.750 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.763+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:56.761 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.775+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:56.802 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.816+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T10:04:56.874 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.888+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:56.900 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.914+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:56.913 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.927+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:56.968 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:56.982+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T10:04:57.011 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:57.025+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:57.030 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:57.044+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:04:57.039 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:57.053+0000 7fee0e7b2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:04:57.125 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:57.139+0000 7fee0e7b2ec0 20 remove_watcher() i=0 2019-12-09T10:04:57.126 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:57.139+0000 7fee0e7b2ec0 2 removed watcher, disabling cache 2019-12-09T10:04:57.163 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:57.176+0000 7fee0e7b2ec0 20 remove_watcher() i=1 2019-12-09T10:04:57.201 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:57.215+0000 7fee0e7b2ec0 20 remove_watcher() i=2 2019-12-09T10:04:57.229 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:57.243+0000 7fee0e7b2ec0 20 remove_watcher() i=3 2019-12-09T10:04:57.277 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:57.291+0000 7fee0e7b2ec0 20 remove_watcher() i=4 2019-12-09T10:04:57.319 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:57.333+0000 7fee0e7b2ec0 20 remove_watcher() i=5 2019-12-09T10:04:57.366 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:57.379+0000 7fee0e7b2ec0 20 remove_watcher() i=6 2019-12-09T10:04:57.404 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:04:57.418+0000 7fee0e7b2ec0 20 remove_watcher() i=7 2019-12-09T10:04:57.413 INFO:teuthology.orchestra.run.smithi121:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2019-12-09T10:04:57.918 INFO:teuthology.orchestra.run.smithi121.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2019-12-09T10:05:00.817 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.pom 2019-12-09T10:05:01.018 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.jar 2019-12-09T10:05:02.020 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :clean UP-TO-DATE 2019-12-09T10:05:02.117 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-bom/1.11.549/aws-java-sdk-bom-1.11.549.pom 2019-12-09T10:05:02.217 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.549/aws-java-sdk-pom-1.11.549.pom 2019-12-09T10:05:02.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.pom 2019-12-09T10:05:02.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.pom 2019-12-09T10:05:02.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.pom 2019-12-09T10:05:02.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.pom 2019-12-09T10:05:02.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.pom 2019-12-09T10:05:02.420 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.pom 2019-12-09T10:05:02.420 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.pom 2019-12-09T10:05:02.420 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-parent/2.44.0/selenium-parent-2.44.0.pom 2019-12-09T10:05:02.420 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/3/oss-parent-3.pom 2019-12-09T10:05:02.420 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.pom 2019-12-09T10:05:02.420 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.pom 2019-12-09T10:05:02.420 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.pom 2019-12-09T10:05:02.421 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.pom 2019-12-09T10:05:02.421 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.pom 2019-12-09T10:05:02.421 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.pom 2019-12-09T10:05:02.421 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.5/httpcomponents-client-4.5.5.pom 2019-12-09T10:05:02.421 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.2/jackson-parent-2.6.2.pom 2019-12-09T10:05:02.421 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/28/commons-parent-28.pom 2019-12-09T10:05:02.421 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/24/oss-parent-24.pom 2019-12-09T10:05:02.422 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/10/httpcomponents-parent-10.pom 2019-12-09T10:05:02.517 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2019-12-09T10:05:02.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2019-12-09T10:05:02.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.pom 2019-12-09T10:05:02.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.pom 2019-12-09T10:05:02.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.pom 2019-12-09T10:05:02.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.pom 2019-12-09T10:05:02.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.pom 2019-12-09T10:05:02.618 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.pom 2019-12-09T10:05:02.618 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.pom 2019-12-09T10:05:02.618 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.pom 2019-12-09T10:05:02.619 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.pom 2019-12-09T10:05:02.619 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.pom 2019-12-09T10:05:02.619 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.pom 2019-12-09T10:05:02.619 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.pom 2019-12-09T10:05:02.619 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.pom 2019-12-09T10:05:02.619 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.pom 2019-12-09T10:05:02.620 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.pom 2019-12-09T10:05:02.620 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.pom 2019-12-09T10:05:02.620 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.pom 2019-12-09T10:05:02.620 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.pom 2019-12-09T10:05:02.620 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.pom 2019-12-09T10:05:02.620 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.pom 2019-12-09T10:05:02.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.pom 2019-12-09T10:05:02.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.pom 2019-12-09T10:05:02.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.pom 2019-12-09T10:05:02.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.pom 2019-12-09T10:05:02.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.pom 2019-12-09T10:05:02.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.pom 2019-12-09T10:05:02.723 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.pom 2019-12-09T10:05:02.723 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.pom 2019-12-09T10:05:02.723 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.pom 2019-12-09T10:05:02.723 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.pom 2019-12-09T10:05:02.724 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.pom 2019-12-09T10:05:02.724 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.pom 2019-12-09T10:05:02.724 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.pom 2019-12-09T10:05:02.724 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.pom 2019-12-09T10:05:02.724 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.pom 2019-12-09T10:05:02.728 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.pom 2019-12-09T10:05:02.728 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.pom 2019-12-09T10:05:02.728 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.pom 2019-12-09T10:05:02.729 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.pom 2019-12-09T10:05:02.729 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.pom 2019-12-09T10:05:02.729 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.pom 2019-12-09T10:05:02.729 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.pom 2019-12-09T10:05:02.729 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.pom 2019-12-09T10:05:02.729 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.pom 2019-12-09T10:05:02.729 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.pom 2019-12-09T10:05:02.730 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.pom 2019-12-09T10:05:02.730 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.pom 2019-12-09T10:05:02.730 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.pom 2019-12-09T10:05:02.730 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.pom 2019-12-09T10:05:02.730 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.pom 2019-12-09T10:05:02.730 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.pom 2019-12-09T10:05:02.730 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.pom 2019-12-09T10:05:02.731 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.pom 2019-12-09T10:05:02.731 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.pom 2019-12-09T10:05:02.732 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.pom 2019-12-09T10:05:02.732 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.pom 2019-12-09T10:05:02.732 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.pom 2019-12-09T10:05:02.732 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.pom 2019-12-09T10:05:02.732 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.pom 2019-12-09T10:05:02.733 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.pom 2019-12-09T10:05:02.733 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.pom 2019-12-09T10:05:02.733 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.pom 2019-12-09T10:05:02.733 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.pom 2019-12-09T10:05:02.733 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.pom 2019-12-09T10:05:02.733 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.pom 2019-12-09T10:05:02.733 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.pom 2019-12-09T10:05:02.734 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.pom 2019-12-09T10:05:02.734 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.pom 2019-12-09T10:05:02.822 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.pom 2019-12-09T10:05:02.822 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.pom 2019-12-09T10:05:02.822 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.pom 2019-12-09T10:05:02.822 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.pom 2019-12-09T10:05:02.822 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.pom 2019-12-09T10:05:02.822 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.pom 2019-12-09T10:05:02.823 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.pom 2019-12-09T10:05:02.823 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.pom 2019-12-09T10:05:02.823 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.pom 2019-12-09T10:05:02.823 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.pom 2019-12-09T10:05:02.823 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.pom 2019-12-09T10:05:02.823 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.pom 2019-12-09T10:05:02.823 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.pom 2019-12-09T10:05:02.824 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.pom 2019-12-09T10:05:02.824 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.pom 2019-12-09T10:05:02.824 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.pom 2019-12-09T10:05:02.824 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.pom 2019-12-09T10:05:02.824 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.pom 2019-12-09T10:05:02.824 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.pom 2019-12-09T10:05:02.824 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.pom 2019-12-09T10:05:02.825 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.pom 2019-12-09T10:05:02.825 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.pom 2019-12-09T10:05:02.825 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.pom 2019-12-09T10:05:02.825 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.pom 2019-12-09T10:05:02.825 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.pom 2019-12-09T10:05:02.825 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.pom 2019-12-09T10:05:02.825 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.pom 2019-12-09T10:05:02.826 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.pom 2019-12-09T10:05:02.827 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.pom 2019-12-09T10:05:02.827 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.pom 2019-12-09T10:05:02.827 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.pom 2019-12-09T10:05:02.827 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.pom 2019-12-09T10:05:02.827 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.pom 2019-12-09T10:05:02.827 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.pom 2019-12-09T10:05:02.828 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.pom 2019-12-09T10:05:02.828 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.pom 2019-12-09T10:05:02.828 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.pom 2019-12-09T10:05:02.828 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.pom 2019-12-09T10:05:02.828 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.pom 2019-12-09T10:05:02.921 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.pom 2019-12-09T10:05:02.921 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.pom 2019-12-09T10:05:02.921 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.pom 2019-12-09T10:05:02.921 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.pom 2019-12-09T10:05:02.922 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.pom 2019-12-09T10:05:02.922 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.pom 2019-12-09T10:05:02.922 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.pom 2019-12-09T10:05:02.922 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.pom 2019-12-09T10:05:02.922 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.pom 2019-12-09T10:05:02.922 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.pom 2019-12-09T10:05:02.922 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.pom 2019-12-09T10:05:02.923 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.pom 2019-12-09T10:05:02.923 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.pom 2019-12-09T10:05:02.923 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.pom 2019-12-09T10:05:02.923 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.pom 2019-12-09T10:05:02.923 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.pom 2019-12-09T10:05:02.923 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.pom 2019-12-09T10:05:02.923 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.pom 2019-12-09T10:05:02.924 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.pom 2019-12-09T10:05:02.924 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.pom 2019-12-09T10:05:02.924 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.pom 2019-12-09T10:05:02.924 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.pom 2019-12-09T10:05:02.924 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.pom 2019-12-09T10:05:02.924 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.pom 2019-12-09T10:05:02.924 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.pom 2019-12-09T10:05:02.925 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.pom 2019-12-09T10:05:02.925 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.pom 2019-12-09T10:05:02.925 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.pom 2019-12-09T10:05:02.925 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.pom 2019-12-09T10:05:02.925 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.pom 2019-12-09T10:05:02.925 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.pom 2019-12-09T10:05:02.925 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.pom 2019-12-09T10:05:02.926 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.pom 2019-12-09T10:05:02.926 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.pom 2019-12-09T10:05:02.926 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.pom 2019-12-09T10:05:02.926 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.pom 2019-12-09T10:05:02.926 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.pom 2019-12-09T10:05:02.926 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.pom 2019-12-09T10:05:02.926 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.pom 2019-12-09T10:05:02.927 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.pom 2019-12-09T10:05:02.927 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.pom 2019-12-09T10:05:03.018 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.pom 2019-12-09T10:05:03.018 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.pom 2019-12-09T10:05:03.018 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.pom 2019-12-09T10:05:03.018 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.pom 2019-12-09T10:05:03.019 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.pom 2019-12-09T10:05:03.019 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.pom 2019-12-09T10:05:03.019 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.pom 2019-12-09T10:05:03.020 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.pom 2019-12-09T10:05:03.020 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.pom 2019-12-09T10:05:03.020 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.pom 2019-12-09T10:05:03.020 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.pom 2019-12-09T10:05:03.020 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.pom 2019-12-09T10:05:03.021 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.pom 2019-12-09T10:05:03.021 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.pom 2019-12-09T10:05:03.021 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.pom 2019-12-09T10:05:03.021 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.pom 2019-12-09T10:05:03.021 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.pom 2019-12-09T10:05:03.021 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.22/aws-java-sdk-pom-1.11.22.pom 2019-12-09T10:05:03.021 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.pom 2019-12-09T10:05:03.022 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.pom 2019-12-09T10:05:03.022 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.pom 2019-12-09T10:05:03.022 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.pom 2019-12-09T10:05:03.022 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.pom 2019-12-09T10:05:03.022 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.pom 2019-12-09T10:05:03.022 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.pom 2019-12-09T10:05:03.022 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.pom 2019-12-09T10:05:03.022 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.pom 2019-12-09T10:05:03.118 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.9/commons-codec-1.9.pom 2019-12-09T10:05:03.118 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.pom 2019-12-09T10:05:03.118 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/project/6.1.9/project-6.1.9.pom 2019-12-09T10:05:03.118 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/32/commons-parent-32.pom 2019-12-09T10:05:03.119 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.pom 2019-12-09T10:05:03.119 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.pom 2019-12-09T10:05:03.119 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.pom 2019-12-09T10:05:03.119 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/beanshell/2.0b4/beanshell-2.0b4.pom 2019-12-09T10:05:03.119 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.pom 2019-12-09T10:05:03.119 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/34/commons-parent-34.pom 2019-12-09T10:05:03.218 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.pom 2019-12-09T10:05:03.218 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/35/commons-parent-35.pom 2019-12-09T10:05:03.218 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2019-12-09T10:05:03.219 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.pom 2019-12-09T10:05:03.219 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.9/httpcomponents-core-4.4.9.pom 2019-12-09T10:05:03.219 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/9/httpcomponents-parent-9.pom 2019-12-09T10:05:03.220 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.pom 2019-12-09T10:05:03.220 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.pom 2019-12-09T10:05:03.318 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.1/jackson-parent-2.6.1.pom 2019-12-09T10:05:03.318 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/23/oss-parent-23.pom 2019-12-09T10:05:03.318 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.pom 2019-12-09T10:05:03.318 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.pom 2019-12-09T10:05:03.318 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-parent/4.1.17.Final/netty-parent-4.1.17.Final.pom 2019-12-09T10:05:03.319 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2019-12-09T10:05:03.418 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.pom 2019-12-09T10:05:03.418 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.pom 2019-12-09T10:05:03.418 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.pom 2019-12-09T10:05:03.418 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.pom 2019-12-09T10:05:03.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.pom 2019-12-09T10:05:03.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.pom 2019-12-09T10:05:03.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.pom 2019-12-09T10:05:03.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/6/oss-parent-6.pom 2019-12-09T10:05:03.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.pom 2019-12-09T10:05:03.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.pom 2019-12-09T10:05:03.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.pom 2019-12-09T10:05:03.420 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.pom 2019-12-09T10:05:03.420 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.pom 2019-12-09T10:05:03.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.pom 2019-12-09T10:05:03.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.pom 2019-12-09T10:05:03.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/17/commons-parent-17.pom 2019-12-09T10:05:03.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/25/commons-parent-25.pom 2019-12-09T10:05:03.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/7/apache-7.pom 2019-12-09T10:05:03.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/9/apache-9.pom 2019-12-09T10:05:03.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.pom 2019-12-09T10:05:03.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.pom 2019-12-09T10:05:03.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.pom 2019-12-09T10:05:03.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2019-12-09T10:05:03.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.pom 2019-12-09T10:05:03.618 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.pom 2019-12-09T10:05:03.618 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.pom 2019-12-09T10:05:03.618 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.pom 2019-12-09T10:05:03.618 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.pom 2019-12-09T10:05:03.619 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.pom 2019-12-09T10:05:03.623 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/18.0/guava-parent-18.0.pom 2019-12-09T10:05:03.623 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.pom 2019-12-09T10:05:03.623 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.pom 2019-12-09T10:05:03.623 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.pom 2019-12-09T10:05:03.623 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.pom 2019-12-09T10:05:03.623 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.pom 2019-12-09T10:05:03.624 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.pom 2019-12-09T10:05:03.624 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.pom 2019-12-09T10:05:03.624 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.pom 2019-12-09T10:05:03.624 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/9/commons-parent-9.pom 2019-12-09T10:05:03.624 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.pom 2019-12-09T10:05:03.624 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/33/commons-parent-33.pom 2019-12-09T10:05:03.625 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.3.3/httpcomponents-client-4.3.3.pom 2019-12-09T10:05:03.625 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/4/apache-4.pom 2019-12-09T10:05:03.625 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-project/8.1.15.v20140411/jetty-project-8.1.15.v20140411.pom 2019-12-09T10:05:03.625 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/project/7/project-7.pom 2019-12-09T10:05:03.625 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-parent/20/jetty-parent-20.pom 2019-12-09T10:05:03.718 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.pom 2019-12-09T10:05:03.718 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.pom 2019-12-09T10:05:03.718 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.pom 2019-12-09T10:05:03.718 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.pom 2019-12-09T10:05:03.718 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.pom 2019-12-09T10:05:03.719 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.pom 2019-12-09T10:05:04.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.jar 2019-12-09T10:05:04.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.jar 2019-12-09T10:05:04.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.jar 2019-12-09T10:05:04.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.jar 2019-12-09T10:05:04.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.jar 2019-12-09T10:05:04.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.jar 2019-12-09T10:05:04.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.jar 2019-12-09T10:05:04.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.jar 2019-12-09T10:05:04.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.jar 2019-12-09T10:05:04.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.jar 2019-12-09T10:05:04.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.jar 2019-12-09T10:05:04.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.jar 2019-12-09T10:05:04.520 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.jar 2019-12-09T10:05:04.520 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.jar 2019-12-09T10:05:04.520 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.jar 2019-12-09T10:05:04.620 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.jar 2019-12-09T10:05:04.620 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.jar 2019-12-09T10:05:04.620 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.jar 2019-12-09T10:05:04.620 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.jar 2019-12-09T10:05:04.620 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.jar 2019-12-09T10:05:04.620 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.jar 2019-12-09T10:05:04.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.jar 2019-12-09T10:05:04.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.jar 2019-12-09T10:05:04.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.jar 2019-12-09T10:05:04.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.jar 2019-12-09T10:05:04.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.jar 2019-12-09T10:05:04.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.jar 2019-12-09T10:05:04.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.jar 2019-12-09T10:05:04.622 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.jar 2019-12-09T10:05:04.622 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.jar 2019-12-09T10:05:04.622 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.jar 2019-12-09T10:05:04.622 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.jar 2019-12-09T10:05:04.622 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.jar 2019-12-09T10:05:04.622 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.jar 2019-12-09T10:05:04.622 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.jar 2019-12-09T10:05:04.623 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.jar 2019-12-09T10:05:04.623 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.jar 2019-12-09T10:05:04.623 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.jar 2019-12-09T10:05:04.623 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.jar 2019-12-09T10:05:04.623 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.jar 2019-12-09T10:05:04.623 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.jar 2019-12-09T10:05:04.623 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.jar 2019-12-09T10:05:04.719 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.jar 2019-12-09T10:05:04.720 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.jar 2019-12-09T10:05:04.720 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.jar 2019-12-09T10:05:04.720 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.jar 2019-12-09T10:05:04.720 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.jar 2019-12-09T10:05:04.720 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.jar 2019-12-09T10:05:04.720 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.jar 2019-12-09T10:05:04.721 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.jar 2019-12-09T10:05:04.721 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.jar 2019-12-09T10:05:04.721 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.jar 2019-12-09T10:05:04.721 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.jar 2019-12-09T10:05:04.721 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.jar 2019-12-09T10:05:04.721 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.jar 2019-12-09T10:05:04.721 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.jar 2019-12-09T10:05:04.722 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.jar 2019-12-09T10:05:04.722 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.jar 2019-12-09T10:05:04.722 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.jar 2019-12-09T10:05:04.722 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.jar 2019-12-09T10:05:04.722 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.jar 2019-12-09T10:05:04.722 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.jar 2019-12-09T10:05:04.722 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.jar 2019-12-09T10:05:04.723 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.jar 2019-12-09T10:05:04.723 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.jar 2019-12-09T10:05:04.723 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.jar 2019-12-09T10:05:04.819 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.jar 2019-12-09T10:05:04.819 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.jar 2019-12-09T10:05:04.819 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.jar 2019-12-09T10:05:04.819 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.jar 2019-12-09T10:05:04.819 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.jar 2019-12-09T10:05:04.819 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.jar 2019-12-09T10:05:04.820 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.jar 2019-12-09T10:05:04.820 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.jar 2019-12-09T10:05:04.820 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.jar 2019-12-09T10:05:04.820 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.jar 2019-12-09T10:05:04.820 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.jar 2019-12-09T10:05:04.820 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.jar 2019-12-09T10:05:04.820 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.jar 2019-12-09T10:05:04.821 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.jar 2019-12-09T10:05:04.821 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.jar 2019-12-09T10:05:04.821 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.jar 2019-12-09T10:05:04.919 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.jar 2019-12-09T10:05:04.919 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.jar 2019-12-09T10:05:04.919 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.jar 2019-12-09T10:05:04.919 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.jar 2019-12-09T10:05:04.919 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.jar 2019-12-09T10:05:04.920 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.jar 2019-12-09T10:05:04.920 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.jar 2019-12-09T10:05:04.920 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.jar 2019-12-09T10:05:04.920 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.jar 2019-12-09T10:05:04.920 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.jar 2019-12-09T10:05:04.920 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.jar 2019-12-09T10:05:04.921 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.jar 2019-12-09T10:05:04.921 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.jar 2019-12-09T10:05:04.921 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.jar 2019-12-09T10:05:04.921 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.jar 2019-12-09T10:05:04.921 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.jar 2019-12-09T10:05:04.921 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.jar 2019-12-09T10:05:04.921 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.jar 2019-12-09T10:05:05.017 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.jar 2019-12-09T10:05:05.018 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.jar 2019-12-09T10:05:05.018 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.jar 2019-12-09T10:05:05.018 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.jar 2019-12-09T10:05:05.018 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.jar 2019-12-09T10:05:05.018 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.jar 2019-12-09T10:05:05.117 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.jar 2019-12-09T10:05:05.118 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.jar 2019-12-09T10:05:05.118 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.jar 2019-12-09T10:05:05.118 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.jar 2019-12-09T10:05:05.118 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.jar 2019-12-09T10:05:05.118 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.jar 2019-12-09T10:05:05.119 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.jar 2019-12-09T10:05:05.119 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.jar 2019-12-09T10:05:05.119 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.jar 2019-12-09T10:05:05.119 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.jar 2019-12-09T10:05:05.119 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.jar 2019-12-09T10:05:05.119 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.jar 2019-12-09T10:05:05.119 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.jar 2019-12-09T10:05:05.120 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.jar 2019-12-09T10:05:05.120 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.jar 2019-12-09T10:05:05.120 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.jar 2019-12-09T10:05:05.120 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.jar 2019-12-09T10:05:05.120 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.jar 2019-12-09T10:05:05.120 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.jar 2019-12-09T10:05:05.218 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.jar 2019-12-09T10:05:05.219 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.jar 2019-12-09T10:05:05.219 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.jar 2019-12-09T10:05:05.219 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.jar 2019-12-09T10:05:05.219 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.jar 2019-12-09T10:05:05.219 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.jar 2019-12-09T10:05:05.219 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.jar 2019-12-09T10:05:05.219 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.jar 2019-12-09T10:05:05.220 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.jar 2019-12-09T10:05:05.220 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.jar 2019-12-09T10:05:05.220 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.jar 2019-12-09T10:05:05.317 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.jar 2019-12-09T10:05:05.318 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.jar 2019-12-09T10:05:05.318 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.jar 2019-12-09T10:05:05.318 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.jar 2019-12-09T10:05:05.318 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.jar 2019-12-09T10:05:05.318 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.jar 2019-12-09T10:05:05.319 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.jar 2019-12-09T10:05:05.319 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.jar 2019-12-09T10:05:05.319 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.jar 2019-12-09T10:05:05.319 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.jar 2019-12-09T10:05:05.320 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.jar 2019-12-09T10:05:05.320 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.jar 2019-12-09T10:05:05.418 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.jar 2019-12-09T10:05:05.418 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.jar 2019-12-09T10:05:05.418 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.jar 2019-12-09T10:05:05.418 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.jar 2019-12-09T10:05:05.418 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.jar 2019-12-09T10:05:05.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.jar 2019-12-09T10:05:05.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.jar 2019-12-09T10:05:05.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.jar 2019-12-09T10:05:05.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.jar 2019-12-09T10:05:05.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.jar 2019-12-09T10:05:05.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.jar 2019-12-09T10:05:05.419 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.jar 2019-12-09T10:05:05.420 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.jar 2019-12-09T10:05:05.420 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.jar 2019-12-09T10:05:05.420 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.jar 2019-12-09T10:05:05.420 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.jar 2019-12-09T10:05:05.420 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.jar 2019-12-09T10:05:05.420 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.jar 2019-12-09T10:05:05.421 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.jar 2019-12-09T10:05:05.421 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.jar 2019-12-09T10:05:05.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.jar 2019-12-09T10:05:05.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.jar 2019-12-09T10:05:05.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.jar 2019-12-09T10:05:05.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.jar 2019-12-09T10:05:05.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.jar 2019-12-09T10:05:05.518 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.jar 2019-12-09T10:05:05.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.jar 2019-12-09T10:05:05.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.jar 2019-12-09T10:05:05.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.jar 2019-12-09T10:05:05.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.jar 2019-12-09T10:05:05.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.jar 2019-12-09T10:05:05.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.jar 2019-12-09T10:05:05.519 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.jar 2019-12-09T10:05:05.520 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.jar 2019-12-09T10:05:05.520 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.jar 2019-12-09T10:05:05.520 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.jar 2019-12-09T10:05:05.520 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.jar 2019-12-09T10:05:05.520 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.jar 2019-12-09T10:05:05.521 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.jar 2019-12-09T10:05:05.521 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.jar 2019-12-09T10:05:05.618 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.jar 2019-12-09T10:05:05.618 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.jar 2019-12-09T10:05:05.618 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.jar 2019-12-09T10:05:05.618 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.jar 2019-12-09T10:05:05.619 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.jar 2019-12-09T10:05:05.619 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.jar 2019-12-09T10:05:05.619 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.jar 2019-12-09T10:05:05.619 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.jar 2019-12-09T10:05:05.620 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.jar 2019-12-09T10:05:05.620 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.jar 2019-12-09T10:05:05.620 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.jar 2019-12-09T10:05:05.620 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.jar 2019-12-09T10:05:05.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.jar 2019-12-09T10:05:05.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.jar 2019-12-09T10:05:05.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.jar 2019-12-09T10:05:05.621 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.jar 2019-12-09T10:05:05.718 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.jar 2019-12-09T10:05:05.718 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.jar 2019-12-09T10:05:05.718 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.jar 2019-12-09T10:05:05.718 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.jar 2019-12-09T10:05:05.719 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.jar 2019-12-09T10:05:05.719 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.jar 2019-12-09T10:05:05.719 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.jar 2019-12-09T10:05:05.719 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.jar 2019-12-09T10:05:05.719 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.jar 2019-12-09T10:05:05.719 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.jar 2019-12-09T10:05:05.719 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.jar 2019-12-09T10:05:05.720 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.jar 2019-12-09T10:05:05.720 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.jar 2019-12-09T10:05:05.720 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.jar 2019-12-09T10:05:05.720 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.jar 2019-12-09T10:05:05.720 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.jar 2019-12-09T10:05:05.720 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.jar 2019-12-09T10:05:05.720 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.jar 2019-12-09T10:05:05.721 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar 2019-12-09T10:05:05.721 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar 2019-12-09T10:05:05.818 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.jar 2019-12-09T10:05:05.818 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.jar 2019-12-09T10:05:05.818 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.jar 2019-12-09T10:05:05.818 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.jar 2019-12-09T10:05:05.819 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.jar 2019-12-09T10:05:05.819 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.jar 2019-12-09T10:05:05.819 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar 2019-12-09T10:05:05.819 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.jar 2019-12-09T10:05:05.819 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.jar 2019-12-09T10:05:05.819 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.jar 2019-12-09T10:05:05.820 INFO:teuthology.orchestra.run.smithi121.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.jar 2019-12-09T10:05:14.117 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :compileJava 2019-12-09T10:05:14.220 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :processResources 2019-12-09T10:05:14.220 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :classes 2019-12-09T10:05:14.618 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:05:14.618 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :compileTestJava 2019-12-09T10:05:14.618 INFO:teuthology.orchestra.run.smithi121.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-12-09T10:05:14.618 INFO:teuthology.orchestra.run.smithi121.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-12-09T10:05:14.618 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:05:14.619 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :processTestResources NO-SOURCE 2019-12-09T10:05:14.619 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :testClasses 2019-12-09T10:05:22.417 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:05:22.418 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :test 2019-12-09T10:05:22.418 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:05:22.418 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2019-12-09T10:06:22.617 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:06:22.617 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2019-12-09T10:06:28.717 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:06:28.717 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2019-12-09T10:06:31.017 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:06:31.017 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2019-12-09T10:06:40.117 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:06:40.117 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2019-12-09T10:07:52.517 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:07:52.517 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2019-12-09T10:08:02.918 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:08:02.918 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2019-12-09T10:08:03.420 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:08:03.420 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2019-12-09T10:08:04.318 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:08:04.318 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2019-12-09T10:08:07.118 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:08:07.118 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2019-12-09T10:08:14.018 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:08:14.019 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2019-12-09T10:09:07.822 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:09:07.822 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2019-12-09T10:09:24.622 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:09:24.623 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2019-12-09T10:11:09.335 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:32:07.369 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:11:09.346 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:32:07.379 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:11:09.348 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:32:07.381 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:11:09.352 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:32:07.308 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:11:09.352 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:32:07.386 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:11:09.360 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:32:07.316 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:11:09.567 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:32:07.600 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:11:09.575 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:32:07.608 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:11:09.591 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:32:07.547 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:13:07.332 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:13:07.499 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2019-12-09T10:13:24.031 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:13:24.031 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2019-12-09T10:13:26.631 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:13:26.631 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2019-12-09T10:13:35.531 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:13:35.531 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2019-12-09T10:13:41.731 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:13:41.731 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2019-12-09T10:13:56.131 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:13:56.132 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2019-12-09T10:14:35.932 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:14:35.932 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2019-12-09T10:14:45.232 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:14:45.232 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2019-12-09T10:14:45.932 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:14:45.932 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2019-12-09T10:14:47.533 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:14:47.533 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2019-12-09T10:15:37.633 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:15:37.633 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2019-12-09T10:15:47.333 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:15:47.333 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2019-12-09T10:16:20.633 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:37:18.660 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:16:20.640 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:37:18.668 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:16:20.647 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:37:18.674 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:16:20.654 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:37:18.681 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:16:20.654 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:37:18.611 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:16:20.674 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:37:18.632 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:16:20.823 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:37:18.850 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:16:20.844 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:37:18.802 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:16:20.847 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:37:18.874 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:16:45.834 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:16:45.834 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2019-12-09T10:16:59.634 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:16:59.634 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2019-12-09T10:17:30.134 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:17:30.134 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2019-12-09T10:17:40.634 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:17:40.635 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2019-12-09T10:21:34.858 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:42:32.881 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:34.865 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:42:32.889 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:34.872 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:42:32.895 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:34.877 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:42:32.900 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:34.880 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:42:32.844 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:34.902 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:42:32.867 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:35.076 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:42:33.100 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:35.108 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:42:33.131 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:35.183 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:42:33.148 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:36.209 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:42:34.232 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:36.210 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:42:34.234 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:36.222 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:42:34.246 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:36.257 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:42:34.281 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:36.258 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:42:34.282 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:36.268 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:42:34.292 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:36.332 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:42:34.297 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:36.333 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:42:34.298 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:21:36.344 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:42:34.309 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:26:46.468 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:47:44.493 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:26:46.475 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:47:44.500 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:26:46.483 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:47:44.452 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:26:46.486 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:47:44.511 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:26:46.486 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:47:44.454 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:26:46.489 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:47:44.514 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:26:46.676 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:47:44.644 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:26:46.681 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:47:44.705 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:26:46.726 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:47:44.751 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:29:57.117 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:50:55.142 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:29:57.230 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:50:55.125 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:29:57.231 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:50:55.130 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:29:57.231 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:50:55.169 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:29:57.231 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:50:55.178 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:29:57.231 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:50:55.191 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:29:57.233 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:50:55.258 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:29:57.268 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:50:55.293 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:29:57.275 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:50:55.243 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:31:17.536 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:31:17.536 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2019-12-09T10:31:24.936 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:31:24.936 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2019-12-09T10:31:57.529 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:52:55.553 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:31:57.538 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:52:55.563 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:31:57.542 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:52:55.511 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:31:57.548 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:52:55.572 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:31:57.549 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:52:55.518 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:31:57.555 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:52:55.579 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:31:57.632 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:52:55.657 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:31:57.638 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:52:55.662 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:31:57.689 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:52:55.658 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:33:07.036 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:33:07.036 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2019-12-09T10:33:16.136 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:33:16.136 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2019-12-09T10:34:35.336 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:34:35.337 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2019-12-09T10:34:44.437 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:34:44.437 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2019-12-09T10:34:59.837 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:34:59.837 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2019-12-09T10:35:19.537 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:35:19.537 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2019-12-09T10:35:23.137 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:35:23.137 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2019-12-09T10:35:47.337 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:35:47.337 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2019-12-09T10:35:51.537 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:35:51.537 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2019-12-09T10:36:21.637 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:36:21.638 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2019-12-09T10:36:31.437 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:36:31.437 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2019-12-09T10:37:08.399 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:58:06.422 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:37:08.406 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:58:06.430 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:37:08.411 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:58:06.434 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:37:08.414 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:58:06.437 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:37:08.420 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:58:06.389 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:37:08.427 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:58:06.396 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:37:08.594 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:58:06.617 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:37:08.606 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:58:06.629 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:37:08.659 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:58:06.628 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:37:19.937 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:37:19.938 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2019-12-09T10:37:31.537 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:37:31.538 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2019-12-09T10:38:18.637 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:59:16.660 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:38:18.690 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:59:16.713 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:38:18.692 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:59:16.715 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:38:18.707 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:59:16.729 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:38:18.746 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:59:16.714 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:38:18.750 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:00:59:16.772 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:38:18.752 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:59:16.720 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:38:18.762 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:00:59:16.784 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:38:18.828 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:00:59:16.796 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:38:42.438 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:38:42.438 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2019-12-09T10:39:15.438 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:39:15.438 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2019-12-09T10:40:57.038 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:40:57.039 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2019-12-09T10:41:14.938 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:41:14.939 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2019-12-09T10:42:20.454 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:03:18.476 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:42:20.460 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:03:18.483 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:42:20.469 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:03:18.491 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:42:20.475 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:03:18.496 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:42:20.481 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:03:18.449 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:42:20.496 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:03:18.464 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:42:20.606 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:03:18.627 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:42:20.645 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:03:18.666 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:42:20.682 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:03:18.649 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:42:33.539 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:42:33.539 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2019-12-09T10:42:47.339 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:42:47.339 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2019-12-09T10:44:37.238 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:44:37.239 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2019-12-09T10:46:40.201 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:07:38.223 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:46:40.236 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:07:38.258 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:46:40.239 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:07:38.261 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:46:40.251 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:07:38.272 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:46:40.297 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:07:38.265 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:46:40.300 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:07:38.269 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:46:40.375 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:07:38.397 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:46:40.429 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:07:38.451 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:46:40.463 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:07:38.432 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:47:31.810 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:08:29.832 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:47:31.817 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:08:29.839 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:47:31.831 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:08:29.853 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:47:31.835 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:08:29.856 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:47:31.838 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:08:29.807 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:47:31.866 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:08:29.835 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:47:31.893 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:08:29.914 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:47:31.904 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:08:29.926 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:47:31.964 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:08:29.933 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:52:15.538 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:52:15.538 INFO:teuthology.orchestra.run.smithi121.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2019-12-09T10:52:46.369 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:13:44.391 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:52:46.382 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:13:44.404 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:52:46.388 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:13:44.411 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:52:46.392 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:13:44.415 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:52:46.397 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:13:44.367 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:52:46.430 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:13:44.401 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:52:46.570 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:13:44.593 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:52:46.572 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:13:44.595 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:52:46.717 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:13:44.688 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:53:36.438 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:53:36.438 INFO:teuthology.orchestra.run.smithi121.stdout:---------------------------------------------------------------------- 2019-12-09T10:53:36.438 INFO:teuthology.orchestra.run.smithi121.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2019-12-09T10:53:36.438 INFO:teuthology.orchestra.run.smithi121.stdout:---------------------------------------------------------------------- 2019-12-09T10:53:36.660 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:53:36.660 INFO:teuthology.orchestra.run.smithi121.stdout:BUILD SUCCESSFUL in 48m 39s 2019-12-09T10:53:36.660 INFO:teuthology.orchestra.run.smithi121.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2019-12-09T10:53:36.978 INFO:teuthology.orchestra.run.smithi121:> radosgw-admin gc process --include-all 2019-12-09T10:53:37.162 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.154+0000 7f07c6eefec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:37.193 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.186+0000 7f07c6eefec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:53:37.193 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.186+0000 7f07c6eefec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:37.200 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.193+0000 7f07c6eefec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:53:37.200 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.193+0000 7f07c6eefec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:37.209 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.203+0000 7f07c6eefec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:53:37.209 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.203+0000 7f07c6eefec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:37.228 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.222+0000 7f07c6eefec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:53:37.418 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.411+0000 7f07c6eefec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T10:53:37.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.411+0000 7f07c6eefec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T10:53:37.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.411+0000 7f07c6eefec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T10:53:37.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.411+0000 7f07c6eefec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T10:53:37.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.411+0000 7f07c6eefec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:37.434 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.428+0000 7f07c6eefec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:53:37.434 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.428+0000 7f07c6eefec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:37.448 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.441+0000 7f07c6eefec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:53:37.448 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.441+0000 7f07c6eefec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:37.459 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.453+0000 7f07c6eefec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:53:37.460 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.453+0000 7f07c6eefec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:37.468 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.461+0000 7f07c6eefec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:53:37.468 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.461+0000 7f07c6eefec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:37.480 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.470+0000 7f07c6eefec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:53:37.480 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.470+0000 7f07c6eefec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T10:53:37.480 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.470+0000 7f07c6eefec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:37.483 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.477+0000 7f07c6eefec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:53:37.483 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.477+0000 7f07c6eefec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:37.495 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.488+0000 7f07c6eefec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:53:37.495 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.488+0000 7f07c6eefec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:37.502 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.495+0000 7f07c6eefec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:53:37.502 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.495+0000 7f07c6eefec0 20 zonegroup default 2019-12-09T10:53:37.502 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.495+0000 7f07c6eefec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:37.509 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.502+0000 7f07c6eefec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:53:37.509 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.502+0000 7f07c6eefec0 10 Cannot find current period zone using local zone 2019-12-09T10:53:37.509 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.502+0000 7f07c6eefec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:37.515 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.509+0000 7f07c6eefec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:53:37.516 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.509+0000 7f07c6eefec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:37.525 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.518+0000 7f07c6eefec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:53:37.525 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.518+0000 7f07c6eefec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:37.535 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.528+0000 7f07c6eefec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:53:37.535 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.528+0000 7f07c6eefec0 20 zone default found 2019-12-09T10:53:37.536 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.528+0000 7f07c6eefec0 20 started sync module instance, tier type = 2019-12-09T10:53:37.536 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.528+0000 7f07c6eefec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T10:53:37.894 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.888+0000 7f07c6eefec0 20 add_watcher() i=0 2019-12-09T10:53:37.895 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.888+0000 7f07c6eefec0 20 add_watcher() i=1 2019-12-09T10:53:37.895 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.888+0000 7f07c6eefec0 20 add_watcher() i=2 2019-12-09T10:53:37.895 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.888+0000 7f07c6eefec0 20 add_watcher() i=3 2019-12-09T10:53:37.895 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.888+0000 7f07c6eefec0 20 add_watcher() i=4 2019-12-09T10:53:37.895 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.888+0000 7f07c6eefec0 20 add_watcher() i=5 2019-12-09T10:53:37.903 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.896+0000 7f07c6eefec0 20 add_watcher() i=6 2019-12-09T10:53:37.935 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.928+0000 7f07c6eefec0 20 add_watcher() i=7 2019-12-09T10:53:37.935 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.928+0000 7f07c6eefec0 2 all 8 watchers are set, enabling cache 2019-12-09T10:53:37.935 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.928+0000 7f0784fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T10:53:37.937 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.931+0000 7f07b4119700 0 -- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5643ed009870 msgr2=0x5643ed00d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T10:53:37.984 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:37.977+0000 7f07abfff700 0 -- 172.21.15.121:0/3763752754 >> [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] conn(0x5643ed050f80 msgr2=0x5643ed0533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T10:53:39.729 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:39.723+0000 7f06f6ffd700 20 reqs_thread_entry: start 2019-12-09T10:53:39.730 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:39.723+0000 7f06f4ff9700 20 reqs_thread_entry: start 2019-12-09T10:53:39.730 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:39.723+0000 7f07c6eefec0 20 init_complete bucket index max shards: 0 2019-12-09T10:53:39.731 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:39.724+0000 7f06eaffd700 20 reqs_thread_entry: start 2019-12-09T10:53:39.731 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:39.724+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T10:53:39.821 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:39.814+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:39.853 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:39.847+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:39.866 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:39.859+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:39.972 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:39.965+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T10:53:40.033 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.027+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:40.052 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.045+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:40.060 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.054+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:40.102 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.095+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T10:53:40.205 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.199+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:40.226 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.220+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:40.247 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.240+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T10:53:40.247 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.240+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='2~DKsIAQXk0PUBaAKQpQDF5aZLKWe_upO', time=2019-12-09T12:06:21.663351+0000, chain.objs.size()=9 2019-12-09T10:53:40.247 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.240+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.13__multipart_key1.2~DKsIAQXk0PUBaAKQpQDF5aZLKWe_upO.1 2019-12-09T10:53:40.248 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.240+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.13__shadow_key1.2~DKsIAQXk0PUBaAKQpQDF5aZLKWe_upO.1_1 2019-12-09T10:53:40.248 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.240+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.13__multipart_key1.2~DKsIAQXk0PUBaAKQpQDF5aZLKWe_upO.2 2019-12-09T10:53:40.248 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.240+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.13__shadow_key1.2~DKsIAQXk0PUBaAKQpQDF5aZLKWe_upO.2_1 2019-12-09T10:53:40.248 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.240+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.13__multipart_key1.2~DKsIAQXk0PUBaAKQpQDF5aZLKWe_upO.3 2019-12-09T10:53:40.248 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.240+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.13__shadow_key1.2~DKsIAQXk0PUBaAKQpQDF5aZLKWe_upO.3_1 2019-12-09T10:53:40.248 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.240+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.13__multipart_key1.2~DKsIAQXk0PUBaAKQpQDF5aZLKWe_upO.4 2019-12-09T10:53:40.248 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.240+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.13__shadow_key1.2~DKsIAQXk0PUBaAKQpQDF5aZLKWe_upO.4_1 2019-12-09T10:53:40.249 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.240+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.13__multipart_key1.2~DKsIAQXk0PUBaAKQpQDF5aZLKWe_upO.5 2019-12-09T10:53:40.249 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.240+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.439', time=2019-12-09T12:11:19.285066+0000, chain.objs.size()=9 2019-12-09T10:53:40.249 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.240+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~8ESPzXlND5NPaJOiip0ERfVsqEQNIM2.1 2019-12-09T10:53:40.249 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.240+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~8ESPzXlND5NPaJOiip0ERfVsqEQNIM2.1_1 2019-12-09T10:53:40.249 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.240+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~8ESPzXlND5NPaJOiip0ERfVsqEQNIM2.2 2019-12-09T10:53:40.435 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.428+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~8ESPzXlND5NPaJOiip0ERfVsqEQNIM2.2_1 2019-12-09T10:53:40.469 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.462+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~8ESPzXlND5NPaJOiip0ERfVsqEQNIM2.3 2019-12-09T10:53:40.469 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.462+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~8ESPzXlND5NPaJOiip0ERfVsqEQNIM2.3_1 2019-12-09T10:53:40.469 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.462+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~8ESPzXlND5NPaJOiip0ERfVsqEQNIM2.4 2019-12-09T10:53:40.470 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.462+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~8ESPzXlND5NPaJOiip0ERfVsqEQNIM2.4_1 2019-12-09T10:53:40.470 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.462+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~8ESPzXlND5NPaJOiip0ERfVsqEQNIM2.5 2019-12-09T10:53:40.697 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.690+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:40.782 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.775+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T10:53:40.821 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.815+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:40.843 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.837+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:40.867 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.860+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T10:53:40.867 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.860+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.447', time=2019-12-09T12:12:02.450498+0000, chain.objs.size()=9 2019-12-09T10:53:40.868 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.860+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~ctsk6ddxcA3KW0s-9XUhWVhEN68dZt-.1 2019-12-09T10:53:40.868 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.860+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~ctsk6ddxcA3KW0s-9XUhWVhEN68dZt-.1_1 2019-12-09T10:53:40.868 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.860+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~ctsk6ddxcA3KW0s-9XUhWVhEN68dZt-.2 2019-12-09T10:53:40.868 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.860+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~ctsk6ddxcA3KW0s-9XUhWVhEN68dZt-.2_1 2019-12-09T10:53:40.868 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.860+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~ctsk6ddxcA3KW0s-9XUhWVhEN68dZt-.3 2019-12-09T10:53:40.868 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.860+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~ctsk6ddxcA3KW0s-9XUhWVhEN68dZt-.3_1 2019-12-09T10:53:40.869 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.860+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~ctsk6ddxcA3KW0s-9XUhWVhEN68dZt-.4 2019-12-09T10:53:40.869 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.860+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~ctsk6ddxcA3KW0s-9XUhWVhEN68dZt-.4_1 2019-12-09T10:53:40.869 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.860+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~ctsk6ddxcA3KW0s-9XUhWVhEN68dZt-.5 2019-12-09T10:53:40.869 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.860+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.667', time=2019-12-09T12:34:38.047100+0000, chain.objs.size()=9 2019-12-09T10:53:40.869 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.860+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.30__multipart_key1.2~i5f5L1fMZclNOj1zL0LGAyf4LbFF2Mj.1 2019-12-09T10:53:40.869 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.860+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.30__shadow_key1.2~i5f5L1fMZclNOj1zL0LGAyf4LbFF2Mj.1_1 2019-12-09T10:53:40.869 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:40.860+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.30__multipart_key1.2~i5f5L1fMZclNOj1zL0LGAyf4LbFF2Mj.2 2019-12-09T10:53:41.090 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.084+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.30__shadow_key1.2~i5f5L1fMZclNOj1zL0LGAyf4LbFF2Mj.2_1 2019-12-09T10:53:41.091 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.084+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.30__multipart_key1.2~i5f5L1fMZclNOj1zL0LGAyf4LbFF2Mj.3 2019-12-09T10:53:41.216 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.209+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.30__shadow_key1.2~i5f5L1fMZclNOj1zL0LGAyf4LbFF2Mj.3_1 2019-12-09T10:53:41.217 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.209+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.30__multipart_key1.2~i5f5L1fMZclNOj1zL0LGAyf4LbFF2Mj.4 2019-12-09T10:53:41.217 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.209+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.30__shadow_key1.2~i5f5L1fMZclNOj1zL0LGAyf4LbFF2Mj.4_1 2019-12-09T10:53:41.217 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.209+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.30__multipart_key1.2~i5f5L1fMZclNOj1zL0LGAyf4LbFF2Mj.5 2019-12-09T10:53:41.477 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.471+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:41.574 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.567+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T10:53:41.617 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.610+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:41.633 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.626+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:41.643 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.636+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:53:41.643 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.636+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='2~f_3S8MXj9awpKDbo7MylCdItbvxHCSL', time=2019-12-09T12:53:23.439028+0000, chain.objs.size()=0 2019-12-09T10:53:41.643 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.636+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:41.729 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.720+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T10:53:41.768 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.762+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:41.784 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.777+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:41.796 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.789+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:41.841 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.834+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T10:53:41.890 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.883+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:41.909 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.902+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:41.942 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.935+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:41.988 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:41.981+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T10:53:42.060 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.054+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:42.101 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.095+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:42.120 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.113+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:42.220 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.213+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T10:53:42.269 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.263+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:42.288 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.282+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:42.308 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.301+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:42.375 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.369+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T10:53:42.455 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.448+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:42.475 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.469+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:42.497 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.490+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:53:42.497 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.490+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.455', time=2019-12-09T12:12:18.340128+0000, chain.objs.size()=9 2019-12-09T10:53:42.497 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.490+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~ffflIemaLJBUZL2iIfwoj7g8DpFQoq2.1 2019-12-09T10:53:42.497 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.490+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~ffflIemaLJBUZL2iIfwoj7g8DpFQoq2.1_1 2019-12-09T10:53:42.498 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.490+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~ffflIemaLJBUZL2iIfwoj7g8DpFQoq2.2 2019-12-09T10:53:42.498 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.490+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~ffflIemaLJBUZL2iIfwoj7g8DpFQoq2.2_1 2019-12-09T10:53:42.498 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.490+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~ffflIemaLJBUZL2iIfwoj7g8DpFQoq2.3 2019-12-09T10:53:42.498 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.490+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~ffflIemaLJBUZL2iIfwoj7g8DpFQoq2.3_1 2019-12-09T10:53:42.498 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.490+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~ffflIemaLJBUZL2iIfwoj7g8DpFQoq2.4 2019-12-09T10:53:42.498 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.490+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~ffflIemaLJBUZL2iIfwoj7g8DpFQoq2.4_1 2019-12-09T10:53:42.498 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.490+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~ffflIemaLJBUZL2iIfwoj7g8DpFQoq2.5 2019-12-09T10:53:42.729 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.723+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:42.830 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.823+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T10:53:42.883 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.876+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:42.910 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.903+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:42.924 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.917+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:53:42.924 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.917+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.467', time=2019-12-09T12:13:04.894342+0000, chain.objs.size()=7 2019-12-09T10:53:42.924 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.917+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~DJ47wgMBLvY4xUi-QBmIVLH6aPTAfPV.1 2019-12-09T10:53:42.924 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.917+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~DJ47wgMBLvY4xUi-QBmIVLH6aPTAfPV.1_1 2019-12-09T10:53:42.924 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.917+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~DJ47wgMBLvY4xUi-QBmIVLH6aPTAfPV.1_2 2019-12-09T10:53:42.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.917+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~DJ47wgMBLvY4xUi-QBmIVLH6aPTAfPV.2 2019-12-09T10:53:42.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.917+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~DJ47wgMBLvY4xUi-QBmIVLH6aPTAfPV.2_1 2019-12-09T10:53:42.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.917+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~DJ47wgMBLvY4xUi-QBmIVLH6aPTAfPV.2_2 2019-12-09T10:53:42.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:42.917+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~DJ47wgMBLvY4xUi-QBmIVLH6aPTAfPV.3 2019-12-09T10:53:43.196 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.189+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:43.309 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.302+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T10:53:43.384 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.377+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:43.401 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.395+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:43.418 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.410+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:53:43.418 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.410+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.418', time=2019-12-09T12:09:09.839746+0000, chain.objs.size()=9 2019-12-09T10:53:43.418 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.410+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__multipart_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.1 2019-12-09T10:53:43.418 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.410+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__shadow_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.1_1 2019-12-09T10:53:43.418 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.410+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__multipart_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.2 2019-12-09T10:53:43.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.410+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__shadow_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.2_1 2019-12-09T10:53:43.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.410+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__multipart_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.3 2019-12-09T10:53:43.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.411+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__shadow_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.3_1 2019-12-09T10:53:43.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.411+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__multipart_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.4 2019-12-09T10:53:43.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.411+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__shadow_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.4_1 2019-12-09T10:53:43.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.411+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__multipart_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.5 2019-12-09T10:53:43.684 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.677+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:43.777 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.771+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T10:53:43.823 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.817+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:43.842 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.836+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:43.868 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.861+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T10:53:43.868 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.861+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.431', time=2019-12-09T12:13:09.083851+0000, chain.objs.size()=5 2019-12-09T10:53:43.869 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.861+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.19__shadow_.6m5qM7hSBJeAZJATYkqoOpx5Bg1rFoI_1 2019-12-09T10:53:43.869 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.861+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.19__shadow_.6m5qM7hSBJeAZJATYkqoOpx5Bg1rFoI_2 2019-12-09T10:53:43.869 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.861+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.19__shadow_.6m5qM7hSBJeAZJATYkqoOpx5Bg1rFoI_3 2019-12-09T10:53:43.869 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.861+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.19__shadow_.6m5qM7hSBJeAZJATYkqoOpx5Bg1rFoI_4 2019-12-09T10:53:43.869 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.861+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.19__shadow_.6m5qM7hSBJeAZJATYkqoOpx5Bg1rFoI_5 2019-12-09T10:53:43.869 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.861+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe', time=2019-12-09T12:35:13.134445+0000, chain.objs.size()=26 2019-12-09T10:53:43.870 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.861+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.1 2019-12-09T10:53:43.870 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.861+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.2 2019-12-09T10:53:43.870 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.861+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.3 2019-12-09T10:53:43.870 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.861+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.4 2019-12-09T10:53:43.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.861+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.5 2019-12-09T10:53:43.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.861+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.6 2019-12-09T10:53:43.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:43.862+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.7 2019-12-09T10:53:44.119 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.112+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.8 2019-12-09T10:53:44.119 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.112+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.9 2019-12-09T10:53:44.120 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.112+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.10 2019-12-09T10:53:44.120 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.112+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.11 2019-12-09T10:53:44.120 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.112+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.12 2019-12-09T10:53:44.120 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.112+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.13 2019-12-09T10:53:44.120 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.112+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.14 2019-12-09T10:53:44.120 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.112+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.15 2019-12-09T10:53:44.121 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.112+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.16 2019-12-09T10:53:44.152 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.145+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.17 2019-12-09T10:53:44.221 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.214+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.AFXjInOVUw9ms5BcgejLW9tSvKMbYbK.18 2019-12-09T10:53:44.247 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.240+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.XON06UWdLxpW8VIhaJWyFcJKHGmiCQG.19 2019-12-09T10:53:44.375 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.368+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.eLDPVKarnPw-Od7b1_nCNVtIbX6iQnt.20 2019-12-09T10:53:44.376 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.368+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.21 2019-12-09T10:53:44.376 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.368+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.sD5GvHS65aprRcotfU8QAnRliiYAjlK.22 2019-12-09T10:53:44.376 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.368+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.PQX5CUfcf3G6x_v4RHMXfQFIbnX5PnD.23 2019-12-09T10:53:44.376 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.368+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.24 2019-12-09T10:53:44.376 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.368+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.25 2019-12-09T10:53:44.376 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.368+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.31__multipart_key1.2~l8rbWLpXjGmfdHGg3KgSbNuMD19NdDe.26 2019-12-09T10:53:44.684 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.677+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:45.022 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.811+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T10:53:45.022 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.863+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:45.023 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.887+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:45.023 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.897+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:45.023 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:44.940+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T10:53:45.023 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.007+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:45.039 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.032+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:45.053 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.046+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:45.119 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.112+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T10:53:45.180 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.173+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:45.203 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.196+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:45.224 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.217+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:53:45.224 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.217+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.461', time=2019-12-09T12:12:36.728775+0000, chain.objs.size()=7 2019-12-09T10:53:45.224 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.217+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~JQipGhtC8WTg8HtRxGLMp4Yub4PoRHU.1 2019-12-09T10:53:45.224 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.217+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~JQipGhtC8WTg8HtRxGLMp4Yub4PoRHU.1_1 2019-12-09T10:53:45.225 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.217+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~JQipGhtC8WTg8HtRxGLMp4Yub4PoRHU.1_2 2019-12-09T10:53:45.225 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.217+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~JQipGhtC8WTg8HtRxGLMp4Yub4PoRHU.2 2019-12-09T10:53:45.225 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.217+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~JQipGhtC8WTg8HtRxGLMp4Yub4PoRHU.2_1 2019-12-09T10:53:45.225 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.217+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~JQipGhtC8WTg8HtRxGLMp4Yub4PoRHU.2_2 2019-12-09T10:53:45.225 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.217+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~JQipGhtC8WTg8HtRxGLMp4Yub4PoRHU.3 2019-12-09T10:53:45.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.412+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:45.494 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.487+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T10:53:45.568 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.559+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:45.601 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.595+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:45.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.617+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T10:53:45.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.617+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.416', time=2019-12-09T12:09:19.218815+0000, chain.objs.size()=9 2019-12-09T10:53:45.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.617+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__multipart_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.1 2019-12-09T10:53:45.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.617+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__shadow_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.1_1 2019-12-09T10:53:45.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.617+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__multipart_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.2 2019-12-09T10:53:45.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.617+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__shadow_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.2_1 2019-12-09T10:53:45.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.617+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__multipart_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.3 2019-12-09T10:53:45.626 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.617+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__shadow_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.3_1 2019-12-09T10:53:45.626 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.617+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__multipart_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.4 2019-12-09T10:53:45.626 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.617+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__shadow_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.4_1 2019-12-09T10:53:45.626 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.617+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.17__multipart_key1.2~5FkcBJkmWwGXoitMHKQa44arfFJAeI7.5 2019-12-09T10:53:45.626 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.617+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.473', time=2019-12-09T12:13:18.179755+0000, chain.objs.size()=7 2019-12-09T10:53:45.626 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.617+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~mAV7FM3FEdhRGAWNPtmGTKM_6OwsvJm.1 2019-12-09T10:53:45.626 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.617+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~mAV7FM3FEdhRGAWNPtmGTKM_6OwsvJm.1_1 2019-12-09T10:53:45.627 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.617+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~mAV7FM3FEdhRGAWNPtmGTKM_6OwsvJm.1_2 2019-12-09T10:53:45.820 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.813+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~mAV7FM3FEdhRGAWNPtmGTKM_6OwsvJm.2 2019-12-09T10:53:45.820 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.813+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~mAV7FM3FEdhRGAWNPtmGTKM_6OwsvJm.2_1 2019-12-09T10:53:45.820 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.813+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__shadow_key1.2~mAV7FM3FEdhRGAWNPtmGTKM_6OwsvJm.2_2 2019-12-09T10:53:45.821 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.813+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.20__multipart_key1.2~mAV7FM3FEdhRGAWNPtmGTKM_6OwsvJm.3 2019-12-09T10:53:45.965 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:45.958+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:46.077 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.070+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T10:53:46.118 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.112+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:46.138 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.131+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:46.146 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.140+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:46.179 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.172+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T10:53:46.222 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.215+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:46.259 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.253+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:46.284 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.276+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T10:53:46.284 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.276+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.387', time=2019-12-09T12:07:56.052135+0000, chain.objs.size()=9 2019-12-09T10:53:46.285 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.276+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.15__multipart_key1.2~-WjNlzJ5KWJCYKj_rbuTrZn-SSMceF2.1 2019-12-09T10:53:46.285 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.276+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.15__shadow_key1.2~-WjNlzJ5KWJCYKj_rbuTrZn-SSMceF2.1_1 2019-12-09T10:53:46.285 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.276+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.15__multipart_key1.2~-WjNlzJ5KWJCYKj_rbuTrZn-SSMceF2.2 2019-12-09T10:53:46.285 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.276+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.15__shadow_key1.2~-WjNlzJ5KWJCYKj_rbuTrZn-SSMceF2.2_1 2019-12-09T10:53:46.285 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.276+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.15__multipart_key1.2~-WjNlzJ5KWJCYKj_rbuTrZn-SSMceF2.3 2019-12-09T10:53:46.286 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.276+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.15__shadow_key1.2~-WjNlzJ5KWJCYKj_rbuTrZn-SSMceF2.3_1 2019-12-09T10:53:46.286 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.276+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.15__multipart_key1.2~-WjNlzJ5KWJCYKj_rbuTrZn-SSMceF2.4 2019-12-09T10:53:46.286 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.276+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.15__shadow_key1.2~-WjNlzJ5KWJCYKj_rbuTrZn-SSMceF2.4_1 2019-12-09T10:53:46.286 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.276+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.15__multipart_key1.2~-WjNlzJ5KWJCYKj_rbuTrZn-SSMceF2.5 2019-12-09T10:53:46.286 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.276+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.652', time=2019-12-09T12:33:09.023204+0000, chain.objs.size()=9 2019-12-09T10:53:46.287 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.276+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.29__multipart_key1.2~coJxRZnQLhvI464SCBpn1iDE73NVb0b.1 2019-12-09T10:53:46.287 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.276+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.29__shadow_key1.2~coJxRZnQLhvI464SCBpn1iDE73NVb0b.1_1 2019-12-09T10:53:46.287 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.276+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.29__multipart_key1.2~coJxRZnQLhvI464SCBpn1iDE73NVb0b.2 2019-12-09T10:53:46.433 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.427+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.29__shadow_key1.2~coJxRZnQLhvI464SCBpn1iDE73NVb0b.2_1 2019-12-09T10:53:46.437 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.430+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.29__multipart_key1.2~coJxRZnQLhvI464SCBpn1iDE73NVb0b.3 2019-12-09T10:53:46.437 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.430+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.29__shadow_key1.2~coJxRZnQLhvI464SCBpn1iDE73NVb0b.3_1 2019-12-09T10:53:46.472 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.465+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.29__multipart_key1.2~coJxRZnQLhvI464SCBpn1iDE73NVb0b.4 2019-12-09T10:53:46.472 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.465+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.29__shadow_key1.2~coJxRZnQLhvI464SCBpn1iDE73NVb0b.4_1 2019-12-09T10:53:46.491 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.484+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.29__multipart_key1.2~coJxRZnQLhvI464SCBpn1iDE73NVb0b.5 2019-12-09T10:53:46.716 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.709+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:46.833 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.826+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T10:53:46.885 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.878+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:46.903 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.896+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:46.917 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.911+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:46.949 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.942+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T10:53:46.990 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.983+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:47.006 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:46.999+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:47.021 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.014+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:53:47.021 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.014+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.510', time=2019-12-09T12:14:38.989074+0000, chain.objs.size()=9 2019-12-09T10:53:47.021 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.014+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.24__multipart_key1.2~rm2KWqtVrNH8d7PdW3lDgBvx7u61unM.1 2019-12-09T10:53:47.022 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.014+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.24__shadow_key1.2~rm2KWqtVrNH8d7PdW3lDgBvx7u61unM.1_1 2019-12-09T10:53:47.022 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.014+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.24__multipart_key1.2~rm2KWqtVrNH8d7PdW3lDgBvx7u61unM.2 2019-12-09T10:53:47.022 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.014+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.24__shadow_key1.2~rm2KWqtVrNH8d7PdW3lDgBvx7u61unM.2_1 2019-12-09T10:53:47.022 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.014+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.24__multipart_key1.2~rm2KWqtVrNH8d7PdW3lDgBvx7u61unM.3 2019-12-09T10:53:47.026 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.014+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.24__shadow_key1.2~rm2KWqtVrNH8d7PdW3lDgBvx7u61unM.3_1 2019-12-09T10:53:47.026 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.014+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.24__multipart_key1.2~rm2KWqtVrNH8d7PdW3lDgBvx7u61unM.4 2019-12-09T10:53:47.027 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.014+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.24__shadow_key1.2~rm2KWqtVrNH8d7PdW3lDgBvx7u61unM.4_1 2019-12-09T10:53:47.027 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.014+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.24__multipart_key1.2~rm2KWqtVrNH8d7PdW3lDgBvx7u61unM.5 2019-12-09T10:53:47.306 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.299+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:47.396 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.389+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T10:53:47.445 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.439+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:47.462 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.455+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:47.477 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.470+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:53:47.477 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.470+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.629', time=2019-12-09T12:31:17.088932+0000, chain.objs.size()=16 2019-12-09T10:53:47.478 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.470+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~lZKSDe2pjDNg8Xh3KeU4C6uK4lgzwa9.1 2019-12-09T10:53:47.478 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.470+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~lZKSDe2pjDNg8Xh3KeU4C6uK4lgzwa9.1_1 2019-12-09T10:53:47.478 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.470+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~lZKSDe2pjDNg8Xh3KeU4C6uK4lgzwa9.1_2 2019-12-09T10:53:47.478 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.470+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~lZKSDe2pjDNg8Xh3KeU4C6uK4lgzwa9.2 2019-12-09T10:53:47.478 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.470+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~lZKSDe2pjDNg8Xh3KeU4C6uK4lgzwa9.2_1 2019-12-09T10:53:47.478 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.470+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~lZKSDe2pjDNg8Xh3KeU4C6uK4lgzwa9.2_2 2019-12-09T10:53:47.479 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.470+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~lZKSDe2pjDNg8Xh3KeU4C6uK4lgzwa9.3 2019-12-09T10:53:47.479 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.470+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~lZKSDe2pjDNg8Xh3KeU4C6uK4lgzwa9.3_1 2019-12-09T10:53:47.479 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.470+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~lZKSDe2pjDNg8Xh3KeU4C6uK4lgzwa9.3_2 2019-12-09T10:53:47.479 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.470+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~lZKSDe2pjDNg8Xh3KeU4C6uK4lgzwa9.4 2019-12-09T10:53:47.479 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.470+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~lZKSDe2pjDNg8Xh3KeU4C6uK4lgzwa9.4_1 2019-12-09T10:53:47.479 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.470+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~lZKSDe2pjDNg8Xh3KeU4C6uK4lgzwa9.4_2 2019-12-09T10:53:47.571 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.564+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~lZKSDe2pjDNg8Xh3KeU4C6uK4lgzwa9.5 2019-12-09T10:53:47.658 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.651+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~lZKSDe2pjDNg8Xh3KeU4C6uK4lgzwa9.5_1 2019-12-09T10:53:47.658 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.651+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~lZKSDe2pjDNg8Xh3KeU4C6uK4lgzwa9.5_2 2019-12-09T10:53:47.658 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.651+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~lZKSDe2pjDNg8Xh3KeU4C6uK4lgzwa9.6 2019-12-09T10:53:47.794 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.787+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:47.870 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.863+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T10:53:47.905 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.899+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:47.921 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.914+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:47.929 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.922+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:47.963 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:47.956+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T10:53:48.024 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.018+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:48.040 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.034+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:48.053 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.045+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:53:48.053 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.045+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='2~no88BmjyZO9Y5e9jK5VWUx2_gxn7igK', time=2019-12-09T12:17:36.470066+0000, chain.objs.size()=5 2019-12-09T10:53:48.053 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.045+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.27__multipart_key1.2~no88BmjyZO9Y5e9jK5VWUx2_gxn7igK.7 2019-12-09T10:53:48.053 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.045+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.27__shadow_key1.2~no88BmjyZO9Y5e9jK5VWUx2_gxn7igK.7_1 2019-12-09T10:53:48.054 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.045+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.27__multipart_key1.2~no88BmjyZO9Y5e9jK5VWUx2_gxn7igK.10 2019-12-09T10:53:48.054 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.045+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.27__shadow_key1.2~no88BmjyZO9Y5e9jK5VWUx2_gxn7igK.10_1 2019-12-09T10:53:48.054 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.045+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.27__multipart_key1.2~no88BmjyZO9Y5e9jK5VWUx2_gxn7igK.13 2019-12-09T10:53:48.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.187+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:48.299 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.292+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T10:53:48.337 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.329+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:48.350 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.344+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:48.371 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.364+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T10:53:48.371 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.364+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.554', time=2019-12-09T12:16:48.051465+0000, chain.objs.size()=9 2019-12-09T10:53:48.371 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.364+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.26__multipart_file.mpg.2~hxVX3jX89v_if_qYJpRSC6G46G8vzhL.1 2019-12-09T10:53:48.372 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.364+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.26__shadow_file.mpg.2~hxVX3jX89v_if_qYJpRSC6G46G8vzhL.1_1 2019-12-09T10:53:48.372 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.364+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.26__multipart_file.mpg.2~hxVX3jX89v_if_qYJpRSC6G46G8vzhL.2 2019-12-09T10:53:48.372 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.364+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.26__shadow_file.mpg.2~hxVX3jX89v_if_qYJpRSC6G46G8vzhL.2_1 2019-12-09T10:53:48.372 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.364+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.26__multipart_file.mpg.2~hxVX3jX89v_if_qYJpRSC6G46G8vzhL.3 2019-12-09T10:53:48.372 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.364+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.26__shadow_file.mpg.2~hxVX3jX89v_if_qYJpRSC6G46G8vzhL.3_1 2019-12-09T10:53:48.372 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.364+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.26__multipart_file.mpg.2~hxVX3jX89v_if_qYJpRSC6G46G8vzhL.4 2019-12-09T10:53:48.372 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.364+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.26__shadow_file.mpg.2~hxVX3jX89v_if_qYJpRSC6G46G8vzhL.4_1 2019-12-09T10:53:48.373 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.364+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.26__multipart_file.mpg.2~hxVX3jX89v_if_qYJpRSC6G46G8vzhL.5 2019-12-09T10:53:48.373 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.364+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.601', time=2019-12-09T12:24:39.201322+0000, chain.objs.size()=21 2019-12-09T10:53:48.373 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.364+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.1 2019-12-09T10:53:48.373 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.364+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.1_1 2019-12-09T10:53:48.373 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.364+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.2 2019-12-09T10:53:48.563 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.557+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.2_1 2019-12-09T10:53:48.592 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.585+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.3 2019-12-09T10:53:48.681 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.674+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.3_1 2019-12-09T10:53:48.681 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.674+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.4 2019-12-09T10:53:48.682 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.674+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.4_1 2019-12-09T10:53:48.682 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.674+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.5 2019-12-09T10:53:48.682 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.674+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.5_1 2019-12-09T10:53:48.682 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.674+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.6 2019-12-09T10:53:48.682 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.674+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.6_1 2019-12-09T10:53:48.682 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.674+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.7 2019-12-09T10:53:48.682 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.674+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.7_1 2019-12-09T10:53:48.683 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.674+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.8 2019-12-09T10:53:48.799 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.793+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.8_1 2019-12-09T10:53:48.882 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.875+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.9 2019-12-09T10:53:48.882 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.875+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.9_1 2019-12-09T10:53:48.882 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.875+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.10 2019-12-09T10:53:48.883 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.875+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.10_1 2019-12-09T10:53:48.883 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:48.875+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~IsTlMncGuwxxUVsqjYVxWu2QEPG4C5O.11 2019-12-09T10:53:49.070 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.063+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:49.180 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.173+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T10:53:49.218 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.211+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:49.234 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.227+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:49.248 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.241+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:53:49.249 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.241+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.613', time=2019-12-09T12:26:48.455785+0000, chain.objs.size()=19 2019-12-09T10:53:49.249 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.241+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.1 2019-12-09T10:53:49.249 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.242+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.1_1 2019-12-09T10:53:49.249 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.242+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.2 2019-12-09T10:53:49.249 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.242+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.2_1 2019-12-09T10:53:49.249 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.242+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.3 2019-12-09T10:53:49.249 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.242+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.3_1 2019-12-09T10:53:49.250 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.242+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.4 2019-12-09T10:53:49.250 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.242+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.4_1 2019-12-09T10:53:49.250 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.242+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.5 2019-12-09T10:53:49.250 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.242+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.5_1 2019-12-09T10:53:49.250 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.242+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.6 2019-12-09T10:53:49.250 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.242+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.6_1 2019-12-09T10:53:49.418 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.411+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.7 2019-12-09T10:53:49.440 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.434+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.7_1 2019-12-09T10:53:49.440 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.434+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.8 2019-12-09T10:53:49.441 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.434+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.8_1 2019-12-09T10:53:49.441 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.434+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.9 2019-12-09T10:53:49.482 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.475+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.9_1 2019-12-09T10:53:49.482 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.475+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~qZVPK0lL_ztJGbhDVQZiCe3Dj_DeHwi.10 2019-12-09T10:53:49.695 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.688+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:49.788 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.782+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T10:53:49.838 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.831+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:49.856 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.849+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:49.864 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.857+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:49.897 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.890+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T10:53:49.943 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.936+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:49.959 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.952+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:49.991 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.983+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-12-09T10:53:49.991 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.983+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.529', time=2019-12-09T12:15:40.762235+0000, chain.objs.size()=9 2019-12-09T10:53:49.991 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.983+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.25__multipart_key1.2~i7H28eJ_pSnjXx9IZC3TbO3Ay87eJmq.1 2019-12-09T10:53:49.991 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.983+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.25__shadow_key1.2~i7H28eJ_pSnjXx9IZC3TbO3Ay87eJmq.1_1 2019-12-09T10:53:49.992 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.983+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.25__multipart_key1.2~i7H28eJ_pSnjXx9IZC3TbO3Ay87eJmq.2 2019-12-09T10:53:49.992 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.983+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.25__shadow_key1.2~i7H28eJ_pSnjXx9IZC3TbO3Ay87eJmq.2_1 2019-12-09T10:53:49.992 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.983+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.25__multipart_key1.2~i7H28eJ_pSnjXx9IZC3TbO3Ay87eJmq.3 2019-12-09T10:53:49.992 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.983+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.25__shadow_key1.2~i7H28eJ_pSnjXx9IZC3TbO3Ay87eJmq.3_1 2019-12-09T10:53:49.992 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.983+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.25__multipart_key1.2~i7H28eJ_pSnjXx9IZC3TbO3Ay87eJmq.4 2019-12-09T10:53:49.992 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.983+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.25__shadow_key1.2~i7H28eJ_pSnjXx9IZC3TbO3Ay87eJmq.4_1 2019-12-09T10:53:49.992 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.983+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.25__multipart_key1.2~i7H28eJ_pSnjXx9IZC3TbO3Ay87eJmq.5 2019-12-09T10:53:49.993 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.983+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.588', time=2019-12-09T12:22:18.829988+0000, chain.objs.size()=21 2019-12-09T10:53:49.993 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.983+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.1 2019-12-09T10:53:49.993 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.983+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.1_1 2019-12-09T10:53:49.993 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:49.983+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.2 2019-12-09T10:53:50.117 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.110+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.2_1 2019-12-09T10:53:50.118 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.110+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.3 2019-12-09T10:53:50.118 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.110+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.3_1 2019-12-09T10:53:50.324 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.317+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.4 2019-12-09T10:53:50.324 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.317+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.4_1 2019-12-09T10:53:50.325 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.318+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.5 2019-12-09T10:53:50.325 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.318+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.5_1 2019-12-09T10:53:50.325 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.318+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.6 2019-12-09T10:53:50.325 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.318+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.6_1 2019-12-09T10:53:50.325 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.318+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.7 2019-12-09T10:53:50.325 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.318+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.7_1 2019-12-09T10:53:50.390 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.383+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.8 2019-12-09T10:53:50.390 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.383+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.8_1 2019-12-09T10:53:50.391 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.383+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.9 2019-12-09T10:53:50.610 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.604+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.9_1 2019-12-09T10:53:50.611 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.604+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.10 2019-12-09T10:53:50.611 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.604+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.10_1 2019-12-09T10:53:50.611 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.604+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~ZgsSy_W8YdxlXiPJRef0FKXJldgy3lC.11 2019-12-09T10:53:50.611 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.604+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.637', time=2019-12-09T12:31:19.722700+0000, chain.objs.size()=16 2019-12-09T10:53:50.612 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.604+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~GMZlUkSiRXoBgFCvIw3C3kiQybYfYgx.1 2019-12-09T10:53:50.612 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.604+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~GMZlUkSiRXoBgFCvIw3C3kiQybYfYgx.1_1 2019-12-09T10:53:50.612 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.604+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~GMZlUkSiRXoBgFCvIw3C3kiQybYfYgx.1_2 2019-12-09T10:53:50.612 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.605+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~GMZlUkSiRXoBgFCvIw3C3kiQybYfYgx.2 2019-12-09T10:53:50.653 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.646+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~GMZlUkSiRXoBgFCvIw3C3kiQybYfYgx.2_1 2019-12-09T10:53:50.684 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.677+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~GMZlUkSiRXoBgFCvIw3C3kiQybYfYgx.2_2 2019-12-09T10:53:50.684 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.677+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~GMZlUkSiRXoBgFCvIw3C3kiQybYfYgx.3 2019-12-09T10:53:50.717 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.711+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~GMZlUkSiRXoBgFCvIw3C3kiQybYfYgx.3_1 2019-12-09T10:53:50.834 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.828+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~GMZlUkSiRXoBgFCvIw3C3kiQybYfYgx.3_2 2019-12-09T10:53:50.901 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.894+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~GMZlUkSiRXoBgFCvIw3C3kiQybYfYgx.4 2019-12-09T10:53:50.902 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.894+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~GMZlUkSiRXoBgFCvIw3C3kiQybYfYgx.4_1 2019-12-09T10:53:50.902 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.894+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~GMZlUkSiRXoBgFCvIw3C3kiQybYfYgx.4_2 2019-12-09T10:53:50.902 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.894+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~GMZlUkSiRXoBgFCvIw3C3kiQybYfYgx.5 2019-12-09T10:53:50.902 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.894+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~GMZlUkSiRXoBgFCvIw3C3kiQybYfYgx.5_1 2019-12-09T10:53:50.902 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.895+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~GMZlUkSiRXoBgFCvIw3C3kiQybYfYgx.5_2 2019-12-09T10:53:50.995 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:50.989+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~GMZlUkSiRXoBgFCvIw3C3kiQybYfYgx.6 2019-12-09T10:53:51.146 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.139+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:51.234 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.226+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T10:53:51.264 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.257+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:51.281 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.273+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:51.288 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.282+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:51.319 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.312+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T10:53:51.356 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.349+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:51.372 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.366+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:51.379 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.373+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:51.413 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.406+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T10:53:51.448 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.442+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:51.465 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.458+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:51.474 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.467+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:51.502 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.495+0000 7f07c6eefec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T10:53:51.551 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.544+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:51.573 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.566+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:51.593 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.585+0000 7f07c6eefec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T10:53:51.593 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.585+0000 7f07c6eefec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.621', time=2019-12-09T12:28:40.997617+0000, chain.objs.size()=16 2019-12-09T10:53:51.593 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.585+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~666d-5dmhqNPa1axJ7Rpv2EPclVQJQn.1 2019-12-09T10:53:51.593 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.585+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~666d-5dmhqNPa1axJ7Rpv2EPclVQJQn.1_1 2019-12-09T10:53:51.594 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.585+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~666d-5dmhqNPa1axJ7Rpv2EPclVQJQn.1_2 2019-12-09T10:53:51.594 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.585+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~666d-5dmhqNPa1axJ7Rpv2EPclVQJQn.2 2019-12-09T10:53:51.594 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.585+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~666d-5dmhqNPa1axJ7Rpv2EPclVQJQn.2_1 2019-12-09T10:53:51.594 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.585+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~666d-5dmhqNPa1axJ7Rpv2EPclVQJQn.2_2 2019-12-09T10:53:51.594 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.585+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~666d-5dmhqNPa1axJ7Rpv2EPclVQJQn.3 2019-12-09T10:53:51.594 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.585+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~666d-5dmhqNPa1axJ7Rpv2EPclVQJQn.3_1 2019-12-09T10:53:51.594 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.585+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~666d-5dmhqNPa1axJ7Rpv2EPclVQJQn.3_2 2019-12-09T10:53:51.595 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.585+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~666d-5dmhqNPa1axJ7Rpv2EPclVQJQn.4 2019-12-09T10:53:51.595 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.585+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~666d-5dmhqNPa1axJ7Rpv2EPclVQJQn.4_1 2019-12-09T10:53:51.595 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.585+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~666d-5dmhqNPa1axJ7Rpv2EPclVQJQn.4_2 2019-12-09T10:53:51.742 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.735+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~666d-5dmhqNPa1axJ7Rpv2EPclVQJQn.5 2019-12-09T10:53:51.751 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.745+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~666d-5dmhqNPa1axJ7Rpv2EPclVQJQn.5_1 2019-12-09T10:53:51.779 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.772+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__shadow_key1.2~666d-5dmhqNPa1axJ7Rpv2EPclVQJQn.5_2 2019-12-09T10:53:51.779 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.773+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.28__multipart_key1.2~666d-5dmhqNPa1axJ7Rpv2EPclVQJQn.6 2019-12-09T10:53:51.943 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:51.936+0000 7f07c6eefec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T10:53:52.064 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.057+0000 7f07c6eefec0 20 remove_watcher() i=0 2019-12-09T10:53:52.064 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.057+0000 7f07c6eefec0 2 removed watcher, disabling cache 2019-12-09T10:53:52.119 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.113+0000 7f07c6eefec0 20 remove_watcher() i=1 2019-12-09T10:53:52.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.189+0000 7f07c6eefec0 20 remove_watcher() i=2 2019-12-09T10:53:52.224 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.217+0000 7f07c6eefec0 20 remove_watcher() i=3 2019-12-09T10:53:52.263 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.257+0000 7f07c6eefec0 20 remove_watcher() i=4 2019-12-09T10:53:52.298 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.291+0000 7f07c6eefec0 20 remove_watcher() i=5 2019-12-09T10:53:52.348 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.341+0000 7f07c6eefec0 20 remove_watcher() i=6 2019-12-09T10:53:52.387 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.380+0000 7f07c6eefec0 20 remove_watcher() i=7 2019-12-09T10:53:52.399 INFO:teuthology.orchestra.run.smithi121:> radosgw-admin gc process --include-all 2019-12-09T10:53:52.512 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.506+0000 7f1bce41fec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:52.535 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.529+0000 7f1bce41fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:53:52.536 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.529+0000 7f1bce41fec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:52.544 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.538+0000 7f1bce41fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:53:52.545 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.538+0000 7f1bce41fec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:52.549 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.543+0000 7f1bce41fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:53:52.549 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.543+0000 7f1bce41fec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:52.569 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.562+0000 7f1bce41fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:53:52.748 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.741+0000 7f1bce41fec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T10:53:52.748 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.741+0000 7f1bce41fec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T10:53:52.749 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.741+0000 7f1bce41fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T10:53:52.749 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.741+0000 7f1bce41fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T10:53:52.749 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.741+0000 7f1bce41fec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:52.758 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.752+0000 7f1bce41fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:53:52.759 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.752+0000 7f1bce41fec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:52.771 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.765+0000 7f1bce41fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:53:52.772 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.765+0000 7f1bce41fec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:52.780 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.773+0000 7f1bce41fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:53:52.781 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.773+0000 7f1bce41fec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:52.794 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.788+0000 7f1bce41fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:53:52.794 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.788+0000 7f1bce41fec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:52.801 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.795+0000 7f1bce41fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:53:52.801 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.795+0000 7f1bce41fec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T10:53:52.802 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.795+0000 7f1bce41fec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:52.807 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.800+0000 7f1bce41fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:53:52.807 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.800+0000 7f1bce41fec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:52.815 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.809+0000 7f1bce41fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:53:52.815 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.809+0000 7f1bce41fec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:52.828 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.821+0000 7f1bce41fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:53:52.828 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.821+0000 7f1bce41fec0 20 zonegroup default 2019-12-09T10:53:52.828 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.821+0000 7f1bce41fec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:52.836 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.830+0000 7f1bce41fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:53:52.837 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.830+0000 7f1bce41fec0 10 Cannot find current period zone using local zone 2019-12-09T10:53:52.837 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.830+0000 7f1bce41fec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:52.846 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.839+0000 7f1bce41fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:53:52.846 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.839+0000 7f1bce41fec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:52.853 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.846+0000 7f1bce41fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:53:52.853 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.846+0000 7f1bce41fec0 20 rados->read ofs=0 len=0 2019-12-09T10:53:52.863 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.856+0000 7f1bce41fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:53:52.863 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.856+0000 7f1bce41fec0 20 zone default found 2019-12-09T10:53:52.864 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.856+0000 7f1bce41fec0 20 started sync module instance, tier type = 2019-12-09T10:53:52.864 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:52.856+0000 7f1bce41fec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T10:53:53.156 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:53.149+0000 7f1bce41fec0 20 add_watcher() i=0 2019-12-09T10:53:53.157 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:53.149+0000 7f1bce41fec0 20 add_watcher() i=1 2019-12-09T10:53:53.157 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:53.149+0000 7f1bce41fec0 20 add_watcher() i=2 2019-12-09T10:53:53.157 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:53.149+0000 7f1bce41fec0 20 add_watcher() i=3 2019-12-09T10:53:53.157 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:53.149+0000 7f1bce41fec0 20 add_watcher() i=4 2019-12-09T10:53:53.157 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:53.149+0000 7f1bce41fec0 20 add_watcher() i=5 2019-12-09T10:53:53.157 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:53.149+0000 7f1bce41fec0 20 add_watcher() i=6 2019-12-09T10:53:53.179 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:53.172+0000 7f1bce41fec0 20 add_watcher() i=7 2019-12-09T10:53:53.180 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:53.172+0000 7f1bce41fec0 2 all 8 watchers are set, enabling cache 2019-12-09T10:53:53.180 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:53.173+0000 7f1b8bfdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T10:53:53.189 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:53.183+0000 7f1bbb649700 0 -- 172.21.15.121:0/495113530 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f1afc0034e0 msgr2=0x7f1afc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T10:53:53.229 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:53.222+0000 7f1bbae48700 0 -- 172.21.15.121:0/2344953973 >> [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] conn(0x557003a713b0 msgr2=0x557003a737d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T10:53:54.919 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:54.913+0000 7f1afa7fc700 20 reqs_thread_entry: start 2019-12-09T10:53:54.920 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:54.914+0000 7f1af3fff700 20 reqs_thread_entry: start 2019-12-09T10:53:54.920 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:54.914+0000 7f1bce41fec0 20 init_complete bucket index max shards: 0 2019-12-09T10:53:54.920 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:54.915+0000 7f1af27fc700 20 reqs_thread_entry: start 2019-12-09T10:53:54.921 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:54.915+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T10:53:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:54.961+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:54.984 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:54.979+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:54.993 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:54.988+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:55.024 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.018+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T10:53:55.067 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.061+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:55.082 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.077+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:55.092 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.087+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:55.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.189+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T10:53:55.265 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.259+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:55.288 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.282+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:55.299 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.294+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:55.346 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.340+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T10:53:55.417 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.411+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:55.443 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.438+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:55.453 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.448+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:55.500 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.495+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T10:53:55.636 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.630+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:55.677 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.672+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:55.690 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.684+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:55.737 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.732+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T10:53:55.824 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.818+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:55.851 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.846+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:55.868 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.863+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:55.923 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.917+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T10:53:55.970 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.964+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:55.987 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.981+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:55.998 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:55.992+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:56.035 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.030+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T10:53:56.223 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.217+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:56.246 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.241+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:56.272 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.266+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:56.318 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.313+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T10:53:56.384 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.378+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:56.404 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.398+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:56.416 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.410+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:56.454 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.448+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T10:53:56.504 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.498+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:56.520 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.514+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:56.529 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.523+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:56.563 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.557+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T10:53:56.613 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.607+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:56.632 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.626+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:56.640 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.634+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:56.676 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.670+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T10:53:56.716 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.711+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:56.733 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.728+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:56.744 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.738+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:56.774 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.768+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T10:53:56.828 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.822+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:56.846 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.841+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:56.856 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.850+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:56.913 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.907+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T10:53:57.005 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:56.999+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:57.024 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.019+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:57.033 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.027+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:57.068 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.063+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T10:53:57.132 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.127+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:57.151 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.146+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:57.163 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.157+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:57.204 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.198+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T10:53:57.250 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.244+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:57.284 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.278+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:57.307 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.302+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:57.348 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.343+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T10:53:57.391 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.386+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:57.408 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.402+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:57.417 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.412+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:57.448 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.442+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T10:53:57.488 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.482+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:57.503 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.498+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:57.512 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.506+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:57.552 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.547+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T10:53:57.598 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.592+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:57.621 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.614+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:57.629 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.624+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:57.796 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.790+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T10:53:57.869 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.860+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:57.896 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.891+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:57.908 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.903+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:57.952 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:57.946+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T10:53:58.007 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.002+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:58.040 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.034+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:58.054 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.049+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:58.109 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.104+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T10:53:58.177 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.171+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:58.231 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.226+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:58.248 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.243+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:58.317 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.311+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T10:53:58.386 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.380+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:58.410 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.404+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:58.425 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.420+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:58.460 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.454+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T10:53:58.504 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.499+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:58.523 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.517+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:58.534 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.528+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:58.572 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.566+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T10:53:58.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.619+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:58.650 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.644+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:58.661 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.656+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:58.698 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.693+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T10:53:58.770 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.765+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:58.806 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.800+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:58.826 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.821+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:58.882 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.877+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T10:53:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.947+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:58.982 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.976+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:58.994 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:58.988+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:59.044 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.039+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T10:53:59.121 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.115+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:59.148 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.142+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:59.168 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.162+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:59.219 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.213+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T10:53:59.280 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.274+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:59.316 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.310+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:59.328 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.323+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:59.364 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.358+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T10:53:59.434 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.428+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:59.467 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.462+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:59.481 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.476+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:59.552 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.546+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T10:53:59.629 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.623+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:59.659 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.654+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:59.668 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.663+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:59.722 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.716+0000 7f1bce41fec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T10:53:59.772 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.767+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:59.794 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.788+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:53:59.806 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.800+0000 7f1bce41fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:53:59.884 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.878+0000 7f1bce41fec0 20 remove_watcher() i=0 2019-12-09T10:53:59.884 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.878+0000 7f1bce41fec0 2 removed watcher, disabling cache 2019-12-09T10:53:59.922 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.917+0000 7f1bce41fec0 20 remove_watcher() i=1 2019-12-09T10:53:59.953 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.948+0000 7f1bce41fec0 20 remove_watcher() i=2 2019-12-09T10:53:59.989 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:53:59.983+0000 7f1bce41fec0 20 remove_watcher() i=3 2019-12-09T10:54:00.015 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.010+0000 7f1bce41fec0 20 remove_watcher() i=4 2019-12-09T10:54:00.046 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.040+0000 7f1bce41fec0 20 remove_watcher() i=5 2019-12-09T10:54:00.080 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.074+0000 7f1bce41fec0 20 remove_watcher() i=6 2019-12-09T10:54:00.113 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.107+0000 7f1bce41fec0 20 remove_watcher() i=7 2019-12-09T10:54:00.122 INFO:teuthology.orchestra.run.smithi121:> radosgw-admin gc process --include-all 2019-12-09T10:54:00.413 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.407+0000 7f0ad9ffc700 0 --2- 172.21.15.121:0/3739278253 >> v2:172.21.15.121:3300/0 conn(0x5645559964f0 0x564555998860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-09T10:54:00.451 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.445+0000 7f0aecdd2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:00.495 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.483+0000 7f0aecdd2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:54:00.495 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.483+0000 7f0aecdd2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:00.499 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.493+0000 7f0aecdd2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:54:00.499 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.493+0000 7f0aecdd2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:00.508 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.502+0000 7f0aecdd2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:54:00.508 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.502+0000 7f0aecdd2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:00.530 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.524+0000 7f0aecdd2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:54:00.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.749+0000 7f0aecdd2ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T10:54:00.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.749+0000 7f0aecdd2ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T10:54:00.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.749+0000 7f0aecdd2ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T10:54:00.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.749+0000 7f0aecdd2ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T10:54:00.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.749+0000 7f0aecdd2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:00.762 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.757+0000 7f0aecdd2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:54:00.762 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.757+0000 7f0aecdd2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:00.773 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.767+0000 7f0aecdd2ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:54:00.773 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.767+0000 7f0aecdd2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:00.783 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.777+0000 7f0aecdd2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:54:00.783 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.777+0000 7f0aecdd2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:00.804 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.798+0000 7f0aecdd2ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:54:00.804 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.798+0000 7f0aecdd2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:00.809 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.803+0000 7f0aecdd2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:54:00.809 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.803+0000 7f0aecdd2ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T10:54:00.809 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.803+0000 7f0aecdd2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:00.814 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.808+0000 7f0aecdd2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:54:00.814 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.808+0000 7f0aecdd2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:00.822 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.817+0000 7f0aecdd2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:54:00.823 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.817+0000 7f0aecdd2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:00.840 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.835+0000 7f0aecdd2ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:54:00.841 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.835+0000 7f0aecdd2ec0 20 zonegroup default 2019-12-09T10:54:00.841 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.835+0000 7f0aecdd2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:00.850 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.844+0000 7f0aecdd2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:54:00.850 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.844+0000 7f0aecdd2ec0 10 Cannot find current period zone using local zone 2019-12-09T10:54:00.850 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.844+0000 7f0aecdd2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:00.858 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.853+0000 7f0aecdd2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:54:00.858 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.853+0000 7f0aecdd2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:00.875 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.869+0000 7f0aecdd2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:54:00.875 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.869+0000 7f0aecdd2ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:00.891 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.884+0000 7f0aecdd2ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:54:00.891 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.885+0000 7f0aecdd2ec0 20 zone default found 2019-12-09T10:54:00.891 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.885+0000 7f0aecdd2ec0 20 started sync module instance, tier type = 2019-12-09T10:54:00.891 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:00.885+0000 7f0aecdd2ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T10:54:01.228 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:01.222+0000 7f0aecdd2ec0 20 add_watcher() i=0 2019-12-09T10:54:01.228 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:01.222+0000 7f0aecdd2ec0 20 add_watcher() i=1 2019-12-09T10:54:01.228 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:01.222+0000 7f0aecdd2ec0 20 add_watcher() i=2 2019-12-09T10:54:01.228 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:01.222+0000 7f0aecdd2ec0 20 add_watcher() i=3 2019-12-09T10:54:01.229 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:01.222+0000 7f0aecdd2ec0 20 add_watcher() i=4 2019-12-09T10:54:01.229 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:01.222+0000 7f0aecdd2ec0 20 add_watcher() i=5 2019-12-09T10:54:01.234 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:01.228+0000 7f0aecdd2ec0 20 add_watcher() i=6 2019-12-09T10:54:01.259 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:01.253+0000 7f0aecdd2ec0 20 add_watcher() i=7 2019-12-09T10:54:01.259 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:01.253+0000 7f0aecdd2ec0 2 all 8 watchers are set, enabling cache 2019-12-09T10:54:01.259 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:01.253+0000 7f0aaa7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T10:54:01.261 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:01.256+0000 7f0ad9ffc700 0 -- 172.21.15.121:0/222678867 >> v1:172.21.15.132:6789/0 conn(0x564555a94710 legacy=0x564555a931f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-12-09T10:54:01.300 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:01.294+0000 7f0ada7fd700 0 -- 172.21.15.121:0/3294990055 >> [v2:172.21.15.132:6800/8843,v1:172.21.15.132:6801/8843] conn(0x7f0a1c022480 msgr2=0x7f0a1c024990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T10:54:02.846 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:02.840+0000 7f0a20ff9700 20 reqs_thread_entry: start 2019-12-09T10:54:02.846 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:02.840+0000 7f0a1a7fc700 20 reqs_thread_entry: start 2019-12-09T10:54:02.846 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:02.840+0000 7f0aecdd2ec0 20 init_complete bucket index max shards: 0 2019-12-09T10:54:02.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:02.841+0000 7f0a18ff9700 20 reqs_thread_entry: start 2019-12-09T10:54:02.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:02.841+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T10:54:02.908 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:02.903+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:02.928 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:02.923+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:02.943 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:02.937+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:03.020 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.015+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T10:54:03.077 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.072+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:03.096 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.090+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:03.109 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.103+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:03.148 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.142+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T10:54:03.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.189+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:03.212 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.207+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:03.223 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.218+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:03.262 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.256+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T10:54:03.337 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.331+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:03.368 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.362+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:03.385 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.379+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:03.444 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.438+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T10:54:03.521 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.515+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:03.546 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.540+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:03.555 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.550+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:03.606 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.600+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T10:54:03.669 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.663+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:03.700 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.694+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:03.714 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.709+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:03.774 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.767+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T10:54:03.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.842+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:03.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.874+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:03.898 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.892+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:03.984 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:03.978+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T10:54:04.041 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.035+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:04.063 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.057+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:04.075 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.069+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:04.124 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.118+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T10:54:04.181 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.176+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:04.205 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.200+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:04.217 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.211+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:04.260 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.254+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T10:54:04.304 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.298+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:04.323 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.317+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:04.332 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.326+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:04.376 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.370+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T10:54:04.451 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.444+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:04.474 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.467+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:04.487 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.480+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:04.535 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.529+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T10:54:04.591 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.584+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:04.612 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.605+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:04.619 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.612+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:04.677 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.671+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T10:54:04.742 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.736+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:04.771 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.764+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:04.785 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.778+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:04.837 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.831+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T10:54:04.885 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.878+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:04.903 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.896+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:04.911 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.904+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:04.978 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:04.971+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T10:54:05.039 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.032+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:05.063 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.056+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:05.075 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.068+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:05.117 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.110+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T10:54:05.211 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.204+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:05.260 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.254+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:05.278 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.271+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:05.331 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.325+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T10:54:05.411 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.404+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:05.438 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.431+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:05.454 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.448+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:05.527 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.520+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T10:54:05.606 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.599+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:05.634 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.627+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:05.650 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.644+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:05.705 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.698+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T10:54:05.789 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.782+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:05.818 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.811+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:05.830 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.823+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:05.874 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.867+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T10:54:05.952 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.945+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:05.977 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.970+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:05.990 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:05.983+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:06.032 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.025+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T10:54:06.069 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.063+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:06.087 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.081+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:06.096 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.089+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:06.127 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.121+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T10:54:06.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.189+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:06.227 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.220+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:06.241 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.235+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:06.285 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.279+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T10:54:06.345 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.338+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:06.365 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.358+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:06.374 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.368+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:06.423 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.416+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T10:54:06.490 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.483+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:06.512 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.506+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:06.529 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.522+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:06.573 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.567+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T10:54:06.614 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.607+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:06.629 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.623+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:06.638 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.631+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:06.667 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.660+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T10:54:06.716 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.709+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:06.733 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.727+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:06.742 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.735+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:06.777 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.770+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T10:54:06.843 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.837+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:06.867 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.860+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:06.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.872+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:06.923 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.916+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T10:54:06.990 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:06.983+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:07.017 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.011+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:07.027 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.020+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:07.076 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.070+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T10:54:07.166 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.159+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:07.193 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.187+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:07.209 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.202+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:07.259 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.252+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T10:54:07.339 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.332+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:07.379 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.373+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:07.397 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.390+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:07.445 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.439+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T10:54:07.518 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.511+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:07.593 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.587+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:07.605 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.599+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:07.640 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.633+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T10:54:07.693 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.686+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:07.715 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.708+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:07.729 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.723+0000 7f0aecdd2ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:07.824 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.818+0000 7f0aecdd2ec0 20 remove_watcher() i=0 2019-12-09T10:54:07.825 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.818+0000 7f0aecdd2ec0 2 removed watcher, disabling cache 2019-12-09T10:54:07.884 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.877+0000 7f0aecdd2ec0 20 remove_watcher() i=1 2019-12-09T10:54:07.933 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.926+0000 7f0aecdd2ec0 20 remove_watcher() i=2 2019-12-09T10:54:07.979 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:07.972+0000 7f0aecdd2ec0 20 remove_watcher() i=3 2019-12-09T10:54:08.022 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.016+0000 7f0aecdd2ec0 20 remove_watcher() i=4 2019-12-09T10:54:08.071 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.065+0000 7f0aecdd2ec0 20 remove_watcher() i=5 2019-12-09T10:54:08.125 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.119+0000 7f0aecdd2ec0 20 remove_watcher() i=6 2019-12-09T10:54:08.176 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.169+0000 7f0aecdd2ec0 20 remove_watcher() i=7 2019-12-09T10:54:08.186 INFO:teuthology.orchestra.run.smithi121:> radosgw-admin gc process --include-all 2019-12-09T10:54:08.308 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.302+0000 7f0159165ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:08.341 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.334+0000 7f0159165ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:54:08.341 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.334+0000 7f0159165ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:08.351 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.345+0000 7f0159165ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:54:08.352 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.345+0000 7f0159165ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:08.362 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.356+0000 7f0159165ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:54:08.362 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.356+0000 7f0159165ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:08.385 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.378+0000 7f0159165ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:54:08.603 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.596+0000 7f0159165ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T10:54:08.603 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.596+0000 7f0159165ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T10:54:08.603 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.596+0000 7f0159165ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T10:54:08.603 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.596+0000 7f0159165ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T10:54:08.603 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.596+0000 7f0159165ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:08.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.617+0000 7f0159165ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:54:08.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.617+0000 7f0159165ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:08.636 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.629+0000 7f0159165ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:54:08.636 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.629+0000 7f0159165ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:08.647 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.641+0000 7f0159165ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:54:08.647 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.641+0000 7f0159165ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:08.658 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.652+0000 7f0159165ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:54:08.659 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.652+0000 7f0159165ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:08.666 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.660+0000 7f0159165ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:54:08.667 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.660+0000 7f0159165ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T10:54:08.667 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.660+0000 7f0159165ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:08.672 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.666+0000 7f0159165ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:54:08.673 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.666+0000 7f0159165ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:08.688 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.681+0000 7f0159165ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:54:08.688 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.681+0000 7f0159165ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:08.705 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.699+0000 7f0159165ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:54:08.705 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.699+0000 7f0159165ec0 20 zonegroup default 2019-12-09T10:54:08.705 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.699+0000 7f0159165ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:08.711 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.704+0000 7f0159165ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:54:08.711 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.704+0000 7f0159165ec0 10 Cannot find current period zone using local zone 2019-12-09T10:54:08.711 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.704+0000 7f0159165ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:08.724 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.717+0000 7f0159165ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:54:08.724 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.718+0000 7f0159165ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:08.740 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.733+0000 7f0159165ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:54:08.740 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.733+0000 7f0159165ec0 20 rados->read ofs=0 len=0 2019-12-09T10:54:08.754 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.747+0000 7f0159165ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:54:08.754 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.747+0000 7f0159165ec0 20 zone default found 2019-12-09T10:54:08.754 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.747+0000 7f0159165ec0 20 started sync module instance, tier type = 2019-12-09T10:54:08.754 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:08.747+0000 7f0159165ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T10:54:09.143 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:09.136+0000 7f0159165ec0 20 add_watcher() i=0 2019-12-09T10:54:09.143 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:09.136+0000 7f0159165ec0 20 add_watcher() i=1 2019-12-09T10:54:09.143 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:09.136+0000 7f0159165ec0 20 add_watcher() i=2 2019-12-09T10:54:09.143 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:09.136+0000 7f0159165ec0 20 add_watcher() i=3 2019-12-09T10:54:09.144 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:09.136+0000 7f0159165ec0 20 add_watcher() i=4 2019-12-09T10:54:09.144 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:09.136+0000 7f0159165ec0 20 add_watcher() i=5 2019-12-09T10:54:09.144 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:09.136+0000 7f0159165ec0 20 add_watcher() i=6 2019-12-09T10:54:09.183 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:09.176+0000 7f0159165ec0 20 add_watcher() i=7 2019-12-09T10:54:09.183 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:09.176+0000 7f0159165ec0 2 all 8 watchers are set, enabling cache 2019-12-09T10:54:09.183 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:09.176+0000 7f0116fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T10:54:09.206 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:09.199+0000 7f0146b90700 0 -- >> v2:172.21.15.121:3300/0 conn(0x55ed7a6a8210 msgr2=0x55ed7a6a75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T10:54:09.323 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:09.316+0000 7f0146b90700 0 -- 172.21.15.121:0/1039942152 >> [v2:172.21.15.132:6810/10196,v1:172.21.15.132:6811/10196] conn(0x55ed7a6c6490 msgr2=0x55ed7a6c88b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T10:54:11.048 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.041+0000 7f00857fa700 20 reqs_thread_entry: start 2019-12-09T10:54:11.049 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.042+0000 7f007effd700 20 reqs_thread_entry: start 2019-12-09T10:54:11.049 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.042+0000 7f0159165ec0 20 init_complete bucket index max shards: 0 2019-12-09T10:54:11.049 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.042+0000 7f007d7fa700 20 reqs_thread_entry: start 2019-12-09T10:54:11.049 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.042+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T10:54:11.128 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.121+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:11.144 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.138+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:11.155 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.149+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:11.216 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.210+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T10:54:11.284 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.277+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:11.304 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.297+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:11.314 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.307+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:11.352 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.345+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T10:54:11.406 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.399+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:11.437 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.430+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:11.449 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.442+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:11.497 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.491+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T10:54:11.554 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.548+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:11.592 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.585+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:11.600 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.594+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:11.635 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.628+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T10:54:11.696 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.689+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:11.713 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.706+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:11.723 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.717+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:11.773 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.767+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T10:54:11.893 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.887+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:11.917 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.910+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:11.930 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.923+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:11.988 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:11.982+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T10:54:12.050 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.044+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:12.070 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.063+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:12.081 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.074+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:12.125 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.118+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T10:54:12.166 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.160+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:12.185 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.179+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:12.199 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.193+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:12.233 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.227+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T10:54:12.283 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.277+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:12.303 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.296+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:12.313 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.307+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:12.361 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.355+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T10:54:12.427 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.421+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:12.448 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.441+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:12.460 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.454+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.490+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T10:54:12.543 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.536+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:12.560 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.554+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:12.570 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.563+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:12.605 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.599+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T10:54:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.672+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:12.707 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.700+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:12.719 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.712+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:12.768 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.762+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T10:54:12.849 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.842+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:12.888 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.882+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:12.903 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.896+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:12.953 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:12.946+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T10:54:13.029 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.022+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:13.045 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.039+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:13.058 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.052+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:13.092 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.084+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T10:54:13.143 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.136+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:13.166 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.160+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:13.174 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.168+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:13.220 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.213+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T10:54:13.271 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.264+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:13.287 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.280+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:13.295 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.289+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:13.335 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.328+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T10:54:13.382 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.376+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:13.398 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.392+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:13.407 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.400+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:13.439 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.432+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T10:54:13.506 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.499+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:13.532 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.525+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:13.540 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.534+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.576+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T10:54:13.661 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.655+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:13.703 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.696+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.713+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:13.779 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.772+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T10:54:13.849 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.842+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:13.884 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.878+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:13.894 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.887+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:13.938 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.932+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T10:54:14.002 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:13.995+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.024+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:14.042 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.035+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:14.079 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.073+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T10:54:14.163 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.157+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:14.192 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.186+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:14.211 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.205+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:14.249 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.243+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T10:54:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.291+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:14.322 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.316+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:14.335 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.329+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.383+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T10:54:14.445 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.438+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:14.471 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.465+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:14.483 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.477+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.512+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T10:54:14.590 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.583+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:14.618 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.611+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:14.628 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.621+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:14.657 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.650+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T10:54:14.717 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.710+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:14.740 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.734+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:14.748 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.742+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:14.799 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.792+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T10:54:14.862 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.856+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:14.888 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.882+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:14.901 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.895+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:14.954 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.947+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T10:54:14.993 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:14.986+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:15.009 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.003+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:15.021 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.015+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:15.049 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.043+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T10:54:15.088 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.081+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:15.103 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.097+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.105+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:15.142 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.135+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T10:54:15.177 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.171+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:15.192 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.186+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:15.201 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.194+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:15.229 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.223+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T10:54:15.447 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.278+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:15.447 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.300+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:15.447 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.315+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:15.447 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.366+0000 7f0159165ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T10:54:15.448 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.413+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:15.448 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.431+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:54:15.448 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.440+0000 7f0159165ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:54:15.523 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.516+0000 7f0159165ec0 20 remove_watcher() i=0 2019-12-09T10:54:15.523 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.516+0000 7f0159165ec0 2 removed watcher, disabling cache 2019-12-09T10:54:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.574+0000 7f0159165ec0 20 remove_watcher() i=1 2019-12-09T10:54:15.643 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.636+0000 7f0159165ec0 20 remove_watcher() i=2 2019-12-09T10:54:15.682 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.676+0000 7f0159165ec0 20 remove_watcher() i=3 2019-12-09T10:54:15.741 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.734+0000 7f0159165ec0 20 remove_watcher() i=4 2019-12-09T10:54:15.804 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.797+0000 7f0159165ec0 20 remove_watcher() i=5 2019-12-09T10:54:15.881 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.874+0000 7f0159165ec0 20 remove_watcher() i=6 2019-12-09T10:54:15.937 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:54:15.931+0000 7f0159165ec0 20 remove_watcher() i=7 2019-12-09T10:54:15.946 INFO:teuthology.orchestra.run.smithi121:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2019-12-09T10:54:16.545 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :clean 2019-12-09T10:54:17.242 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :compileJava 2019-12-09T10:54:17.243 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :processResources 2019-12-09T10:54:17.243 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :classes 2019-12-09T10:54:17.444 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:54:17.444 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :compileTestJava 2019-12-09T10:54:17.444 INFO:teuthology.orchestra.run.smithi121.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-12-09T10:54:17.445 INFO:teuthology.orchestra.run.smithi121.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-12-09T10:54:17.445 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:54:17.445 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :processTestResources NO-SOURCE 2019-12-09T10:54:17.445 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :testClasses 2019-12-09T10:54:20.342 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:54:20.342 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :test 2019-12-09T10:54:20.342 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:54:20.343 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2019-12-09T10:54:22.042 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:54:22.042 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2019-12-09T10:54:29.442 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:54:29.442 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2019-12-09T10:54:31.542 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:54:31.542 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2019-12-09T10:54:39.842 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:54:39.842 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2019-12-09T10:54:42.842 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:54:42.842 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2019-12-09T10:54:48.642 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:54:48.642 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2019-12-09T10:54:56.842 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:54:56.842 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2019-12-09T10:54:57.742 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:54:57.742 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2019-12-09T10:55:02.242 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:55:02.242 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2019-12-09T10:55:06.800 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:16:04.823 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:55:06.822 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:16:04.845 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:55:06.843 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:16:04.866 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:55:06.845 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:16:04.868 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:55:06.859 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:16:04.829 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:55:06.873 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:16:04.843 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:55:06.927 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:16:04.950 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:55:06.940 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:16:04.963 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:55:06.985 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:16:04.956 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:55:11.942 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:55:11.942 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2019-12-09T10:55:12.942 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:55:12.942 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2019-12-09T10:55:14.042 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:55:14.042 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2019-12-09T10:55:20.242 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:55:20.242 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2019-12-09T10:55:33.542 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:55:33.542 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2019-12-09T10:55:36.542 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:55:36.542 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2019-12-09T10:55:44.642 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:55:44.642 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2019-12-09T10:55:44.942 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:55:44.942 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2019-12-09T10:55:46.690 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:55:46.690 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------- 2019-12-09T10:55:46.690 INFO:teuthology.orchestra.run.smithi121.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2019-12-09T10:55:46.690 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------- 2019-12-09T10:55:46.691 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:55:46.691 INFO:teuthology.orchestra.run.smithi121.stdout:BUILD SUCCESSFUL in 1m 30s 2019-12-09T10:55:46.691 INFO:teuthology.orchestra.run.smithi121.stdout:5 actionable tasks: 5 executed 2019-12-09T10:55:46.698 INFO:teuthology.orchestra.run.smithi121:> radosgw-admin gc process --include-all 2019-12-09T10:55:46.832 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:46.826+0000 7f55eafa9ec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:46.861 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:46.854+0000 7f55eafa9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:55:46.861 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:46.854+0000 7f55eafa9ec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:46.870 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:46.863+0000 7f55eafa9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:55:46.870 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:46.863+0000 7f55eafa9ec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:46.878 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:46.871+0000 7f55eafa9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:55:46.878 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:46.871+0000 7f55eafa9ec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:46.896 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:46.889+0000 7f55eafa9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:55:47.066 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.059+0000 7f55eafa9ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T10:55:47.066 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.059+0000 7f55eafa9ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T10:55:47.066 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.059+0000 7f55eafa9ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T10:55:47.066 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.059+0000 7f55eafa9ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T10:55:47.066 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.059+0000 7f55eafa9ec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:47.080 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.073+0000 7f55eafa9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:55:47.080 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.073+0000 7f55eafa9ec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:47.090 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.083+0000 7f55eafa9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:55:47.090 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.083+0000 7f55eafa9ec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:47.105 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.098+0000 7f55eafa9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:55:47.105 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.098+0000 7f55eafa9ec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:47.116 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.109+0000 7f55eafa9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:55:47.116 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.109+0000 7f55eafa9ec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:47.124 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.117+0000 7f55eafa9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:55:47.124 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.118+0000 7f55eafa9ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T10:55:47.124 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.118+0000 7f55eafa9ec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:47.130 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.124+0000 7f55eafa9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:55:47.131 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.124+0000 7f55eafa9ec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:47.145 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.138+0000 7f55eafa9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:55:47.145 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.138+0000 7f55eafa9ec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:47.153 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.147+0000 7f55eafa9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:55:47.153 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.147+0000 7f55eafa9ec0 20 zonegroup default 2019-12-09T10:55:47.153 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.147+0000 7f55eafa9ec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:47.165 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.158+0000 7f55eafa9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:55:47.165 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.158+0000 7f55eafa9ec0 10 Cannot find current period zone using local zone 2019-12-09T10:55:47.165 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.158+0000 7f55eafa9ec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:47.175 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.168+0000 7f55eafa9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:55:47.175 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.168+0000 7f55eafa9ec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:47.192 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.185+0000 7f55eafa9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:55:47.192 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.185+0000 7f55eafa9ec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:47.212 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.205+0000 7f55eafa9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:55:47.212 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.205+0000 7f55eafa9ec0 20 zone default found 2019-12-09T10:55:47.212 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.205+0000 7f55eafa9ec0 20 started sync module instance, tier type = 2019-12-09T10:55:47.212 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.205+0000 7f55eafa9ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T10:55:47.524 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.517+0000 7f55eafa9ec0 20 add_watcher() i=0 2019-12-09T10:55:47.524 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.517+0000 7f55eafa9ec0 20 add_watcher() i=1 2019-12-09T10:55:47.524 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.517+0000 7f55eafa9ec0 20 add_watcher() i=2 2019-12-09T10:55:47.524 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.517+0000 7f55eafa9ec0 20 add_watcher() i=3 2019-12-09T10:55:47.524 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.517+0000 7f55eafa9ec0 20 add_watcher() i=4 2019-12-09T10:55:47.525 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.517+0000 7f55eafa9ec0 20 add_watcher() i=5 2019-12-09T10:55:47.525 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.517+0000 7f55eafa9ec0 20 add_watcher() i=6 2019-12-09T10:55:47.557 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.551+0000 7f55eafa9ec0 20 add_watcher() i=7 2019-12-09T10:55:47.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.551+0000 7f55eafa9ec0 2 all 8 watchers are set, enabling cache 2019-12-09T10:55:47.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.551+0000 7f55a8fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T10:55:47.559 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.553+0000 7f55d89d4700 0 -- >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x5564968617b0 msgr2=0x55649685df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T10:55:47.601 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:47.595+0000 7f55d89d4700 0 -- 172.21.15.121:0/2038931184 >> [v2:172.21.15.132:6800/8843,v1:172.21.15.132:6801/8843] conn(0x7f551c022470 msgr2=0x7f551c024960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T10:55:48.942 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:48.935+0000 7f551affd700 20 reqs_thread_entry: start 2019-12-09T10:55:48.942 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:48.936+0000 7f5518ff9700 20 reqs_thread_entry: start 2019-12-09T10:55:48.943 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:48.936+0000 7f55eafa9ec0 20 init_complete bucket index max shards: 0 2019-12-09T10:55:48.943 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:48.936+0000 7f5506ffd700 20 reqs_thread_entry: start 2019-12-09T10:55:48.943 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:48.936+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T10:55:49.081 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.074+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:49.100 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.094+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:49.109 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.103+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:49.136 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.129+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T10:55:49.254 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.247+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:49.273 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.267+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:49.284 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.278+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:49.318 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.312+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T10:55:49.360 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.353+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:49.383 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.377+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:49.393 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.387+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:49.424 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.418+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T10:55:49.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.457+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:49.479 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.472+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:49.487 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.481+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:49.521 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.515+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T10:55:49.587 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.581+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:49.620 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.614+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:49.640 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.633+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:49.734 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.727+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T10:55:49.809 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.803+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:49.838 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.832+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:49.853 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.846+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:49.904 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.897+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T10:55:49.961 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.954+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:49.986 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.980+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:49.999 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:49.993+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:50.046 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.039+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T10:55:50.147 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.140+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:50.172 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.166+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:50.183 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.177+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:50.229 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.222+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T10:55:50.272 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.266+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:50.292 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.286+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:50.305 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.298+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:50.337 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.330+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T10:55:50.374 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.368+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:50.391 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.384+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:50.399 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.393+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:50.440 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.434+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T10:55:50.486 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.480+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:50.510 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.503+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:50.523 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.517+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:50.566 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.557+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T10:55:50.628 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.621+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:50.644 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.637+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:50.653 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.647+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:50.703 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.696+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T10:55:50.746 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.740+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:50.767 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.760+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:50.778 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.771+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:50.824 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.818+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T10:55:50.886 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.879+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:50.909 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.902+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:50.918 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.912+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:50.950 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.944+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T10:55:50.994 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:50.988+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:51.011 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.003+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:51.017 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.010+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:51.060 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.054+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T10:55:51.100 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.094+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:51.115 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.109+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:51.126 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.120+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:51.169 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.162+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T10:55:51.234 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.228+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:51.259 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.252+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:51.270 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.264+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:51.319 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.312+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T10:55:51.390 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.383+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:51.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.412+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:51.440 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.434+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:51.480 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.474+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T10:55:51.554 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.548+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:51.582 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.575+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:51.595 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.588+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:51.652 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.646+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T10:55:51.708 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.702+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:51.730 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.723+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:51.740 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.734+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:51.783 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.777+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T10:55:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.863+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:51.913 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.906+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:51.928 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.921+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:51.981 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:51.975+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T10:55:52.042 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.035+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:52.067 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.060+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:52.080 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.074+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:52.124 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.118+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T10:55:52.198 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.192+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:52.227 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.220+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:52.240 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.233+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:52.338 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.331+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T10:55:52.415 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.408+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:52.439 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.432+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:52.449 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.443+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:52.508 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.501+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T10:55:52.585 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.579+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:52.609 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.602+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:52.622 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.615+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:52.673 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.666+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T10:55:52.727 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.721+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:52.754 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.747+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:52.764 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.758+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:52.818 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.811+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T10:55:52.873 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.866+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:52.897 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.891+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:52.910 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.903+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:52.969 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:52.962+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T10:55:53.050 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.044+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:53.110 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.104+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:53.128 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.121+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:53.175 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.169+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T10:55:53.233 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.226+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:53.256 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.250+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:53.267 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.261+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:53.311 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.304+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T10:55:53.386 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.379+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:53.417 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.411+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:53.431 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.424+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:53.488 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.482+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T10:55:53.570 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.563+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:53.596 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.589+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:53.611 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.605+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:53.670 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.663+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T10:55:53.742 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.735+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:53.789 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.774+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:53.801 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.794+0000 7f55eafa9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:53.892 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.885+0000 7f55eafa9ec0 20 remove_watcher() i=0 2019-12-09T10:55:53.892 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.885+0000 7f55eafa9ec0 2 removed watcher, disabling cache 2019-12-09T10:55:53.942 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.935+0000 7f55eafa9ec0 20 remove_watcher() i=1 2019-12-09T10:55:53.986 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:53.980+0000 7f55eafa9ec0 20 remove_watcher() i=2 2019-12-09T10:55:54.039 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.033+0000 7f55eafa9ec0 20 remove_watcher() i=3 2019-12-09T10:55:54.078 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.071+0000 7f55eafa9ec0 20 remove_watcher() i=4 2019-12-09T10:55:54.129 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.123+0000 7f55eafa9ec0 20 remove_watcher() i=5 2019-12-09T10:55:54.166 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.160+0000 7f55eafa9ec0 20 remove_watcher() i=6 2019-12-09T10:55:54.204 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.197+0000 7f55eafa9ec0 20 remove_watcher() i=7 2019-12-09T10:55:54.211 INFO:teuthology.orchestra.run.smithi121:> radosgw-admin gc process --include-all 2019-12-09T10:55:54.320 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.313+0000 7f0ca9fbbec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:54.351 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.344+0000 7f0ca9fbbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:55:54.351 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.344+0000 7f0ca9fbbec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:54.362 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.355+0000 7f0ca9fbbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:55:54.362 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.355+0000 7f0ca9fbbec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:54.369 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.363+0000 7f0ca9fbbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:55:54.370 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.363+0000 7f0ca9fbbec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:54.393 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.386+0000 7f0ca9fbbec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:55:54.585 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.579+0000 7f0ca9fbbec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T10:55:54.585 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.579+0000 7f0ca9fbbec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T10:55:54.587 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.579+0000 7f0ca9fbbec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T10:55:54.587 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.579+0000 7f0ca9fbbec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T10:55:54.588 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.579+0000 7f0ca9fbbec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:54.603 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.597+0000 7f0ca9fbbec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:55:54.604 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.597+0000 7f0ca9fbbec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:54.615 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.609+0000 7f0ca9fbbec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:55:54.616 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.609+0000 7f0ca9fbbec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:54.637 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.626+0000 7f0ca9fbbec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:55:54.637 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.626+0000 7f0ca9fbbec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:54.640 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.633+0000 7f0ca9fbbec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:55:54.640 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.633+0000 7f0ca9fbbec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:54.649 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.642+0000 7f0ca9fbbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:55:54.649 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.642+0000 7f0ca9fbbec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T10:55:54.649 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.642+0000 7f0ca9fbbec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:54.659 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.653+0000 7f0ca9fbbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:55:54.659 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.653+0000 7f0ca9fbbec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:54.675 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.669+0000 7f0ca9fbbec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:55:54.675 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.669+0000 7f0ca9fbbec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:54.683 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.677+0000 7f0ca9fbbec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:55:54.684 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.677+0000 7f0ca9fbbec0 20 zonegroup default 2019-12-09T10:55:54.684 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.677+0000 7f0ca9fbbec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:54.695 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.688+0000 7f0ca9fbbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:55:54.695 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.688+0000 7f0ca9fbbec0 10 Cannot find current period zone using local zone 2019-12-09T10:55:54.695 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.688+0000 7f0ca9fbbec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:54.702 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.696+0000 7f0ca9fbbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:55:54.702 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.696+0000 7f0ca9fbbec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:54.717 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.710+0000 7f0ca9fbbec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:55:54.717 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.711+0000 7f0ca9fbbec0 20 rados->read ofs=0 len=0 2019-12-09T10:55:54.733 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.727+0000 7f0ca9fbbec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:55:54.733 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.727+0000 7f0ca9fbbec0 20 zone default found 2019-12-09T10:55:54.734 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.727+0000 7f0ca9fbbec0 20 started sync module instance, tier type = 2019-12-09T10:55:54.734 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:54.727+0000 7f0ca9fbbec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T10:55:55.103 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:55.097+0000 7f0ca9fbbec0 20 add_watcher() i=0 2019-12-09T10:55:55.103 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:55.097+0000 7f0ca9fbbec0 20 add_watcher() i=1 2019-12-09T10:55:55.103 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:55.097+0000 7f0ca9fbbec0 20 add_watcher() i=2 2019-12-09T10:55:55.104 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:55.097+0000 7f0ca9fbbec0 20 add_watcher() i=3 2019-12-09T10:55:55.104 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:55.097+0000 7f0ca9fbbec0 20 add_watcher() i=4 2019-12-09T10:55:55.104 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:55.097+0000 7f0ca9fbbec0 20 add_watcher() i=5 2019-12-09T10:55:55.104 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:55.097+0000 7f0ca9fbbec0 20 add_watcher() i=6 2019-12-09T10:55:55.104 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:55.097+0000 7f0c971e5700 0 -- 172.21.15.121:0/342721025 >> [v2:172.21.15.121:6816/9958,v1:172.21.15.121:6817/9958] conn(0x7f0c88013040 msgr2=0x7f0c88013450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T10:55:55.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:55.152+0000 7f0ca9fbbec0 20 add_watcher() i=7 2019-12-09T10:55:55.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:55.152+0000 7f0ca9fbbec0 2 all 8 watchers are set, enabling cache 2019-12-09T10:55:55.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:55.153+0000 7f0c67fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T10:55:55.174 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:55.168+0000 7f0c971e5700 0 -- 172.21.15.121:0/1986550567 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x564065688af0 msgr2=0x564065688f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T10:55:56.908 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:56.901+0000 7f0bd67fc700 20 reqs_thread_entry: start 2019-12-09T10:55:56.908 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:56.902+0000 7f0bcffff700 20 reqs_thread_entry: start 2019-12-09T10:55:56.909 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:56.902+0000 7f0ca9fbbec0 20 init_complete bucket index max shards: 0 2019-12-09T10:55:56.909 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:56.903+0000 7f0bce7fc700 20 reqs_thread_entry: start 2019-12-09T10:55:56.909 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:56.903+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T10:55:56.984 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:56.978+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:57.008 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.002+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:57.021 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.014+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:57.061 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.054+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T10:55:57.116 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.110+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:57.136 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.130+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:57.147 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.141+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:57.181 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.174+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T10:55:57.221 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.215+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:57.237 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.231+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:57.250 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.240+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:57.286 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.280+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T10:55:57.360 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.354+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:57.385 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.378+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:57.397 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.391+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.443+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T10:55:57.541 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.535+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:57.570 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.563+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:57.578 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.572+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:57.626 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.619+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T10:55:57.986 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.705+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:57.986 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.758+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:57.986 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.772+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:57.987 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.814+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T10:55:57.987 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.862+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:57.987 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.885+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:57.987 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.895+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:57.987 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:57.923+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T10:55:58.007 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.001+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:58.036 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.029+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:58.053 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.046+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:58.098 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.092+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T10:55:58.155 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.148+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:58.177 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.171+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:58.186 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.180+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:58.218 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.212+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T10:55:58.256 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.250+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:58.272 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.265+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:58.280 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.274+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:58.316 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.310+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T10:55:58.352 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.346+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:58.367 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.361+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:58.376 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.370+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:58.409 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.402+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T10:55:58.449 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.442+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:58.464 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.458+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:58.473 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.466+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:58.507 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.500+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T10:55:58.586 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.580+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:58.608 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.602+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:58.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.617+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:58.687 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.681+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T10:55:58.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.748+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:58.786 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.780+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:58.800 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.793+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:58.855 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.849+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T10:55:58.929 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.923+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:58.957 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.950+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:58.972 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:58.965+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:59.019 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.012+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T10:55:59.108 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.099+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:59.138 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.131+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:59.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.152+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:59.214 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.207+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T10:55:59.293 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.286+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:59.333 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.327+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:59.366 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.360+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:59.415 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.408+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T10:55:59.495 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.489+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:59.517 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.511+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:59.528 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.522+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:59.568 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.561+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T10:55:59.641 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.635+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:59.666 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.660+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:59.686 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.680+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:59.738 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.732+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T10:55:59.791 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.784+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.805+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:59.824 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.818+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:59.866 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.860+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T10:55:59.931 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.925+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:55:59.952 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.945+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:55:59.966 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.959+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:00.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:55:59.997+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T10:56:00.075 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.069+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:00.112 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.106+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:00.126 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.120+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:00.165 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.159+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T10:56:00.251 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.244+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:00.280 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.274+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:00.302 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.295+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:00.351 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.344+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T10:56:00.408 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.402+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:00.444 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.438+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:00.460 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.454+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:00.522 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.515+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T10:56:00.599 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.591+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:00.626 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.619+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:00.638 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.632+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:00.684 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.677+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T10:56:00.754 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.747+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:00.778 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.771+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:00.789 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.783+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:00.834 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.827+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T10:56:00.907 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.901+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:00.936 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.929+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:00.953 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.946+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:00.995 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:00.989+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T10:56:01.058 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.051+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:01.085 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.079+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:01.104 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.098+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:01.158 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.152+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T10:56:01.227 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.220+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:01.250 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.243+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:01.262 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.255+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:01.343 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.336+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T10:56:01.396 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.390+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:01.418 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.411+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:01.427 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.420+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:01.480 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.473+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T10:56:01.566 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.559+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:01.599 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.592+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:01.617 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.610+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:01.683 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.677+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T10:56:01.760 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.754+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:01.801 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.795+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:01.823 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.817+0000 7f0ca9fbbec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:01.912 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.905+0000 7f0ca9fbbec0 20 remove_watcher() i=0 2019-12-09T10:56:01.912 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.906+0000 7f0ca9fbbec0 2 removed watcher, disabling cache 2019-12-09T10:56:01.967 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:01.960+0000 7f0ca9fbbec0 20 remove_watcher() i=1 2019-12-09T10:56:02.018 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.011+0000 7f0ca9fbbec0 20 remove_watcher() i=2 2019-12-09T10:56:02.055 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.049+0000 7f0ca9fbbec0 20 remove_watcher() i=3 2019-12-09T10:56:02.092 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.086+0000 7f0ca9fbbec0 20 remove_watcher() i=4 2019-12-09T10:56:02.141 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.129+0000 7f0ca9fbbec0 20 remove_watcher() i=5 2019-12-09T10:56:02.168 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.162+0000 7f0ca9fbbec0 20 remove_watcher() i=6 2019-12-09T10:56:02.193 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.187+0000 7f0ca9fbbec0 20 remove_watcher() i=7 2019-12-09T10:56:02.200 INFO:teuthology.orchestra.run.smithi121:> radosgw-admin gc process --include-all 2019-12-09T10:56:02.305 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.298+0000 7eff88055ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:02.337 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.331+0000 7eff88055ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:56:02.337 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.331+0000 7eff88055ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:02.349 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.342+0000 7eff88055ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:56:02.349 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.342+0000 7eff88055ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:02.359 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.353+0000 7eff88055ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:56:02.360 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.353+0000 7eff88055ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:02.384 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.377+0000 7eff88055ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:56:02.812 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.806+0000 7eff88055ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T10:56:02.812 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.806+0000 7eff88055ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T10:56:02.813 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.806+0000 7eff88055ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T10:56:02.813 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.806+0000 7eff88055ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T10:56:02.813 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.806+0000 7eff88055ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:02.829 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.822+0000 7eff88055ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:56:02.829 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.822+0000 7eff88055ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:02.843 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.836+0000 7eff88055ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:56:02.843 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.836+0000 7eff88055ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:02.856 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.850+0000 7eff88055ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:56:02.856 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.850+0000 7eff88055ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:02.868 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.862+0000 7eff88055ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:56:02.869 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.862+0000 7eff88055ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:02.880 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.873+0000 7eff88055ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:56:02.880 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.873+0000 7eff88055ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T10:56:02.880 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.873+0000 7eff88055ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:02.890 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.883+0000 7eff88055ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:56:02.890 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.883+0000 7eff88055ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:02.907 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.900+0000 7eff88055ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:56:02.907 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.900+0000 7eff88055ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:02.918 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.912+0000 7eff88055ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:56:02.919 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.912+0000 7eff88055ec0 20 zonegroup default 2019-12-09T10:56:02.919 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.912+0000 7eff88055ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:02.929 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.923+0000 7eff88055ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:56:02.930 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.923+0000 7eff88055ec0 10 Cannot find current period zone using local zone 2019-12-09T10:56:02.930 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.923+0000 7eff88055ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:02.942 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.935+0000 7eff88055ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:56:02.942 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.935+0000 7eff88055ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:02.957 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.950+0000 7eff88055ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:56:02.957 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.950+0000 7eff88055ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:02.971 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.965+0000 7eff88055ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:56:02.972 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.965+0000 7eff88055ec0 20 zone default found 2019-12-09T10:56:02.972 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.965+0000 7eff88055ec0 20 started sync module instance, tier type = 2019-12-09T10:56:02.972 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:02.965+0000 7eff88055ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T10:56:03.406 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:03.399+0000 7eff88055ec0 20 add_watcher() i=0 2019-12-09T10:56:03.406 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:03.399+0000 7eff88055ec0 20 add_watcher() i=1 2019-12-09T10:56:03.406 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:03.399+0000 7eff88055ec0 20 add_watcher() i=2 2019-12-09T10:56:03.406 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:03.399+0000 7eff88055ec0 20 add_watcher() i=3 2019-12-09T10:56:03.406 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:03.399+0000 7eff88055ec0 20 add_watcher() i=4 2019-12-09T10:56:03.407 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:03.399+0000 7eff88055ec0 20 add_watcher() i=5 2019-12-09T10:56:03.407 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:03.399+0000 7eff88055ec0 20 add_watcher() i=6 2019-12-09T10:56:03.441 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:03.435+0000 7eff88055ec0 20 add_watcher() i=7 2019-12-09T10:56:03.442 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:03.435+0000 7eff88055ec0 2 all 8 watchers are set, enabling cache 2019-12-09T10:56:03.442 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:03.435+0000 7eff45fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T10:56:03.445 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:03.439+0000 7eff75a80700 0 -- 172.21.15.121:0/692326283 >> v2:172.21.15.132:3300/0 conn(0x5610b1c33f60 msgr2=0x5610b1c482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T10:56:03.485 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:03.479+0000 7eff7527f700 0 -- 172.21.15.121:0/2855845864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5610b1c2fe70 msgr2=0x5610b1c732b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T10:56:05.126 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.120+0000 7efeb7fff700 20 reqs_thread_entry: start 2019-12-09T10:56:05.127 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.120+0000 7efeb5ffb700 20 reqs_thread_entry: start 2019-12-09T10:56:05.127 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.120+0000 7eff88055ec0 20 init_complete bucket index max shards: 0 2019-12-09T10:56:05.127 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.120+0000 7efea3fff700 20 reqs_thread_entry: start 2019-12-09T10:56:05.127 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.120+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T10:56:05.171 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.165+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:05.187 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.181+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:05.196 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.189+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:05.237 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.230+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T10:56:05.316 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.307+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:05.345 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.339+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:05.358 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.352+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:05.398 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.392+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T10:56:05.438 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.431+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:05.456 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.450+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:05.467 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.460+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:05.499 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.492+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T10:56:05.551 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.545+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:05.574 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.568+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:05.590 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.583+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:05.643 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.636+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T10:56:05.713 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.707+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:05.738 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.731+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:05.747 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.741+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.794+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T10:56:05.884 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.877+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:05.942 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.935+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:05.968 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:05.961+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:06.030 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.024+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T10:56:06.083 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.077+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:06.106 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.099+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:06.115 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.109+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:06.171 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.165+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T10:56:06.232 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.225+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:06.249 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.243+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:06.260 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.254+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:06.295 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.288+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T10:56:06.339 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.332+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:06.354 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.348+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:06.363 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.357+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:06.395 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.389+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T10:56:06.437 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.430+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:06.453 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.447+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:06.462 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.455+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:06.493 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.487+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T10:56:06.569 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.563+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:06.592 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.585+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:06.607 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.601+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:06.657 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.651+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T10:56:06.718 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.712+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:06.745 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.739+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:06.754 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.748+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:06.806 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.799+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T10:56:06.881 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.875+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:06.905 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.899+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:06.913 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.907+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:06.978 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:06.971+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T10:56:07.050 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.044+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:07.072 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.066+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:07.082 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.076+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:07.130 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.124+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T10:56:07.186 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.179+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:07.216 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.210+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:07.230 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.224+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:07.268 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.261+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T10:56:07.364 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.357+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:07.384 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.378+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:07.406 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.400+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:07.449 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.442+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T10:56:07.504 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.498+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:07.523 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.517+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:07.533 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.527+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:07.567 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.561+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T10:56:07.617 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.611+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:07.644 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.638+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:07.658 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.652+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:07.703 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.696+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T10:56:07.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.749+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:07.777 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.771+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:07.790 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.783+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:07.839 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.832+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T10:56:07.929 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.923+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:07.965 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.958+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:07.979 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:07.973+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:08.033 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.027+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T10:56:08.106 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.100+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:08.129 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.122+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:08.141 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.135+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:08.179 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.173+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T10:56:08.277 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.270+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:08.306 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.300+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:08.318 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.312+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:08.371 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.364+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T10:56:08.446 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.439+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:08.475 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.469+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:08.494 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.487+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:08.542 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.536+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T10:56:08.632 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.626+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:08.657 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.650+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:08.666 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.660+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:08.715 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.708+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T10:56:08.769 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.763+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:08.791 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.784+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:08.803 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.797+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:08.854 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.847+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T10:56:08.912 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.905+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:08.954 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.947+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:08.965 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.959+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:08.998 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:08.991+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T10:56:09.041 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.034+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:09.057 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.050+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:09.067 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.061+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:09.107 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.100+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T10:56:09.165 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.159+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:09.181 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.174+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:09.189 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.183+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:09.234 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.228+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T10:56:09.311 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.304+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:09.336 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.329+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:09.348 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.342+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:09.398 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.392+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T10:56:09.476 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.470+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:09.511 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.505+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:09.536 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.529+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:09.591 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.585+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T10:56:09.681 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.675+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:09.708 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.702+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:09.722 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.716+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:09.781 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.774+0000 7eff88055ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T10:56:09.840 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.833+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:09.859 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.853+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:09.872 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.866+0000 7eff88055ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:09.953 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.947+0000 7eff88055ec0 20 remove_watcher() i=0 2019-12-09T10:56:09.954 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.947+0000 7eff88055ec0 2 removed watcher, disabling cache 2019-12-09T10:56:10.003 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:09.996+0000 7eff88055ec0 20 remove_watcher() i=1 2019-12-09T10:56:10.071 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.065+0000 7eff88055ec0 20 remove_watcher() i=2 2019-12-09T10:56:10.107 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.101+0000 7eff88055ec0 20 remove_watcher() i=3 2019-12-09T10:56:10.150 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.143+0000 7eff88055ec0 20 remove_watcher() i=4 2019-12-09T10:56:10.184 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.177+0000 7eff88055ec0 20 remove_watcher() i=5 2019-12-09T10:56:10.234 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.228+0000 7eff88055ec0 20 remove_watcher() i=6 2019-12-09T10:56:10.271 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.264+0000 7eff88055ec0 20 remove_watcher() i=7 2019-12-09T10:56:10.279 INFO:teuthology.orchestra.run.smithi121:> radosgw-admin gc process --include-all 2019-12-09T10:56:10.379 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.373+0000 7fc5d1253ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:10.409 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.403+0000 7fc5d1253ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:56:10.409 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.403+0000 7fc5d1253ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:10.417 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.411+0000 7fc5d1253ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:56:10.417 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.411+0000 7fc5d1253ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:10.425 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.419+0000 7fc5d1253ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:56:10.426 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.419+0000 7fc5d1253ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:10.448 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.441+0000 7fc5d1253ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:56:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.658+0000 7fc5d1253ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T10:56:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.658+0000 7fc5d1253ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T10:56:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.658+0000 7fc5d1253ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T10:56:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.658+0000 7fc5d1253ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T10:56:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.658+0000 7fc5d1253ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:10.680 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.673+0000 7fc5d1253ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:56:10.680 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.673+0000 7fc5d1253ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:10.698 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.691+0000 7fc5d1253ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:56:10.698 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.691+0000 7fc5d1253ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:10.710 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.703+0000 7fc5d1253ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:56:10.710 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.703+0000 7fc5d1253ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:10.725 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.718+0000 7fc5d1253ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:56:10.725 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.718+0000 7fc5d1253ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:10.735 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.729+0000 7fc5d1253ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:56:10.735 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.729+0000 7fc5d1253ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T10:56:10.736 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.729+0000 7fc5d1253ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:10.742 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.736+0000 7fc5d1253ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:56:10.742 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.736+0000 7fc5d1253ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:10.754 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.748+0000 7fc5d1253ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:56:10.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.748+0000 7fc5d1253ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:10.766 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.759+0000 7fc5d1253ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T10:56:10.766 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.759+0000 7fc5d1253ec0 20 zonegroup default 2019-12-09T10:56:10.766 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.759+0000 7fc5d1253ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:10.776 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.770+0000 7fc5d1253ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:56:10.777 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.770+0000 7fc5d1253ec0 10 Cannot find current period zone using local zone 2019-12-09T10:56:10.777 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.770+0000 7fc5d1253ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:10.781 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.775+0000 7fc5d1253ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T10:56:10.782 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.775+0000 7fc5d1253ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:10.797 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.791+0000 7fc5d1253ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T10:56:10.798 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.791+0000 7fc5d1253ec0 20 rados->read ofs=0 len=0 2019-12-09T10:56:10.808 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.801+0000 7fc5d1253ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T10:56:10.808 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.801+0000 7fc5d1253ec0 20 zone default found 2019-12-09T10:56:10.808 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.801+0000 7fc5d1253ec0 20 started sync module instance, tier type = 2019-12-09T10:56:10.808 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:10.801+0000 7fc5d1253ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T10:56:11.183 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:11.176+0000 7fc5d1253ec0 20 add_watcher() i=0 2019-12-09T10:56:11.183 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:11.176+0000 7fc5d1253ec0 20 add_watcher() i=1 2019-12-09T10:56:11.183 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:11.176+0000 7fc5d1253ec0 20 add_watcher() i=2 2019-12-09T10:56:11.184 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:11.177+0000 7fc5d1253ec0 20 add_watcher() i=3 2019-12-09T10:56:11.184 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:11.177+0000 7fc5d1253ec0 20 add_watcher() i=4 2019-12-09T10:56:11.184 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:11.177+0000 7fc5d1253ec0 20 add_watcher() i=5 2019-12-09T10:56:11.184 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:11.177+0000 7fc5d1253ec0 20 add_watcher() i=6 2019-12-09T10:56:11.217 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:11.210+0000 7fc5d1253ec0 20 add_watcher() i=7 2019-12-09T10:56:11.217 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:11.211+0000 7fc5d1253ec0 2 all 8 watchers are set, enabling cache 2019-12-09T10:56:11.217 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:11.211+0000 7fc58dfeb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T10:56:11.220 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:11.214+0000 7fc5b7fff700 0 -- 172.21.15.121:0/2481712711 >> v2:172.21.15.132:3300/0 conn(0x55f6923ea500 msgr2=0x55f6923ea910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T10:56:11.259 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:11.253+0000 7fc5b7fff700 0 -- 172.21.15.121:0/2698494779 >> [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] conn(0x55f692425b10 msgr2=0x55f692427f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T10:56:13.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:12.997+0000 7fc4fffff700 20 reqs_thread_entry: start 2019-12-09T10:56:13.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:12.997+0000 7fc4fdffb700 20 reqs_thread_entry: start 2019-12-09T10:56:13.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:12.997+0000 7fc5d1253ec0 20 init_complete bucket index max shards: 0 2019-12-09T10:56:13.005 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:12.998+0000 7fc4ebfff700 20 reqs_thread_entry: start 2019-12-09T10:56:13.005 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:12.998+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T10:56:13.085 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.079+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:13.112 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.105+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:13.126 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.120+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:13.172 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.166+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T10:56:13.246 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.240+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:13.270 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.263+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:13.282 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.275+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:13.322 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.316+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T10:56:13.405 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.398+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:13.422 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.416+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:13.432 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.425+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:13.469 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.463+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T10:56:13.547 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.541+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:13.588 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.581+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:13.604 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.598+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:13.649 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.643+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T10:56:13.706 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.699+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:13.730 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.723+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:13.738 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.732+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:13.784 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.778+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T10:56:13.844 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.837+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:13.865 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.858+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:13.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.872+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:13.922 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.915+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T10:56:13.973 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.966+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:13.990 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.984+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:13.999 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:13.993+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:14.033 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.027+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T10:56:14.080 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.073+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:14.100 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.091+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:14.108 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.102+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.139+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T10:56:14.212 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.206+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:14.240 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.234+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:14.254 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.247+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:14.306 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.300+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T10:56:14.381 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.375+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:14.410 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.404+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:14.425 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.419+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:14.465 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.458+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T10:56:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.514+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:14.539 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.532+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:14.548 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.542+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:14.584 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.578+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T10:56:14.647 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.640+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:14.669 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.662+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:14.681 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.675+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:14.721 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.715+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T10:56:14.786 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.779+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:14.818 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.811+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:14.828 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.822+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:14.870 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.864+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T10:56:14.920 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.914+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:14.944 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.936+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:14.957 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.951+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:15.003 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:14.997+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T10:56:15.084 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.077+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:15.109 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.102+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:15.124 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.117+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:15.175 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.169+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T10:56:15.250 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.244+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:15.277 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.270+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:15.290 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.283+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:15.327 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.320+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T10:56:15.451 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.444+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:15.479 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.473+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:15.495 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.489+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:15.549 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.543+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T10:56:15.612 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.606+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:15.632 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.625+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:15.645 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.639+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:15.686 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.680+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T10:56:15.741 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.734+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:15.764 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.757+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:15.775 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.769+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:15.813 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.806+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T10:56:15.880 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.873+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:15.907 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.901+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:15.919 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.913+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:15.973 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:15.967+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T10:56:16.065 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.059+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:16.105 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.098+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:16.126 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.120+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:16.164 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.158+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T10:56:16.222 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.216+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:16.241 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.235+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:16.251 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.245+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:16.285 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.279+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T10:56:16.338 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.331+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:16.359 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.353+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:16.373 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.366+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:16.418 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.411+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T10:56:16.477 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.470+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.491+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:16.508 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.502+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:16.548 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.542+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T10:56:16.632 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.625+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:16.662 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.655+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:16.679 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.673+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:16.724 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.718+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T10:56:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.765+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:16.791 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.785+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:16.802 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.796+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:16.835 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.829+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T10:56:16.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.872+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:16.897 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.891+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:16.906 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.900+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.936+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T10:56:16.984 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.978+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:17.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:16.996+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:17.011 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.005+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:17.053 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.047+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T10:56:17.109 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.103+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.123+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.132+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:17.173 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.167+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T10:56:17.213 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.207+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:17.231 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.225+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:17.240 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.234+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.355+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T10:56:17.432 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.425+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:17.459 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.452+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:17.473 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.467+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:17.514 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.507+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T10:56:17.578 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.571+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:17.602 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.596+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T10:56:17.612 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.606+0000 7fc5d1253ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T10:56:17.716 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.709+0000 7fc5d1253ec0 20 remove_watcher() i=0 2019-12-09T10:56:17.716 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.709+0000 7fc5d1253ec0 2 removed watcher, disabling cache 2019-12-09T10:56:17.777 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.770+0000 7fc5d1253ec0 20 remove_watcher() i=1 2019-12-09T10:56:17.843 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.837+0000 7fc5d1253ec0 20 remove_watcher() i=2 2019-12-09T10:56:17.919 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.912+0000 7fc5d1253ec0 20 remove_watcher() i=3 2019-12-09T10:56:17.980 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:17.974+0000 7fc5d1253ec0 20 remove_watcher() i=4 2019-12-09T10:56:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:18.039+0000 7fc5d1253ec0 20 remove_watcher() i=5 2019-12-09T10:56:18.100 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:18.093+0000 7fc5d1253ec0 20 remove_watcher() i=6 2019-12-09T10:56:18.163 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T10:56:18.156+0000 7fc5d1253ec0 20 remove_watcher() i=7 2019-12-09T10:56:18.323 INFO:teuthology.orchestra.run.smithi121:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2019-12-09T10:56:18.895 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :clean 2019-12-09T10:56:19.394 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :compileJava 2019-12-09T10:56:19.492 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :processResources 2019-12-09T10:56:19.493 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :classes 2019-12-09T10:56:19.594 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:56:19.594 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :compileTestJava 2019-12-09T10:56:19.594 INFO:teuthology.orchestra.run.smithi121.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-12-09T10:56:19.594 INFO:teuthology.orchestra.run.smithi121.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-12-09T10:56:19.594 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:56:19.594 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :processTestResources NO-SOURCE 2019-12-09T10:56:19.595 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :testClasses 2019-12-09T10:56:22.293 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:56:22.293 INFO:teuthology.orchestra.run.smithi121.stdout:> Task :test 2019-12-09T10:56:22.293 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:56:22.293 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2019-12-09T10:56:27.992 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:56:27.993 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2019-12-09T10:56:40.592 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:56:40.593 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2019-12-09T10:56:45.492 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:56:45.493 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2019-12-09T10:56:54.192 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:56:54.192 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2019-12-09T10:56:57.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:56:57.793 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2019-12-09T10:57:04.592 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:57:04.592 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2019-12-09T10:57:57.446 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:18:55.470 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:57:57.451 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:18:55.474 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:57:57.465 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:18:55.435 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:57:57.471 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:18:55.441 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:57:57.498 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:18:55.522 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:57:57.508 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:18:55.528 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:57:57.564 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:18:55.587 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T10:57:57.582 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:18:55.550 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T10:57:57.628 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:18:55.651 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T10:58:11.392 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:58:11.392 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2019-12-09T10:58:17.692 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:58:17.692 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2019-12-09T10:58:19.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:58:19.792 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2019-12-09T10:58:27.492 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:58:27.492 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2019-12-09T10:58:31.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:58:31.792 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2019-12-09T10:58:40.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:58:40.792 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2019-12-09T10:58:41.192 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:58:41.192 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2019-12-09T10:58:42.592 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:58:42.592 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2019-12-09T10:58:45.892 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:58:45.892 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2019-12-09T10:58:52.092 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:58:52.092 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2019-12-09T10:59:32.192 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:59:32.192 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2019-12-09T10:59:40.292 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:59:40.293 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2019-12-09T10:59:43.992 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:59:43.992 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2019-12-09T10:59:53.992 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:59:53.992 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2019-12-09T10:59:59.292 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T10:59:59.293 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2019-12-09T11:00:08.692 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:00:08.693 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2019-12-09T11:00:10.992 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:00:10.992 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2019-12-09T11:00:18.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:00:18.792 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2019-12-09T11:00:21.292 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:00:21.292 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2019-12-09T11:00:26.392 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:00:26.392 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2019-12-09T11:00:29.592 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:00:29.592 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2019-12-09T11:00:36.692 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:00:36.692 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2019-12-09T11:00:37.992 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:00:37.993 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2019-12-09T11:00:46.292 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:00:46.292 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2019-12-09T11:00:53.192 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:00:53.192 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2019-12-09T11:00:58.292 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:00:58.292 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2019-12-09T11:01:40.892 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:01:40.892 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2019-12-09T11:01:56.492 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:01:56.492 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2019-12-09T11:03:08.565 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:24:06.588 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:08.572 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:24:06.596 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:08.581 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:24:06.550 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:08.582 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:24:06.605 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:08.584 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:24:06.607 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:08.587 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:24:06.555 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:08.744 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:24:06.767 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:08.789 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:24:06.759 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:08.875 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:24:06.898 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:28.614 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:24:26.637 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:28.657 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:24:26.680 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:28.682 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:24:26.705 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:28.688 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:24:26.657 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:28.699 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:24:26.669 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:28.727 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:24:26.750 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:28.732 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:24:26.755 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:28.742 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:24:26.711 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:03:28.755 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:24:26.778 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:06:13.293 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:06:13.293 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2019-12-09T11:06:30.593 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:06:30.593 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2019-12-09T11:06:32.993 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:06:32.993 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2019-12-09T11:06:39.693 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:06:39.693 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2019-12-09T11:06:44.593 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:06:44.593 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2019-12-09T11:06:56.993 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:06:56.993 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2019-12-09T11:07:56.393 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:07:56.393 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2019-12-09T11:08:06.693 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:08:06.693 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2019-12-09T11:08:06.793 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:08:06.793 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2019-12-09T11:08:07.593 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:08:07.593 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2019-12-09T11:08:20.634 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:29:18.656 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:08:20.640 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:29:18.663 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:08:20.651 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:29:18.673 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:08:20.654 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:29:18.676 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:08:20.658 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:29:18.626 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:08:20.668 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:29:18.637 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:08:20.811 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:29:18.833 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:08:20.834 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:29:18.856 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:08:20.914 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:29:18.882 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:09:05.327 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T11:09:05.265+0000 816fa700 -1 handle_data failed with exit code -104 2019-12-09T11:09:06.893 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:09:06.894 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2019-12-09T11:09:14.693 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:09:14.693 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2019-12-09T11:10:46.693 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:10:46.694 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2019-12-09T11:11:00.693 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:11:00.693 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2019-12-09T11:11:50.191 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:32:48.213 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:11:50.257 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:32:48.226 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:11:50.258 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:32:48.281 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:11:50.260 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:32:48.229 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:11:50.262 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:32:48.285 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:11:50.273 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:32:48.296 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:11:50.359 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:32:48.381 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:11:50.370 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:32:48.339 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:11:50.418 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:32:48.440 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:12:08.492 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:12:08.493 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2019-12-09T11:12:16.093 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:12:16.093 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2019-12-09T11:13:33.091 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:34:31.114 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:13:33.099 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:34:31.122 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:13:33.109 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:34:31.129 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:13:33.109 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:34:31.131 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:13:33.124 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:34:31.092 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:13:33.136 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:34:31.105 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:13:33.170 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:34:31.192 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:13:33.182 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:34:31.205 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:13:33.265 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:34:31.233 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:18:45.893 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:18:45.893 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2019-12-09T11:18:46.648 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:39:44.671 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:18:46.656 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:39:44.679 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:18:46.662 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:39:44.684 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:18:46.666 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:39:44.689 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:18:46.671 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:39:44.641 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:18:46.683 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:39:44.653 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:18:46.839 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:39:44.861 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:18:46.843 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:39:44.866 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:18:46.905 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:39:44.875 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:18:53.592 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:18:53.593 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2019-12-09T11:20:11.910 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:41:09.932 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:20:11.913 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:41:09.936 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:20:11.946 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:41:09.969 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:20:11.961 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:41:09.984 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:20:11.984 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:41:09.954 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:20:11.994 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:41:10.016 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:20:11.995 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:41:09.965 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:20:12.056 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:41:10.079 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:20:12.064 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:41:10.034 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:20:31.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:20:31.793 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2019-12-09T11:20:42.793 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:20:42.793 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2019-12-09T11:21:37.443 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:42:35.466 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:21:37.470 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:42:35.492 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:21:37.505 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:42:35.474 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:21:37.507 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:42:35.476 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:21:37.507 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:42:35.530 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:21:37.521 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:42:35.538 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:21:37.550 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:42:35.573 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:21:37.570 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:42:35.539 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:21:37.580 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:42:35.603 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:21:40.893 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:21:40.893 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2019-12-09T11:21:47.492 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:21:47.493 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2019-12-09T11:22:05.493 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:22:05.493 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2019-12-09T11:22:23.293 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:22:23.293 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2019-12-09T11:22:23.993 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:22:23.993 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2019-12-09T11:22:25.093 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:22:25.093 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative STARTED 2019-12-09T11:22:27.393 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:22:27.393 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative PASSED 2019-12-09T11:22:43.793 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:22:43.793 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2019-12-09T11:22:47.493 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:22:47.493 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2019-12-09T11:23:10.893 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:23:10.893 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2019-12-09T11:23:13.793 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:23:13.793 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2019-12-09T11:23:39.893 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:23:39.893 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2019-12-09T11:23:44.893 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:23:44.893 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2019-12-09T11:23:57.181 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:44:55.204 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:57.187 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:44:55.210 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:57.198 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:44:55.221 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:57.204 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:44:55.227 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:57.211 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:44:55.180 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:57.220 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:44:55.189 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:57.286 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:44:55.309 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:57.303 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:44:55.326 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:23:57.422 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:44:55.391 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:24:14.093 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:24:14.093 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2019-12-09T11:24:22.493 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:24:22.493 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2019-12-09T11:25:13.693 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:25:13.693 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2019-12-09T11:25:24.393 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:25:24.393 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2019-12-09T11:26:54.493 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:26:54.493 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2019-12-09T11:27:06.893 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:27:06.893 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2019-12-09T11:28:22.993 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:28:22.994 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2019-12-09T11:28:38.785 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:49:36.807 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:28:38.824 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:49:36.847 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:28:38.914 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:49:36.883 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:28:38.920 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:49:36.889 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:28:38.937 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:49:36.960 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:28:39.005 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:49:37.027 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:28:39.011 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:49:37.033 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:28:39.075 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:49:37.043 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:28:39.138 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:49:37.160 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:29:09.946 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:50:07.968 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:29:09.954 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:50:07.977 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:29:09.958 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:50:07.927 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:29:09.960 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:50:07.982 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:29:09.967 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:50:07.988 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:29:09.968 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:50:07.932 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:29:09.992 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:50:08.015 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:29:10.004 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:50:08.026 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:29:10.023 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:50:07.992 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:29:44.193 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:29:44.193 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2019-12-09T11:32:09.393 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:32:09.403 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2019-12-09T11:34:23.930 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:55:21.952 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:34:23.937 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:55:21.959 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:34:23.952 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:55:21.974 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:34:23.955 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:55:21.976 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:34:23.962 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:55:21.931 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:34:23.988 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:55:21.957 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:34:24.144 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:55:22.166 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:34:24.181 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:55:22.203 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:34:24.229 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:55:22.197 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:34:25.994 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:34:25.994 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2019-12-09T11:37:00.462 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:57:58.483 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:37:00.477 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:57:58.497 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:37:00.512 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:57:58.533 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:37:00.514 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:57:58.535 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:37:00.544 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:57:58.512 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:37:00.551 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:57:58.520 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:37:00.572 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:01:57:58.593 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:37:00.607 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:01:57:58.628 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:37:00.694 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:01:57:58.662 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:38:05.394 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:38:05.395 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2019-12-09T11:39:36.034 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:00:34.055 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:39:36.044 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:00:34.065 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:39:36.050 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:00:34.071 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:39:36.054 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:00:34.075 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:39:36.055 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:00:34.024 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:39:36.063 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:00:34.032 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:39:36.152 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:00:34.173 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:39:36.159 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:00:34.180 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:39:36.172 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:00:34.141 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:40:59.595 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:40:59.596 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2019-12-09T11:44:48.041 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:05:46.061 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:44:48.048 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:05:46.069 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:44:48.054 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:05:46.074 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:44:48.057 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:05:46.077 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:44:48.072 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:05:46.041 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:44:48.089 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:05:46.058 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:44:48.230 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:05:46.251 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:44:48.298 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:05:46.318 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:44:48.327 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:05:46.296 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:45:22.127 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:06:20.147 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:45:22.144 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:06:20.164 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:45:22.173 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:06:20.193 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:45:22.175 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:06:20.195 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:45:22.189 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:06:20.209 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:45:22.209 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:06:20.178 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:45:22.215 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:06:20.184 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:45:22.217 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:06:20.237 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:45:22.252 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:06:20.221 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:46:33.495 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:46:33.496 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2019-12-09T11:49:38.095 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:49:38.105 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2019-12-09T11:49:59.017 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:10:57.038 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:49:59.027 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:10:57.048 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:49:59.036 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:10:57.057 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:49:59.039 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:10:57.060 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:49:59.048 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:10:57.018 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:49:59.061 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:10:57.030 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:49:59.264 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:10:57.284 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:49:59.270 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:10:57.240 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:49:59.287 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:10:57.307 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:43.829 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:14:41.851 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:43.831 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:14:41.853 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:43.858 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:14:41.880 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:43.876 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:14:41.898 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:43.914 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:14:41.884 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:43.916 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:14:41.886 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:43.930 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:14:41.952 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:43.959 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:14:41.980 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:53:44.047 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:14:42.017 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:54:15.093 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:54:15.093 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2019-12-09T11:55:12.762 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:16:10.784 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:55:12.775 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:16:10.797 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:55:12.789 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:16:10.811 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:55:12.791 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:16:10.762 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:55:12.794 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:16:10.816 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:55:12.837 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:16:10.808 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:55:12.863 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:16:10.886 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T11:55:12.868 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:16:10.890 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T11:55:12.997 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:16:10.965 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T11:57:24.393 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T11:57:24.402 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2019-12-09T12:00:15.993 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:00:16.002 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2019-12-09T12:00:22.882 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:21:20.905 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:00:22.888 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:21:20.911 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:00:22.899 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:21:20.921 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:00:22.902 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:21:20.925 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:00:22.903 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:21:20.874 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:00:22.932 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:21:20.903 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:00:23.077 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:21:21.100 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:00:23.090 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:21:21.113 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:00:23.165 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:21:21.135 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:05.458 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:23:03.481 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:05.466 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:23:03.489 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:05.508 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:23:03.479 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:06.421 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:23:03.535 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:06.421 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:23:03.537 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:06.422 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:23:03.610 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:06.422 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:23:03.555 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:06.422 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:23:03.489 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:06.422 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:23:03.565 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:08.793 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:02:08.793 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2019-12-09T12:02:50.905 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:23:48.928 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:50.938 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:23:48.961 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:50.940 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:23:48.963 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:50.951 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:23:48.974 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:51.001 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:23:49.024 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:51.024 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:23:49.047 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:51.028 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:23:49.000 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:51.032 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:23:49.004 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:02:51.098 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:23:49.070 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:04:33.592 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:04:33.594 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2019-12-09T12:05:27.092 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:05:27.103 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2019-12-09T12:05:31.380 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:26:29.403 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:31.386 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:26:29.409 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:31.396 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:26:29.419 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:31.403 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:26:29.426 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:31.410 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:26:29.381 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:31.418 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:26:29.389 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:31.489 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:26:29.513 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:31.513 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:26:29.536 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:31.574 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:26:29.545 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:05:57.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:05:57.793 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2019-12-09T12:06:05.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:06:05.792 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2019-12-09T12:06:17.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:06:17.792 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2019-12-09T12:06:28.492 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:06:28.493 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2019-12-09T12:06:40.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:06:40.792 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2019-12-09T12:06:51.092 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:06:51.092 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2019-12-09T12:07:06.492 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:07:06.492 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2019-12-09T12:07:16.692 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:07:16.692 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2019-12-09T12:07:31.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:07:31.793 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2019-12-09T12:07:38.692 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:07:38.693 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2019-12-09T12:07:53.092 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:07:53.092 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2019-12-09T12:08:01.092 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:08:01.093 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2019-12-09T12:08:12.192 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:08:12.192 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2019-12-09T12:08:20.392 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:08:20.392 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2019-12-09T12:08:34.092 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:08:34.093 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2019-12-09T12:08:41.492 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:08:41.492 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2019-12-09T12:08:54.092 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:08:54.092 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2019-12-09T12:09:00.992 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:09:00.992 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2019-12-09T12:09:13.092 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:09:13.092 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2019-12-09T12:09:22.092 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:09:22.093 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2019-12-09T12:09:33.392 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:09:33.392 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2019-12-09T12:09:41.892 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:09:41.892 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2019-12-09T12:09:54.192 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:09:54.192 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2019-12-09T12:09:59.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:09:59.792 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2019-12-09T12:10:11.192 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:10:11.193 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2019-12-09T12:10:19.796 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:10:19.796 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2019-12-09T12:10:27.484 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:31:25.508 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:27.535 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:31:25.558 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:27.538 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:31:25.562 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:27.543 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:31:25.566 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:27.580 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:31:25.551 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:27.586 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:31:25.557 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:27.652 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:31:25.675 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:27.662 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:31:25.685 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:27.731 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:31:25.702 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:30.292 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:10:30.292 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2019-12-09T12:10:35.892 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:10:35.892 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2019-12-09T12:10:46.392 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:10:46.392 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2019-12-09T12:10:47.292 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:31:45.315 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:47.300 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:31:45.323 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:47.308 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:31:45.278 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:47.314 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:31:45.284 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:47.316 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:31:45.339 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:47.324 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:31:45.347 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:47.331 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:31:45.355 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:47.342 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:31:45.313 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:47.355 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:31:45.379 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:10:51.192 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:10:51.192 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2019-12-09T12:11:01.292 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:11:01.292 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2019-12-09T12:11:03.092 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:11:03.092 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2019-12-09T12:11:09.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:11:09.792 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2019-12-09T12:11:12.093 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:11:12.093 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2019-12-09T12:11:17.492 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:11:17.492 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2019-12-09T12:11:20.392 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:11:20.392 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2019-12-09T12:11:29.392 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:11:29.392 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2019-12-09T12:11:33.392 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:11:33.392 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2019-12-09T12:11:39.692 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:11:39.693 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2019-12-09T12:11:48.292 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:11:48.293 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2019-12-09T12:11:53.292 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:11:53.292 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2019-12-09T12:11:53.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:11:53.792 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2019-12-09T12:11:54.492 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:11:54.492 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2019-12-09T12:11:59.292 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:11:59.292 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2019-12-09T12:12:06.592 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:12:06.592 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2019-12-09T12:12:10.692 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:12:10.692 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2019-12-09T12:12:19.692 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:12:19.692 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2019-12-09T12:12:22.592 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:12:22.592 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2019-12-09T12:12:27.892 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:12:27.892 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2019-12-09T12:12:30.992 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:12:30.992 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2019-12-09T12:12:37.492 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:12:37.492 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent STARTED 2019-12-09T12:12:41.193 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:12:41.193 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent PASSED 2019-12-09T12:12:49.092 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:12:49.092 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2019-12-09T12:13:34.892 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:13:34.892 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2019-12-09T12:13:45.092 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:13:45.092 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI STARTED 2019-12-09T12:14:47.492 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:14:47.493 INFO:teuthology.orchestra.run.smithi121.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI PASSED 2019-12-09T12:14:58.492 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:14:58.492 INFO:teuthology.orchestra.run.smithi121.stdout:---------------------------------------------------------------------- 2019-12-09T12:14:58.492 INFO:teuthology.orchestra.run.smithi121.stdout:| Results: SUCCESS (72 tests, 72 successes, 0 failures, 0 skipped) | 2019-12-09T12:14:58.493 INFO:teuthology.orchestra.run.smithi121.stdout:---------------------------------------------------------------------- 2019-12-09T12:14:58.517 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:14:58.517 INFO:teuthology.orchestra.run.smithi121.stdout:BUILD SUCCESSFUL in 1h 18m 40s 2019-12-09T12:14:58.517 INFO:teuthology.orchestra.run.smithi121.stdout:5 actionable tasks: 5 executed 2019-12-09T12:14:58.532 INFO:teuthology.orchestra.run.smithi121:> radosgw-admin gc process --include-all 2019-12-09T12:14:58.671 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.664+0000 7f853e255ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:58.706 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.699+0000 7f853e255ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:58.706 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.699+0000 7f853e255ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:58.717 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.710+0000 7f853e255ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:58.717 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.710+0000 7f853e255ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:58.727 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.720+0000 7f853e255ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:58.727 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.720+0000 7f853e255ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:58.750 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.743+0000 7f853e255ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:14:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.946+0000 7f853e255ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T12:14:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.946+0000 7f853e255ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T12:14:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.946+0000 7f853e255ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T12:14:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.946+0000 7f853e255ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T12:14:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.946+0000 7f853e255ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:58.970 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.964+0000 7f853e255ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:14:58.970 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.964+0000 7f853e255ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:58.985 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.979+0000 7f853e255ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:14:58.986 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.979+0000 7f853e255ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:58.997 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.991+0000 7f853e255ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:14:58.997 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:58.991+0000 7f853e255ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:59.014 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.008+0000 7f853e255ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:14:59.014 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.008+0000 7f853e255ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:59.022 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.016+0000 7f853e255ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:59.022 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.016+0000 7f853e255ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T12:14:59.022 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.016+0000 7f853e255ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:59.033 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.027+0000 7f853e255ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:59.033 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.027+0000 7f853e255ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:59.046 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.040+0000 7f853e255ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:14:59.046 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.040+0000 7f853e255ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:59.061 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.055+0000 7f853e255ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:14:59.061 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.055+0000 7f853e255ec0 20 zonegroup default 2019-12-09T12:14:59.061 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.055+0000 7f853e255ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:59.071 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.065+0000 7f853e255ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:59.071 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.065+0000 7f853e255ec0 10 Cannot find current period zone using local zone 2019-12-09T12:14:59.072 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.065+0000 7f853e255ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:59.080 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.074+0000 7f853e255ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:14:59.080 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.074+0000 7f853e255ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:59.094 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.088+0000 7f853e255ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:14:59.095 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.088+0000 7f853e255ec0 20 rados->read ofs=0 len=0 2019-12-09T12:14:59.112 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.106+0000 7f853e255ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:14:59.112 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.106+0000 7f853e255ec0 20 zone default found 2019-12-09T12:14:59.113 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.106+0000 7f853e255ec0 20 started sync module instance, tier type = 2019-12-09T12:14:59.113 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.106+0000 7f853e255ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T12:14:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.537+0000 7f853e255ec0 20 add_watcher() i=0 2019-12-09T12:14:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.537+0000 7f853e255ec0 20 add_watcher() i=1 2019-12-09T12:14:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.537+0000 7f853e255ec0 20 add_watcher() i=2 2019-12-09T12:14:59.544 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.537+0000 7f853e255ec0 20 add_watcher() i=3 2019-12-09T12:14:59.544 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.537+0000 7f853e255ec0 20 add_watcher() i=4 2019-12-09T12:14:59.544 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.537+0000 7f853e255ec0 20 add_watcher() i=5 2019-12-09T12:14:59.544 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.537+0000 7f853e255ec0 20 add_watcher() i=6 2019-12-09T12:14:59.573 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.566+0000 7f853e255ec0 20 add_watcher() i=7 2019-12-09T12:14:59.573 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.566+0000 7f853e255ec0 2 all 8 watchers are set, enabling cache 2019-12-09T12:14:59.573 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.566+0000 7f84fafed700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T12:14:59.586 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.580+0000 7f852bc80700 0 -- 172.21.15.121:0/2040436124 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55ab08adee00 msgr2=0x55ab08af2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:14:59.608 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:14:59.602+0000 7f852bc80700 0 -- 172.21.15.121:0/3493072859 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x7f846c002bf0 msgr2=0x7f846c005010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T12:15:01.049 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.042+0000 7f84697fa700 20 reqs_thread_entry: start 2019-12-09T12:15:01.049 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.043+0000 7f8462ffd700 20 reqs_thread_entry: start 2019-12-09T12:15:01.050 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.043+0000 7f853e255ec0 20 init_complete bucket index max shards: 0 2019-12-09T12:15:01.050 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.044+0000 7f84617fa700 20 reqs_thread_entry: start 2019-12-09T12:15:01.050 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.044+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T12:15:01.130 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.123+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:01.166 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.159+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:01.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.188+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:15:01.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.188+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1326', time=2019-12-09T13:16:31.911867+0000, chain.objs.size()=9 2019-12-09T12:15:01.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.188+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~Mf0lQOEfG3AjlZvg0yYjVCtKNJH6oKa.1 2019-12-09T12:15:01.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.188+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~Mf0lQOEfG3AjlZvg0yYjVCtKNJH6oKa.1_1 2019-12-09T12:15:01.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.188+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~Mf0lQOEfG3AjlZvg0yYjVCtKNJH6oKa.2 2019-12-09T12:15:01.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.188+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~Mf0lQOEfG3AjlZvg0yYjVCtKNJH6oKa.2_1 2019-12-09T12:15:01.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.188+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~Mf0lQOEfG3AjlZvg0yYjVCtKNJH6oKa.3 2019-12-09T12:15:01.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.188+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~Mf0lQOEfG3AjlZvg0yYjVCtKNJH6oKa.3_1 2019-12-09T12:15:01.196 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.188+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~Mf0lQOEfG3AjlZvg0yYjVCtKNJH6oKa.4 2019-12-09T12:15:01.196 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.188+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~Mf0lQOEfG3AjlZvg0yYjVCtKNJH6oKa.4_1 2019-12-09T12:15:01.196 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.188+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~Mf0lQOEfG3AjlZvg0yYjVCtKNJH6oKa.5 2019-12-09T12:15:01.521 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.515+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:01.633 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.627+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T12:15:01.702 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.696+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:01.721 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.715+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:01.737 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.730+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:15:01.737 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.730+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1336', time=2019-12-09T13:18:45.128846+0000, chain.objs.size()=7 2019-12-09T12:15:01.737 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.730+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~6So2XiXwfKZB-SM2wCGcZgc8UVSdEU_.1 2019-12-09T12:15:01.738 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.730+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~6So2XiXwfKZB-SM2wCGcZgc8UVSdEU_.1_1 2019-12-09T12:15:01.738 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.730+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~6So2XiXwfKZB-SM2wCGcZgc8UVSdEU_.1_2 2019-12-09T12:15:01.738 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.730+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~6So2XiXwfKZB-SM2wCGcZgc8UVSdEU_.2 2019-12-09T12:15:01.738 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.730+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~6So2XiXwfKZB-SM2wCGcZgc8UVSdEU_.2_1 2019-12-09T12:15:01.738 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.730+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~6So2XiXwfKZB-SM2wCGcZgc8UVSdEU_.2_2 2019-12-09T12:15:01.738 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.730+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~6So2XiXwfKZB-SM2wCGcZgc8UVSdEU_.3 2019-12-09T12:15:01.859 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.852+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:01.947 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.941+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T12:15:01.993 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:01.986+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:02.011 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.004+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:02.019 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.013+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:02.055 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.049+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T12:15:02.146 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.140+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:02.170 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.164+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:02.193 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.187+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:15:02.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.187+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.2172', time=2019-12-09T14:14:50.597309+0000, chain.objs.size()=9 2019-12-09T12:15:02.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.187+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.119__multipart_key1/data/file.mpg.2~DMWanmFR8k9Bd9V-xkcykZmcSbbAIAE.1 2019-12-09T12:15:02.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.187+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.119__shadow_key1/data/file.mpg.2~DMWanmFR8k9Bd9V-xkcykZmcSbbAIAE.1_1 2019-12-09T12:15:02.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.187+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.119__multipart_key1/data/file.mpg.2~DMWanmFR8k9Bd9V-xkcykZmcSbbAIAE.2 2019-12-09T12:15:02.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.187+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.119__shadow_key1/data/file.mpg.2~DMWanmFR8k9Bd9V-xkcykZmcSbbAIAE.2_1 2019-12-09T12:15:02.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.187+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.119__multipart_key1/data/file.mpg.2~DMWanmFR8k9Bd9V-xkcykZmcSbbAIAE.3 2019-12-09T12:15:02.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.187+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.119__shadow_key1/data/file.mpg.2~DMWanmFR8k9Bd9V-xkcykZmcSbbAIAE.3_1 2019-12-09T12:15:02.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.187+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.119__multipart_key1/data/file.mpg.2~DMWanmFR8k9Bd9V-xkcykZmcSbbAIAE.4 2019-12-09T12:15:02.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.187+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.119__shadow_key1/data/file.mpg.2~DMWanmFR8k9Bd9V-xkcykZmcSbbAIAE.4_1 2019-12-09T12:15:02.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.187+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.119__multipart_key1/data/file.mpg.2~DMWanmFR8k9Bd9V-xkcykZmcSbbAIAE.5 2019-12-09T12:15:02.407 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.401+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:02.514 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.507+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T12:15:02.574 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.567+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:02.607 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.601+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:02.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.617+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:15:02.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.617+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1200', time=2019-12-09T13:06:15.812009+0000, chain.objs.size()=7 2019-12-09T12:15:02.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.617+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~AAQBhB-ZsQBVtb55FkUsEdLwajpw2xU.1 2019-12-09T12:15:02.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.617+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~AAQBhB-ZsQBVtb55FkUsEdLwajpw2xU.1_1 2019-12-09T12:15:02.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.617+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~AAQBhB-ZsQBVtb55FkUsEdLwajpw2xU.1_2 2019-12-09T12:15:02.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.617+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~AAQBhB-ZsQBVtb55FkUsEdLwajpw2xU.2 2019-12-09T12:15:02.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.617+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~AAQBhB-ZsQBVtb55FkUsEdLwajpw2xU.2_1 2019-12-09T12:15:02.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.617+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~AAQBhB-ZsQBVtb55FkUsEdLwajpw2xU.2_2 2019-12-09T12:15:02.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.617+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~AAQBhB-ZsQBVtb55FkUsEdLwajpw2xU.3 2019-12-09T12:15:02.802 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.795+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:02.866 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.859+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T12:15:02.909 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.903+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:02.926 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.920+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:02.937 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.931+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:02.969 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:02.962+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T12:15:03.015 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.009+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:03.035 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.029+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:03.056 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.049+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:15:03.056 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.049+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1281', time=2019-12-09T13:10:49.078001+0000, chain.objs.size()=9 2019-12-09T12:15:03.056 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.049+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.73__multipart_file.mpg.2~gGnBABZdVWZ00LvQ1_TkW95xkR9EWOH.1 2019-12-09T12:15:03.057 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.049+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.73__shadow_file.mpg.2~gGnBABZdVWZ00LvQ1_TkW95xkR9EWOH.1_1 2019-12-09T12:15:03.057 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.049+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.73__multipart_file.mpg.2~gGnBABZdVWZ00LvQ1_TkW95xkR9EWOH.2 2019-12-09T12:15:03.057 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.049+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.73__shadow_file.mpg.2~gGnBABZdVWZ00LvQ1_TkW95xkR9EWOH.2_1 2019-12-09T12:15:03.057 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.049+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.73__multipart_file.mpg.2~gGnBABZdVWZ00LvQ1_TkW95xkR9EWOH.3 2019-12-09T12:15:03.057 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.049+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.73__shadow_file.mpg.2~gGnBABZdVWZ00LvQ1_TkW95xkR9EWOH.3_1 2019-12-09T12:15:03.057 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.049+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.73__multipart_file.mpg.2~gGnBABZdVWZ00LvQ1_TkW95xkR9EWOH.4 2019-12-09T12:15:03.057 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.049+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.73__shadow_file.mpg.2~gGnBABZdVWZ00LvQ1_TkW95xkR9EWOH.4_1 2019-12-09T12:15:03.058 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.049+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.73__multipart_file.mpg.2~gGnBABZdVWZ00LvQ1_TkW95xkR9EWOH.5 2019-12-09T12:15:03.265 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.259+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:03.336 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.330+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T12:15:03.375 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.368+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:03.391 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.385+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:03.402 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.395+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:03.437 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.431+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T12:15:03.505 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.499+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:03.523 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.517+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:03.537 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.531+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:15:03.537 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.531+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1356', time=2019-12-09T13:20:37.013419+0000, chain.objs.size()=9 2019-12-09T12:15:03.538 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.531+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.76__multipart_key1.2~Okvn6_dzJe26mQf4OCTjUwwC7g2Irvd.1 2019-12-09T12:15:03.538 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.531+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.76__shadow_key1.2~Okvn6_dzJe26mQf4OCTjUwwC7g2Irvd.1_1 2019-12-09T12:15:03.538 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.531+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.76__multipart_key1.2~Okvn6_dzJe26mQf4OCTjUwwC7g2Irvd.2 2019-12-09T12:15:03.538 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.531+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.76__shadow_key1.2~Okvn6_dzJe26mQf4OCTjUwwC7g2Irvd.2_1 2019-12-09T12:15:03.538 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.531+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.76__multipart_key1.2~Okvn6_dzJe26mQf4OCTjUwwC7g2Irvd.3 2019-12-09T12:15:03.538 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.531+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.76__shadow_key1.2~Okvn6_dzJe26mQf4OCTjUwwC7g2Irvd.3_1 2019-12-09T12:15:03.538 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.531+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.76__multipart_key1.2~Okvn6_dzJe26mQf4OCTjUwwC7g2Irvd.4 2019-12-09T12:15:03.539 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.531+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.76__shadow_key1.2~Okvn6_dzJe26mQf4OCTjUwwC7g2Irvd.4_1 2019-12-09T12:15:03.539 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.531+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.76__multipart_key1.2~Okvn6_dzJe26mQf4OCTjUwwC7g2Irvd.5 2019-12-09T12:15:03.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.872+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:03.968 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:03.961+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T12:15:04.014 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.008+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:04.033 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.027+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:04.051 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.044+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:15:04.051 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.044+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1256', time=2019-12-09T13:09:09.418010+0000, chain.objs.size()=9 2019-12-09T12:15:04.051 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.044+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.72__multipart_key1.2~c1z0EInMI6mehJTLGOdrMmRbCw1qg95.1 2019-12-09T12:15:04.051 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.044+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.72__shadow_key1.2~c1z0EInMI6mehJTLGOdrMmRbCw1qg95.1_1 2019-12-09T12:15:04.052 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.044+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.72__multipart_key1.2~c1z0EInMI6mehJTLGOdrMmRbCw1qg95.2 2019-12-09T12:15:04.052 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.044+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.72__shadow_key1.2~c1z0EInMI6mehJTLGOdrMmRbCw1qg95.2_1 2019-12-09T12:15:04.052 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.044+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.72__multipart_key1.2~c1z0EInMI6mehJTLGOdrMmRbCw1qg95.3 2019-12-09T12:15:04.052 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.044+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.72__shadow_key1.2~c1z0EInMI6mehJTLGOdrMmRbCw1qg95.3_1 2019-12-09T12:15:04.052 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.044+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.72__multipart_key1.2~c1z0EInMI6mehJTLGOdrMmRbCw1qg95.4 2019-12-09T12:15:04.052 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.044+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.72__shadow_key1.2~c1z0EInMI6mehJTLGOdrMmRbCw1qg95.4_1 2019-12-09T12:15:04.052 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.044+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.72__multipart_key1.2~c1z0EInMI6mehJTLGOdrMmRbCw1qg95.5 2019-12-09T12:15:04.294 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.288+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:04.380 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.373+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T12:15:04.429 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.423+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:04.445 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.439+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:04.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.454+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T12:15:04.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.454+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1158', time=2019-12-09T13:06:24.579279+0000, chain.objs.size()=5 2019-12-09T12:15:04.462 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.454+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.66__shadow_.IiTXt4ahO9NGm91fM1B4w4hkGUYOzRn_1 2019-12-09T12:15:04.462 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.454+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.66__shadow_.IiTXt4ahO9NGm91fM1B4w4hkGUYOzRn_2 2019-12-09T12:15:04.462 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.454+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.66__shadow_.IiTXt4ahO9NGm91fM1B4w4hkGUYOzRn_3 2019-12-09T12:15:04.462 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.454+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.66__shadow_.IiTXt4ahO9NGm91fM1B4w4hkGUYOzRn_4 2019-12-09T12:15:04.462 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.454+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.66__shadow_.IiTXt4ahO9NGm91fM1B4w4hkGUYOzRn_5 2019-12-09T12:15:04.462 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.454+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1319', time=2019-12-09T13:15:32.753326+0000, chain.objs.size()=9 2019-12-09T12:15:04.462 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.454+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~7vP99lKFHpHqpUZ77K4AWJDzK14wnvG.1 2019-12-09T12:15:04.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.454+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~7vP99lKFHpHqpUZ77K4AWJDzK14wnvG.1_1 2019-12-09T12:15:04.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.454+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~7vP99lKFHpHqpUZ77K4AWJDzK14wnvG.2 2019-12-09T12:15:04.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.454+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~7vP99lKFHpHqpUZ77K4AWJDzK14wnvG.2_1 2019-12-09T12:15:04.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.454+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~7vP99lKFHpHqpUZ77K4AWJDzK14wnvG.3 2019-12-09T12:15:04.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.454+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~7vP99lKFHpHqpUZ77K4AWJDzK14wnvG.3_1 2019-12-09T12:15:04.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.454+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~7vP99lKFHpHqpUZ77K4AWJDzK14wnvG.4 2019-12-09T12:15:04.592 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.585+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~7vP99lKFHpHqpUZ77K4AWJDzK14wnvG.4_1 2019-12-09T12:15:04.685 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.678+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~7vP99lKFHpHqpUZ77K4AWJDzK14wnvG.5 2019-12-09T12:15:04.777 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.770+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:04.934 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.928+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T12:15:04.982 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.976+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.000 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:04.994+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:05.009 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.003+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.042 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.036+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T12:15:05.101 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.095+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.123 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.117+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:05.134 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.128+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.165 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.159+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T12:15:05.253 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.246+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.281 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.275+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:05.301 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.294+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.338 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.332+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T12:15:05.400 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.393+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.421 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.414+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:05.439 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.432+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:15:05.439 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.432+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~K7LKpgQx7nEl8gKdA06K78tnYdItvuc', time=2019-12-09T12:58:10.869195+0000, chain.objs.size()=9 2019-12-09T12:15:05.439 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.432+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.52__multipart_key1.2~K7LKpgQx7nEl8gKdA06K78tnYdItvuc.1 2019-12-09T12:15:05.439 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.432+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.52__shadow_key1.2~K7LKpgQx7nEl8gKdA06K78tnYdItvuc.1_1 2019-12-09T12:15:05.439 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.432+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.52__multipart_key1.2~K7LKpgQx7nEl8gKdA06K78tnYdItvuc.2 2019-12-09T12:15:05.440 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.432+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.52__shadow_key1.2~K7LKpgQx7nEl8gKdA06K78tnYdItvuc.2_1 2019-12-09T12:15:05.440 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.432+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.52__multipart_key1.2~K7LKpgQx7nEl8gKdA06K78tnYdItvuc.3 2019-12-09T12:15:05.440 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.432+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.52__shadow_key1.2~K7LKpgQx7nEl8gKdA06K78tnYdItvuc.3_1 2019-12-09T12:15:05.440 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.432+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.52__multipart_key1.2~K7LKpgQx7nEl8gKdA06K78tnYdItvuc.4 2019-12-09T12:15:05.441 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.432+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.52__shadow_key1.2~K7LKpgQx7nEl8gKdA06K78tnYdItvuc.4_1 2019-12-09T12:15:05.441 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.432+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.52__multipart_key1.2~K7LKpgQx7nEl8gKdA06K78tnYdItvuc.5 2019-12-09T12:15:05.637 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.630+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:05.730 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.724+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T12:15:05.787 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.780+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.803 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.796+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:05.811 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.805+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.840+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T12:15:05.906 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.900+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:05.927 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.920+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:05.940 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.933+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:15:05.941 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.933+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1166', time=2019-12-09T13:03:52.041047+0000, chain.objs.size()=9 2019-12-09T12:15:05.941 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.933+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~vsifsAfejixcl4nVywQYEwgetCmurwo.1 2019-12-09T12:15:05.941 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.934+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~vsifsAfejixcl4nVywQYEwgetCmurwo.1_1 2019-12-09T12:15:05.941 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.934+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~vsifsAfejixcl4nVywQYEwgetCmurwo.2 2019-12-09T12:15:05.941 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.934+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~vsifsAfejixcl4nVywQYEwgetCmurwo.2_1 2019-12-09T12:15:05.941 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.934+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~vsifsAfejixcl4nVywQYEwgetCmurwo.3 2019-12-09T12:15:05.942 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.934+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~vsifsAfejixcl4nVywQYEwgetCmurwo.3_1 2019-12-09T12:15:05.942 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.934+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~vsifsAfejixcl4nVywQYEwgetCmurwo.4 2019-12-09T12:15:05.942 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.934+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~vsifsAfejixcl4nVywQYEwgetCmurwo.4_1 2019-12-09T12:15:05.942 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:05.934+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~vsifsAfejixcl4nVywQYEwgetCmurwo.5 2019-12-09T12:15:06.153 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.147+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:06.232 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.225+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T12:15:06.273 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.267+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:06.291 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.284+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:06.309 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.302+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:15:06.309 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.302+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1071', time=2019-12-09T12:59:34.235206+0000, chain.objs.size()=2 2019-12-09T12:15:06.309 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.302+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.56__shadow_.NZSedCycrXgdDE5l6TcPdg30ICdXM10_1 2019-12-09T12:15:06.309 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.302+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.56__shadow_.NZSedCycrXgdDE5l6TcPdg30ICdXM10_2 2019-12-09T12:15:06.366 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.360+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:06.458 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.451+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T12:15:06.517 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.510+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:06.541 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.534+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:06.557 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.550+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T12:15:06.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.550+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1188', time=2019-12-09T13:05:37.978151+0000, chain.objs.size()=7 2019-12-09T12:15:06.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.550+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~nvWv8dzG-MyKfoXxqJgiyZPYtmXSsSx.1 2019-12-09T12:15:06.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.550+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~nvWv8dzG-MyKfoXxqJgiyZPYtmXSsSx.1_1 2019-12-09T12:15:06.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.550+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~nvWv8dzG-MyKfoXxqJgiyZPYtmXSsSx.1_2 2019-12-09T12:15:06.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.550+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~nvWv8dzG-MyKfoXxqJgiyZPYtmXSsSx.2 2019-12-09T12:15:06.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.550+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~nvWv8dzG-MyKfoXxqJgiyZPYtmXSsSx.2_1 2019-12-09T12:15:06.559 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.550+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~nvWv8dzG-MyKfoXxqJgiyZPYtmXSsSx.2_2 2019-12-09T12:15:06.559 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.550+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~nvWv8dzG-MyKfoXxqJgiyZPYtmXSsSx.3 2019-12-09T12:15:06.559 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.550+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1237', time=2019-12-09T13:07:59.426817+0000, chain.objs.size()=9 2019-12-09T12:15:06.559 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.550+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.71__multipart_key1.2~_AEEGTyp9do5nMRm9J6d7lvLegCCu7Q.1 2019-12-09T12:15:06.559 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.550+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.71__shadow_key1.2~_AEEGTyp9do5nMRm9J6d7lvLegCCu7Q.1_1 2019-12-09T12:15:06.559 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.550+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.71__multipart_key1.2~_AEEGTyp9do5nMRm9J6d7lvLegCCu7Q.2 2019-12-09T12:15:06.559 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.550+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.71__shadow_key1.2~_AEEGTyp9do5nMRm9J6d7lvLegCCu7Q.2_1 2019-12-09T12:15:06.560 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.550+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.71__multipart_key1.2~_AEEGTyp9do5nMRm9J6d7lvLegCCu7Q.3 2019-12-09T12:15:06.800 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.794+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.71__shadow_key1.2~_AEEGTyp9do5nMRm9J6d7lvLegCCu7Q.3_1 2019-12-09T12:15:06.884 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.878+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.71__multipart_key1.2~_AEEGTyp9do5nMRm9J6d7lvLegCCu7Q.4 2019-12-09T12:15:06.884 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.878+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.71__shadow_key1.2~_AEEGTyp9do5nMRm9J6d7lvLegCCu7Q.4_1 2019-12-09T12:15:06.885 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.878+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.71__multipart_key1.2~_AEEGTyp9do5nMRm9J6d7lvLegCCu7Q.5 2019-12-09T12:15:07.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:06.998+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:07.072 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.066+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T12:15:07.111 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.105+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.126 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.119+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:07.136 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.130+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.164 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.158+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T12:15:07.224 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.218+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.251 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.245+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:07.263 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.256+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.290 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.284+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T12:15:07.352 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.346+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.380 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.373+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:07.389 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.383+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.439 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.432+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T12:15:07.505 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.499+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:07.532 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.525+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:07.559 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.552+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-12-09T12:15:07.560 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.552+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1174', time=2019-12-09T13:04:26.207302+0000, chain.objs.size()=9 2019-12-09T12:15:07.560 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.552+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~9vRmX6oHMN-yp4LfAemX2DY54TL3xDr.1 2019-12-09T12:15:07.560 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.553+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~9vRmX6oHMN-yp4LfAemX2DY54TL3xDr.1_1 2019-12-09T12:15:07.560 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.553+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~9vRmX6oHMN-yp4LfAemX2DY54TL3xDr.2 2019-12-09T12:15:07.560 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.553+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~9vRmX6oHMN-yp4LfAemX2DY54TL3xDr.2_1 2019-12-09T12:15:07.560 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.553+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~9vRmX6oHMN-yp4LfAemX2DY54TL3xDr.3 2019-12-09T12:15:07.561 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.553+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~9vRmX6oHMN-yp4LfAemX2DY54TL3xDr.3_1 2019-12-09T12:15:07.561 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.553+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~9vRmX6oHMN-yp4LfAemX2DY54TL3xDr.4 2019-12-09T12:15:07.561 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.553+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~9vRmX6oHMN-yp4LfAemX2DY54TL3xDr.4_1 2019-12-09T12:15:07.561 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.553+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~9vRmX6oHMN-yp4LfAemX2DY54TL3xDr.5 2019-12-09T12:15:07.562 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.553+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1331', time=2019-12-09T13:17:31.632265+0000, chain.objs.size()=7 2019-12-09T12:15:07.562 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.553+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~Cv1BJdy0g-u1kMm_eDrZ1MASsqyx0mh.1 2019-12-09T12:15:07.562 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.553+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~Cv1BJdy0g-u1kMm_eDrZ1MASsqyx0mh.1_1 2019-12-09T12:15:07.562 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.553+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~Cv1BJdy0g-u1kMm_eDrZ1MASsqyx0mh.1_2 2019-12-09T12:15:07.722 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.716+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~Cv1BJdy0g-u1kMm_eDrZ1MASsqyx0mh.2 2019-12-09T12:15:07.779 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.774+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~Cv1BJdy0g-u1kMm_eDrZ1MASsqyx0mh.2_1 2019-12-09T12:15:07.783 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.778+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~Cv1BJdy0g-u1kMm_eDrZ1MASsqyx0mh.2_2 2019-12-09T12:15:07.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.841+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~Cv1BJdy0g-u1kMm_eDrZ1MASsqyx0mh.3 2019-12-09T12:15:07.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.841+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis', time=2019-12-09T13:22:17.862811+0000, chain.objs.size()=28 2019-12-09T12:15:07.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.841+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.1 2019-12-09T12:15:07.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.841+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.2 2019-12-09T12:15:07.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.841+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.3 2019-12-09T12:15:07.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.841+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.4 2019-12-09T12:15:07.848 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.841+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.5 2019-12-09T12:15:07.848 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.841+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.6 2019-12-09T12:15:07.848 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.841+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.7 2019-12-09T12:15:07.855 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.850+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.8 2019-12-09T12:15:07.967 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.961+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.9 2019-12-09T12:15:07.967 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:07.961+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.10 2019-12-09T12:15:08.032 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.027+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.11 2019-12-09T12:15:08.118 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.112+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.12 2019-12-09T12:15:08.118 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.112+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.13 2019-12-09T12:15:08.118 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.112+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.14 2019-12-09T12:15:08.118 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.112+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.15 2019-12-09T12:15:08.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.189+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.16 2019-12-09T12:15:08.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.189+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.17 2019-12-09T12:15:08.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.189+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.18 2019-12-09T12:15:08.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.189+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.LUHz0aVOx7ohDwNJxGLa8JRvFPvK_bo.19 2019-12-09T12:15:08.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.189+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.ljamil6_OdZUhSC59IziuiP1r-14vdX.20 2019-12-09T12:15:08.195 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.189+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.21 2019-12-09T12:15:08.196 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.189+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.22 2019-12-09T12:15:08.257 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.252+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.23 2019-12-09T12:15:08.258 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.252+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.24 2019-12-09T12:15:08.258 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.252+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.25 2019-12-09T12:15:08.258 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.252+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.26 2019-12-09T12:15:08.426 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.421+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.27 2019-12-09T12:15:08.427 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.421+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.78__multipart_key1.2~uq7ZaNJ76XzWfF-7I2LBMQcxtuW0Uis.28 2019-12-09T12:15:08.557 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.552+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:08.658 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.652+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T12:15:08.717 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.711+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:08.736 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.731+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:08.749 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.742+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:15:08.749 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.742+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1341', time=2019-12-09T13:18:47.305822+0000, chain.objs.size()=7 2019-12-09T12:15:08.749 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.742+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~DCBtpEATKfu2-cJd65q9zOr22MbLUX9.1 2019-12-09T12:15:08.749 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.742+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~DCBtpEATKfu2-cJd65q9zOr22MbLUX9.1_1 2019-12-09T12:15:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.742+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~DCBtpEATKfu2-cJd65q9zOr22MbLUX9.1_2 2019-12-09T12:15:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.742+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~DCBtpEATKfu2-cJd65q9zOr22MbLUX9.2 2019-12-09T12:15:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.742+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~DCBtpEATKfu2-cJd65q9zOr22MbLUX9.2_1 2019-12-09T12:15:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.742+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~DCBtpEATKfu2-cJd65q9zOr22MbLUX9.2_2 2019-12-09T12:15:08.751 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.743+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~DCBtpEATKfu2-cJd65q9zOr22MbLUX9.3 2019-12-09T12:15:08.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.919+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:08.994 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:08.988+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T12:15:09.040 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.034+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:09.060 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.054+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:09.074 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.068+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:15:09.074 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.068+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~6gSGcB-9Kz---rX6JbgePRzkypMCZTN', time=2019-12-09T13:12:11.496047+0000, chain.objs.size()=9 2019-12-09T12:15:09.075 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.069+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.74__multipart_key1.2~6gSGcB-9Kz---rX6JbgePRzkypMCZTN.7 2019-12-09T12:15:09.075 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.069+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.74__shadow_key1.2~6gSGcB-9Kz---rX6JbgePRzkypMCZTN.7_1 2019-12-09T12:15:09.075 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.069+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.74__multipart_key1.2~6gSGcB-9Kz---rX6JbgePRzkypMCZTN.8 2019-12-09T12:15:09.075 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.069+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.74__shadow_key1.2~6gSGcB-9Kz---rX6JbgePRzkypMCZTN.8_1 2019-12-09T12:15:09.075 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.069+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.74__multipart_key1.2~6gSGcB-9Kz---rX6JbgePRzkypMCZTN.9 2019-12-09T12:15:09.075 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.069+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.74__shadow_key1.2~6gSGcB-9Kz---rX6JbgePRzkypMCZTN.9_1 2019-12-09T12:15:09.076 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.069+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.74__multipart_key1.2~6gSGcB-9Kz---rX6JbgePRzkypMCZTN.10 2019-12-09T12:15:09.076 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.069+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.74__shadow_key1.2~6gSGcB-9Kz---rX6JbgePRzkypMCZTN.10_1 2019-12-09T12:15:09.076 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.069+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.74__multipart_key1.2~6gSGcB-9Kz---rX6JbgePRzkypMCZTN.11 2019-12-09T12:15:09.274 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.269+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:09.342 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.336+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T12:15:09.376 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.371+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:09.391 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.386+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:09.400 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.395+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:09.429 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.423+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T12:15:09.505 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.500+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:09.542 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.537+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:09.561 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.556+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:09.612 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.607+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T12:15:09.703 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.698+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:09.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.750+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:09.766 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.761+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:09.814 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.808+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T12:15:09.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.874+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:09.900 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.895+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:09.924 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.918+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T12:15:09.924 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.918+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1182', time=2019-12-09T13:05:08.206753+0000, chain.objs.size()=9 2019-12-09T12:15:09.924 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.918+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~PJO5IMpqZJ_FR8OIleXauLjxZalRijc.1 2019-12-09T12:15:09.924 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.918+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~PJO5IMpqZJ_FR8OIleXauLjxZalRijc.1_1 2019-12-09T12:15:09.924 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.918+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~PJO5IMpqZJ_FR8OIleXauLjxZalRijc.2 2019-12-09T12:15:09.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.918+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~PJO5IMpqZJ_FR8OIleXauLjxZalRijc.2_1 2019-12-09T12:15:09.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.918+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~PJO5IMpqZJ_FR8OIleXauLjxZalRijc.3 2019-12-09T12:15:09.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.918+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~PJO5IMpqZJ_FR8OIleXauLjxZalRijc.3_1 2019-12-09T12:15:09.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.918+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~PJO5IMpqZJ_FR8OIleXauLjxZalRijc.4 2019-12-09T12:15:09.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.918+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~PJO5IMpqZJ_FR8OIleXauLjxZalRijc.4_1 2019-12-09T12:15:09.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.918+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~PJO5IMpqZJ_FR8OIleXauLjxZalRijc.5 2019-12-09T12:15:09.926 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.918+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.2156', time=2019-12-09T14:13:38.733537+0000, chain.objs.size()=9 2019-12-09T12:15:09.926 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.918+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.118__multipart_key1.2~y5sI5qVqMfcZ8VN6nCdn27RbzcMFEui.1 2019-12-09T12:15:09.926 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.918+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.118__shadow_key1.2~y5sI5qVqMfcZ8VN6nCdn27RbzcMFEui.1_1 2019-12-09T12:15:09.926 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:09.918+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.118__multipart_key1.2~y5sI5qVqMfcZ8VN6nCdn27RbzcMFEui.2 2019-12-09T12:15:10.158 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.153+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.118__shadow_key1.2~y5sI5qVqMfcZ8VN6nCdn27RbzcMFEui.2_1 2019-12-09T12:15:10.158 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.153+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.118__multipart_key1.2~y5sI5qVqMfcZ8VN6nCdn27RbzcMFEui.3 2019-12-09T12:15:10.181 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.175+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.118__shadow_key1.2~y5sI5qVqMfcZ8VN6nCdn27RbzcMFEui.3_1 2019-12-09T12:15:10.181 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.175+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.118__multipart_key1.2~y5sI5qVqMfcZ8VN6nCdn27RbzcMFEui.4 2019-12-09T12:15:10.181 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.175+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.118__shadow_key1.2~y5sI5qVqMfcZ8VN6nCdn27RbzcMFEui.4_1 2019-12-09T12:15:10.181 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.175+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.118__multipart_key1.2~y5sI5qVqMfcZ8VN6nCdn27RbzcMFEui.5 2019-12-09T12:15:10.434 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.429+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:10.514 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.509+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T12:15:10.580 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.574+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:10.605 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.600+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:10.623 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.617+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-09T12:15:10.623 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.617+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1194', time=2019-12-09T13:06:12.075670+0000, chain.objs.size()=7 2019-12-09T12:15:10.623 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.617+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~DoTFo5uTxLbNt8FXW8Jk90iiUPASGuZ.1 2019-12-09T12:15:10.623 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.617+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~DoTFo5uTxLbNt8FXW8Jk90iiUPASGuZ.1_1 2019-12-09T12:15:10.623 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.617+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~DoTFo5uTxLbNt8FXW8Jk90iiUPASGuZ.1_2 2019-12-09T12:15:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.617+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~DoTFo5uTxLbNt8FXW8Jk90iiUPASGuZ.2 2019-12-09T12:15:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.617+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~DoTFo5uTxLbNt8FXW8Jk90iiUPASGuZ.2_1 2019-12-09T12:15:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.617+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__shadow_key1.2~DoTFo5uTxLbNt8FXW8Jk90iiUPASGuZ.2_2 2019-12-09T12:15:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.617+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.67__multipart_key1.2~DoTFo5uTxLbNt8FXW8Jk90iiUPASGuZ.3 2019-12-09T12:15:10.835 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.829+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:10.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.919+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T12:15:10.968 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.963+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:10.984 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.978+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:11.003 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.997+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T12:15:11.003 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.997+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1143', time=2019-12-09T13:01:42.432182+0000, chain.objs.size()=9 2019-12-09T12:15:11.003 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.997+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__multipart_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.1 2019-12-09T12:15:11.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.997+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__shadow_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.1_1 2019-12-09T12:15:11.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.997+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__multipart_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.2 2019-12-09T12:15:11.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.997+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__shadow_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.2_1 2019-12-09T12:15:11.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.997+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__multipart_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.3 2019-12-09T12:15:11.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.997+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__shadow_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.3_1 2019-12-09T12:15:11.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.997+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__multipart_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.4 2019-12-09T12:15:11.004 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.997+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__shadow_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.4_1 2019-12-09T12:15:11.005 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.997+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__multipart_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.5 2019-12-09T12:15:11.005 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.997+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1145', time=2019-12-09T13:01:50.107223+0000, chain.objs.size()=9 2019-12-09T12:15:11.005 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.997+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__multipart_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.1 2019-12-09T12:15:11.005 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.997+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__shadow_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.1_1 2019-12-09T12:15:11.005 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:10.997+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__multipart_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.2 2019-12-09T12:15:11.146 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.141+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__shadow_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.2_1 2019-12-09T12:15:11.209 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.203+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__multipart_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.3 2019-12-09T12:15:11.209 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.203+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__shadow_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.3_1 2019-12-09T12:15:11.209 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.203+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__multipart_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.4 2019-12-09T12:15:11.209 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.203+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__shadow_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.4_1 2019-12-09T12:15:11.209 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.203+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.64__multipart_key1.2~d3V0Zn4mqUUTbb5PjH-exhjlRcsC2-J.5 2019-12-09T12:15:11.462 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.456+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:11.749 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.744+0000 7f853e255ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T12:15:11.820 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.814+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:11.853 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.847+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:11.876 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.871+0000 7f853e255ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-09T12:15:11.877 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.871+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1312', time=2019-12-09T13:14:12.717319+0000, chain.objs.size()=9 2019-12-09T12:15:11.877 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.871+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~EPdrlKY-TiKNtkaqGip4CDV2MU0-LTL.1 2019-12-09T12:15:11.877 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.871+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~EPdrlKY-TiKNtkaqGip4CDV2MU0-LTL.1_1 2019-12-09T12:15:11.877 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.871+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~EPdrlKY-TiKNtkaqGip4CDV2MU0-LTL.2 2019-12-09T12:15:11.878 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.871+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~EPdrlKY-TiKNtkaqGip4CDV2MU0-LTL.2_1 2019-12-09T12:15:11.878 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.871+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~EPdrlKY-TiKNtkaqGip4CDV2MU0-LTL.3 2019-12-09T12:15:11.878 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.871+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~EPdrlKY-TiKNtkaqGip4CDV2MU0-LTL.3_1 2019-12-09T12:15:11.878 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.871+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~EPdrlKY-TiKNtkaqGip4CDV2MU0-LTL.4 2019-12-09T12:15:11.878 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.871+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__shadow_key1.2~EPdrlKY-TiKNtkaqGip4CDV2MU0-LTL.4_1 2019-12-09T12:15:11.878 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.871+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.75__multipart_key1.2~EPdrlKY-TiKNtkaqGip4CDV2MU0-LTL.5 2019-12-09T12:15:11.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.871+0000 7f853e255ec0 20 garbage collection: RGWGC::process iterating over entry tag='a55fd90f-db62-40cd-9264-5916c91f1695.4530.1371', time=2019-12-09T13:21:42.729983+0000, chain.objs.size()=9 2019-12-09T12:15:11.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.871+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.77__multipart_key1.2~Na0K9T8hhK3XxYBiSSZ8RMe8jzma5Qy.1 2019-12-09T12:15:11.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.871+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.77__shadow_key1.2~Na0K9T8hhK3XxYBiSSZ8RMe8jzma5Qy.1_1 2019-12-09T12:15:11.879 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:11.871+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.77__multipart_key1.2~Na0K9T8hhK3XxYBiSSZ8RMe8jzma5Qy.2 2019-12-09T12:15:12.110 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.104+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.77__shadow_key1.2~Na0K9T8hhK3XxYBiSSZ8RMe8jzma5Qy.2_1 2019-12-09T12:15:12.110 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.105+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.77__multipart_key1.2~Na0K9T8hhK3XxYBiSSZ8RMe8jzma5Qy.3 2019-12-09T12:15:12.190 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.184+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.77__shadow_key1.2~Na0K9T8hhK3XxYBiSSZ8RMe8jzma5Qy.3_1 2019-12-09T12:15:12.190 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.184+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.77__multipart_key1.2~Na0K9T8hhK3XxYBiSSZ8RMe8jzma5Qy.4 2019-12-09T12:15:12.190 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.184+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.77__shadow_key1.2~Na0K9T8hhK3XxYBiSSZ8RMe8jzma5Qy.4_1 2019-12-09T12:15:12.190 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.184+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a55fd90f-db62-40cd-9264-5916c91f1695.4358.77__multipart_key1.2~Na0K9T8hhK3XxYBiSSZ8RMe8jzma5Qy.5 2019-12-09T12:15:12.311 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.306+0000 7f853e255ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-09T12:15:12.413 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.408+0000 7f853e255ec0 20 remove_watcher() i=0 2019-12-09T12:15:12.414 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.408+0000 7f853e255ec0 2 removed watcher, disabling cache 2019-12-09T12:15:12.449 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.444+0000 7f853e255ec0 20 remove_watcher() i=1 2019-12-09T12:15:12.488 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.483+0000 7f853e255ec0 20 remove_watcher() i=2 2019-12-09T12:15:12.535 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.530+0000 7f853e255ec0 20 remove_watcher() i=3 2019-12-09T12:15:12.602 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.596+0000 7f853e255ec0 20 remove_watcher() i=4 2019-12-09T12:15:12.653 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.648+0000 7f853e255ec0 20 remove_watcher() i=5 2019-12-09T12:15:12.705 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.699+0000 7f853e255ec0 20 remove_watcher() i=6 2019-12-09T12:15:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.742+0000 7f853e255ec0 20 remove_watcher() i=7 2019-12-09T12:15:12.757 INFO:teuthology.orchestra.run.smithi121:> radosgw-admin gc process --include-all 2019-12-09T12:15:12.894 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.889+0000 7f3fce2fcec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:12.930 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.925+0000 7f3fce2fcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:12.931 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.925+0000 7f3fce2fcec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:12.941 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.936+0000 7f3fce2fcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:12.941 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.936+0000 7f3fce2fcec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:12.950 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.945+0000 7f3fce2fcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:12.950 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.945+0000 7f3fce2fcec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:12.981 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:12.975+0000 7f3fce2fcec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:13.219 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.213+0000 7f3fce2fcec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T12:15:13.219 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.213+0000 7f3fce2fcec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T12:15:13.219 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.213+0000 7f3fce2fcec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T12:15:13.219 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.213+0000 7f3fce2fcec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T12:15:13.219 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.213+0000 7f3fce2fcec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.222+0000 7f3fce2fcec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.222+0000 7f3fce2fcec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.232+0000 7f3fce2fcec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.233+0000 7f3fce2fcec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:13.260 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.255+0000 7f3fce2fcec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:13.260 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.255+0000 7f3fce2fcec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:13.271 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.266+0000 7f3fce2fcec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:13.271 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.266+0000 7f3fce2fcec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:13.285 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.280+0000 7f3fce2fcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:13.285 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.280+0000 7f3fce2fcec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T12:15:13.286 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.280+0000 7f3fce2fcec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:13.292 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.287+0000 7f3fce2fcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:13.293 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.287+0000 7f3fce2fcec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:13.300 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.294+0000 7f3fce2fcec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:13.300 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.295+0000 7f3fce2fcec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:13.311 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.306+0000 7f3fce2fcec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:13.311 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.306+0000 7f3fce2fcec0 20 zonegroup default 2019-12-09T12:15:13.311 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.306+0000 7f3fce2fcec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:13.317 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.311+0000 7f3fce2fcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:13.317 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.311+0000 7f3fce2fcec0 10 Cannot find current period zone using local zone 2019-12-09T12:15:13.317 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.311+0000 7f3fce2fcec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:13.322 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.316+0000 7f3fce2fcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:13.322 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.316+0000 7f3fce2fcec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:13.329 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.323+0000 7f3fce2fcec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:13.329 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.323+0000 7f3fce2fcec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:13.339 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.334+0000 7f3fce2fcec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:13.339 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.334+0000 7f3fce2fcec0 20 zone default found 2019-12-09T12:15:13.339 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.334+0000 7f3fce2fcec0 20 started sync module instance, tier type = 2019-12-09T12:15:13.340 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.334+0000 7f3fce2fcec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T12:15:13.534 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.529+0000 7f3fbb526700 0 -- 172.21.15.121:0/3123483701 >> [v2:172.21.15.132:6802/10193,v1:172.21.15.132:6803/10193] conn(0x5606d55e8bc0 msgr2=0x5606d55eafe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:15:13.637 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.632+0000 7f3fce2fcec0 20 add_watcher() i=0 2019-12-09T12:15:13.637 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.632+0000 7f3fce2fcec0 20 add_watcher() i=1 2019-12-09T12:15:13.637 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.632+0000 7f3fce2fcec0 20 add_watcher() i=2 2019-12-09T12:15:13.638 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.632+0000 7f3fce2fcec0 20 add_watcher() i=3 2019-12-09T12:15:13.638 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.632+0000 7f3fce2fcec0 20 add_watcher() i=4 2019-12-09T12:15:13.638 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.632+0000 7f3fce2fcec0 20 add_watcher() i=5 2019-12-09T12:15:13.638 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.632+0000 7f3fce2fcec0 20 add_watcher() i=6 2019-12-09T12:15:13.666 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.661+0000 7f3fce2fcec0 20 add_watcher() i=7 2019-12-09T12:15:13.666 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.661+0000 7f3fce2fcec0 2 all 8 watchers are set, enabling cache 2019-12-09T12:15:13.666 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.661+0000 7f3f8afed700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T12:15:13.684 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:13.679+0000 7f3fbbd27700 0 -- 172.21.15.121:0/2667376279 >> v1:172.21.15.121:6789/0 conn(0x5606d55f6b30 legacy=0x5606d55f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T12:15:15.341 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.335+0000 7f3ef97fa700 20 reqs_thread_entry: start 2019-12-09T12:15:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.335+0000 7f3ef37fe700 20 reqs_thread_entry: start 2019-12-09T12:15:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.335+0000 7f3fce2fcec0 20 init_complete bucket index max shards: 0 2019-12-09T12:15:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.336+0000 7f3ef1ffb700 20 reqs_thread_entry: start 2019-12-09T12:15:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.336+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-09T12:15:15.407 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.401+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:15.431 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.425+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:15.446 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.440+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:15.487 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.481+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-09T12:15:15.540 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.534+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:15.560 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.554+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:15.571 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.565+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:15.602 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.596+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-09T12:15:15.684 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.678+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:15.714 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.707+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:15.727 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.721+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:15.780 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.774+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-09T12:15:15.832 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.826+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:15.851 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.845+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:15.862 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.856+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:15.914 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.908+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-09T12:15:15.972 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.966+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:15.995 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:15.989+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:16.007 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.001+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:16.048 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.042+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-09T12:15:16.111 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.105+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:16.140 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.134+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:16.152 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.146+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:16.188 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.182+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-09T12:15:16.232 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.226+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:16.248 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.242+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:16.257 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.251+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:16.297 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.291+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-09T12:15:16.341 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.335+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:16.360 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.354+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:16.371 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.365+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:16.417 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.410+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-09T12:15:16.477 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.471+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:16.508 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.501+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:16.525 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.518+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:16.583 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.576+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-09T12:15:16.680 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.673+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:16.701 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.695+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:16.711 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.704+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:16.752 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.745+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-09T12:15:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.794+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:16.820 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.814+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:16.832 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.826+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:16.874 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.868+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-09T12:15:16.915 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.909+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:16.939 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.932+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:16.949 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.943+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:16.986 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:16.980+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-09T12:15:17.035 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.029+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:17.054 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.048+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:17.064 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.058+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:17.101 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.095+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-09T12:15:17.149 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.143+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:17.177 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.170+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:17.191 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.185+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:17.229 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.222+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-09T12:15:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.276+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:17.303 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.297+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:17.312 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.305+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:17.351 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.345+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-09T12:15:17.412 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.406+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:17.446 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.440+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:17.482 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.476+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.529+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-09T12:15:17.604 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.598+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:17.629 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.623+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:17.640 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.634+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:17.698 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.691+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-09T12:15:17.749 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.743+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:17.769 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.762+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:17.779 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.772+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:17.819 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.813+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-09T12:15:17.874 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.868+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:17.908 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.901+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:17.936 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.930+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:17.985 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:17.979+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-09T12:15:18.051 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.045+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:18.077 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.070+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:18.091 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.085+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.137+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-09T12:15:18.206 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.200+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:18.273 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.225+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:18.273 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.238+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.284+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-09T12:15:18.349 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.343+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.369+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:18.391 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.385+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:18.445 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.438+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-09T12:15:18.501 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.495+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:18.526 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.519+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.536+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:18.589 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.582+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-09T12:15:18.630 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.624+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:18.646 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.640+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:18.655 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.648+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:18.692 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.685+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-09T12:15:18.763 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.756+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:18.795 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.789+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:18.805 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.799+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:18.842 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.836+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-09T12:15:18.916 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.910+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.949+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:18.969 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:18.963+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:19.012 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.005+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-09T12:15:19.063 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.056+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:19.081 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.075+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:19.091 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.084+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:19.126 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.119+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-09T12:15:19.174 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.167+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:19.201 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.194+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:19.213 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.207+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:19.251 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.245+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-09T12:15:19.298 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.291+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:19.317 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.310+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:19.325 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.319+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:19.363 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.357+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-09T12:15:19.429 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.423+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:19.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.455+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:19.474 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.468+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:19.532 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.526+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-09T12:15:19.594 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.588+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:19.617 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.611+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:19.630 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.624+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:19.676 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.670+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-09T12:15:19.722 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.716+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:19.738 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.732+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-09T12:15:19.747 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.741+0000 7f3fce2fcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-09T12:15:19.817 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.811+0000 7f3fce2fcec0 20 remove_watcher() i=0 2019-12-09T12:15:19.818 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.811+0000 7f3fce2fcec0 2 removed watcher, disabling cache 2019-12-09T12:15:19.851 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.845+0000 7f3fce2fcec0 20 remove_watcher() i=1 2019-12-09T12:15:19.887 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.880+0000 7f3fce2fcec0 20 remove_watcher() i=2 2019-12-09T12:15:19.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.919+0000 7f3fce2fcec0 20 remove_watcher() i=3 2019-12-09T12:15:19.959 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.952+0000 7f3fce2fcec0 20 remove_watcher() i=4 2019-12-09T12:15:19.994 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:19.988+0000 7f3fce2fcec0 20 remove_watcher() i=5 2019-12-09T12:15:20.040 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:20.034+0000 7f3fce2fcec0 20 remove_watcher() i=6 2019-12-09T12:15:20.074 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:20.068+0000 7f3fce2fcec0 20 remove_watcher() i=7 2019-12-09T12:15:20.081 INFO:teuthology.run_tasks:Running task s3tests... 2019-12-09T12:15:20.098 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master', 'slow_backend': True}} 2019-12-09T12:15:20.098 INFO:tasks.s3tests:Downloading s3-tests... 2019-12-09T12:15:20.098 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2019-12-09T12:15:20.099 INFO:teuthology.orchestra.run.smithi121:> git clone -b ceph-master git://git.ceph.com/git/s3-tests.git /home/ubuntu/cephtest/s3-tests 2019-12-09T12:15:20.167 INFO:teuthology.orchestra.run.smithi121.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests'... 2019-12-09T12:15:20.652 INFO:tasks.s3tests:Creating rgw users... 2019-12-09T12:15:20.653 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2019-12-09T12:15:20.653 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --access-key UWLADHTXUGJXFBIKBPYD --secret 6YMLSJs91cQzOm5qfRByaKudhASxejcBzKRXEqHXViGpGfEVp6wJnQ== --email bar.client.0+test@test.test --cluster ceph 2019-12-09T12:15:20.803 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:20.796+0000 7f198e5b3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:20.832 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:20.826+0000 7f198e5b3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:20.832 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:20.826+0000 7f198e5b3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:20.842 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:20.836+0000 7f198e5b3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:20.842 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:20.836+0000 7f198e5b3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:20.851 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:20.845+0000 7f198e5b3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:20.852 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:20.845+0000 7f198e5b3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:20.873 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:20.867+0000 7f198e5b3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:21.090 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.084+0000 7f198e5b3ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T12:15:21.090 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.084+0000 7f198e5b3ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T12:15:21.090 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.084+0000 7f198e5b3ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T12:15:21.090 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.084+0000 7f198e5b3ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T12:15:21.090 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.084+0000 7f198e5b3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:21.103 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.097+0000 7f198e5b3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:21.103 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.097+0000 7f198e5b3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:21.116 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.110+0000 7f198e5b3ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:21.116 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.110+0000 7f198e5b3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:21.126 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.120+0000 7f198e5b3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:21.127 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.120+0000 7f198e5b3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:21.142 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.135+0000 7f198e5b3ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:21.142 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.136+0000 7f198e5b3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:21.152 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.146+0000 7f198e5b3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:21.152 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.146+0000 7f198e5b3ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T12:15:21.152 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.146+0000 7f198e5b3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:21.161 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.155+0000 7f198e5b3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:21.161 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.155+0000 7f198e5b3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:21.180 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.174+0000 7f198e5b3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:21.180 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.174+0000 7f198e5b3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:21.192 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.186+0000 7f198e5b3ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:21.192 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.186+0000 7f198e5b3ec0 20 zonegroup default 2019-12-09T12:15:21.193 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.186+0000 7f198e5b3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:21.203 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.197+0000 7f198e5b3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:21.203 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.197+0000 7f198e5b3ec0 10 Cannot find current period zone using local zone 2019-12-09T12:15:21.203 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.197+0000 7f198e5b3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:21.214 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.208+0000 7f198e5b3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:21.214 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.208+0000 7f198e5b3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:21.234 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.228+0000 7f198e5b3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:21.234 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.228+0000 7f198e5b3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:21.253 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.246+0000 7f198e5b3ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:21.253 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.246+0000 7f198e5b3ec0 20 zone default found 2019-12-09T12:15:21.253 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.246+0000 7f198e5b3ec0 20 started sync module instance, tier type = 2019-12-09T12:15:21.253 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.246+0000 7f198e5b3ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T12:15:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.531+0000 7f198e5b3ec0 20 add_watcher() i=0 2019-12-09T12:15:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.531+0000 7f198e5b3ec0 20 add_watcher() i=1 2019-12-09T12:15:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.531+0000 7f198e5b3ec0 20 add_watcher() i=2 2019-12-09T12:15:21.538 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.531+0000 7f198e5b3ec0 20 add_watcher() i=3 2019-12-09T12:15:21.539 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.531+0000 7f198e5b3ec0 20 add_watcher() i=4 2019-12-09T12:15:21.539 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.531+0000 7f198e5b3ec0 20 add_watcher() i=5 2019-12-09T12:15:21.539 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.531+0000 7f198e5b3ec0 20 add_watcher() i=6 2019-12-09T12:15:21.569 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.563+0000 7f198e5b3ec0 20 add_watcher() i=7 2019-12-09T12:15:21.569 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.563+0000 7f198e5b3ec0 2 all 8 watchers are set, enabling cache 2019-12-09T12:15:21.569 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.563+0000 7f194bfdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T12:15:21.581 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.574+0000 7f197bfde700 0 -- 172.21.15.121:0/3214095171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563eb30e6b00 msgr2=0x563eb30e6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:15:21.644 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:21.638+0000 7f197afdc700 0 -- 172.21.15.121:0/4112164015 >> [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] conn(0x563eb3100350 msgr2=0x563eb3102770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:15:23.110 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.104+0000 7f18ba7fc700 20 reqs_thread_entry: start 2019-12-09T12:15:23.111 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.104+0000 7f18b3fff700 20 reqs_thread_entry: start 2019-12-09T12:15:23.111 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.104+0000 7f198e5b3ec0 20 init_complete bucket index max shards: 0 2019-12-09T12:15:23.111 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.105+0000 7f18b27fc700 20 reqs_thread_entry: start 2019-12-09T12:15:23.112 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.105+0000 7f198e5b3ec0 20 get_system_obj_state: rctx=0x7fff2816fb98 obj=default.rgw.meta:users.uid:bar.client.0 state=0x563eb3164360 s->prefetch_data=0 2019-12-09T12:15:23.112 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.105+0000 7f198e5b3ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-12-09T12:15:23.123 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.117+0000 7f198e5b3ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-12-09T12:15:23.124 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.117+0000 7f198e5b3ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T12:15:23.124 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.117+0000 7f198e5b3ec0 20 get_system_obj_state: rctx=0x7fff2816fba8 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x563eb31660f0 s->prefetch_data=0 2019-12-09T12:15:23.124 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.117+0000 7f198e5b3ec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-12-09T12:15:23.133 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.127+0000 7f198e5b3ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-12-09T12:15:23.134 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.127+0000 7f198e5b3ec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-09T12:15:23.134 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.127+0000 7f198e5b3ec0 20 get_system_obj_state: rctx=0x7fff2816fba8 obj=default.rgw.meta:users.keys:UWLADHTXUGJXFBIKBPYD state=0x563eb31660f0 s->prefetch_data=0 2019-12-09T12:15:23.134 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.127+0000 7f198e5b3ec0 10 cache get: name=default.rgw.meta+users.keys+UWLADHTXUGJXFBIKBPYD : miss 2019-12-09T12:15:23.143 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.137+0000 7f198e5b3ec0 10 cache put: name=default.rgw.meta+users.keys+UWLADHTXUGJXFBIKBPYD info.flags=0x0 2019-12-09T12:15:23.143 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.137+0000 7f198e5b3ec0 10 adding default.rgw.meta+users.keys+UWLADHTXUGJXFBIKBPYD to cache LRU end 2019-12-09T12:15:23.144 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.137+0000 7f198e5b3ec0 20 get_system_obj_state: rctx=0x7fff2816f7b8 obj=default.rgw.meta:users.keys:UWLADHTXUGJXFBIKBPYD state=0x563eb31660f0 s->prefetch_data=0 2019-12-09T12:15:23.144 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.137+0000 7f198e5b3ec0 10 cache get: name=default.rgw.meta+users.keys+UWLADHTXUGJXFBIKBPYD : type miss (requested=0x6, cached=0x0) 2019-12-09T12:15:23.155 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.148+0000 7f198e5b3ec0 10 cache put: name=default.rgw.meta+users.keys+UWLADHTXUGJXFBIKBPYD info.flags=0x0 2019-12-09T12:15:23.155 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.148+0000 7f198e5b3ec0 10 moving default.rgw.meta+users.keys+UWLADHTXUGJXFBIKBPYD to cache LRU end 2019-12-09T12:15:23.155 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.148+0000 7f198e5b3ec0 20 get_system_obj_state: rctx=0x7fff2816f938 obj=default.rgw.meta:users.keys:UWLADHTXUGJXFBIKBPYD state=0x563eb31660f0 s->prefetch_data=0 2019-12-09T12:15:23.155 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.148+0000 7f198e5b3ec0 10 cache get: name=default.rgw.meta+users.keys+UWLADHTXUGJXFBIKBPYD : type miss (requested=0x6, cached=0x0) 2019-12-09T12:15:23.164 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.158+0000 7f198e5b3ec0 10 cache put: name=default.rgw.meta+users.keys+UWLADHTXUGJXFBIKBPYD info.flags=0x0 2019-12-09T12:15:23.164 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.158+0000 7f198e5b3ec0 10 moving default.rgw.meta+users.keys+UWLADHTXUGJXFBIKBPYD to cache LRU end 2019-12-09T12:15:23.239 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.233+0000 7f198e5b3ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-09T12:15:23.239 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.233+0000 7f198e5b3ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T12:15:23.239 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.233+0000 7f198e5b3ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=617 2019-12-09T12:15:23.261 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.255+0000 7f1960ff9700 10 RGWWatcher::handle_notify() notify_id 571230650423 cookie 94827291964320 notifier 4592 bl.length()=617 2019-12-09T12:15:23.262 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.255+0000 7f1960ff9700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-09T12:15:23.262 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.255+0000 7f1960ff9700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T12:15:23.409 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.403+0000 7f198e5b3ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-12-09T12:15:23.410 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.403+0000 7f198e5b3ec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-09T12:15:23.410 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.403+0000 7f198e5b3ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-12-09T12:15:23.422 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.416+0000 7f1960ff9700 10 RGWWatcher::handle_notify() notify_id 571230650424 cookie 94827291964320 notifier 4592 bl.length()=194 2019-12-09T12:15:23.422 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.416+0000 7f1960ff9700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-12-09T12:15:23.423 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:23.416+0000 7f1960ff9700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-09T12:15:24.296 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:24.289+0000 7f198e5b3ec0 10 cache put: name=default.rgw.meta+users.keys+UWLADHTXUGJXFBIKBPYD info.flags=0x7 2019-12-09T12:15:24.296 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:24.289+0000 7f198e5b3ec0 10 moving default.rgw.meta+users.keys+UWLADHTXUGJXFBIKBPYD to cache LRU end 2019-12-09T12:15:24.296 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:24.289+0000 7f198e5b3ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=186 2019-12-09T12:15:24.311 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:24.305+0000 7f1960ff9700 10 RGWWatcher::handle_notify() notify_id 571230650425 cookie 94827291974304 notifier 4592 bl.length()=186 2019-12-09T12:15:24.311 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:24.305+0000 7f1960ff9700 10 cache put: name=default.rgw.meta+users.keys+UWLADHTXUGJXFBIKBPYD info.flags=0x7 2019-12-09T12:15:24.311 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:24.305+0000 7f1960ff9700 10 moving default.rgw.meta+users.keys+UWLADHTXUGJXFBIKBPYD to cache LRU end 2019-12-09T12:15:24.636 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2019-12-09T12:15:24.637 INFO:teuthology.orchestra.run.smithi121.stdout: "user_id": "bar.client.0", 2019-12-09T12:15:24.637 INFO:teuthology.orchestra.run.smithi121.stdout: "display_name": "Mr. bar.client.0", 2019-12-09T12:15:24.637 INFO:teuthology.orchestra.run.smithi121.stdout: "email": "bar.client.0+test@test.test", 2019-12-09T12:15:24.637 INFO:teuthology.orchestra.run.smithi121.stdout: "suspended": 0, 2019-12-09T12:15:24.637 INFO:teuthology.orchestra.run.smithi121.stdout: "max_buckets": 1000, 2019-12-09T12:15:24.637 INFO:teuthology.orchestra.run.smithi121.stdout: "subusers": [], 2019-12-09T12:15:24.637 INFO:teuthology.orchestra.run.smithi121.stdout: "keys": [ 2019-12-09T12:15:24.638 INFO:teuthology.orchestra.run.smithi121.stdout: { 2019-12-09T12:15:24.638 INFO:teuthology.orchestra.run.smithi121.stdout: "user": "bar.client.0", 2019-12-09T12:15:24.638 INFO:teuthology.orchestra.run.smithi121.stdout: "access_key": "UWLADHTXUGJXFBIKBPYD", 2019-12-09T12:15:24.638 INFO:teuthology.orchestra.run.smithi121.stdout: "secret_key": "6YMLSJs91cQzOm5qfRByaKudhASxejcBzKRXEqHXViGpGfEVp6wJnQ==" 2019-12-09T12:15:24.638 INFO:teuthology.orchestra.run.smithi121.stdout: } 2019-12-09T12:15:24.638 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2019-12-09T12:15:24.638 INFO:teuthology.orchestra.run.smithi121.stdout: "swift_keys": [], 2019-12-09T12:15:24.639 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": [], 2019-12-09T12:15:24.639 INFO:teuthology.orchestra.run.smithi121.stdout: "op_mask": "read, write, delete", 2019-12-09T12:15:24.639 INFO:teuthology.orchestra.run.smithi121.stdout: "default_placement": "", 2019-12-09T12:15:24.639 INFO:teuthology.orchestra.run.smithi121.stdout: "default_storage_class": "", 2019-12-09T12:15:24.639 INFO:teuthology.orchestra.run.smithi121.stdout: "placement_tags": [], 2019-12-09T12:15:24.639 INFO:teuthology.orchestra.run.smithi121.stdout: "bucket_quota": { 2019-12-09T12:15:24.639 INFO:teuthology.orchestra.run.smithi121.stdout: "enabled": false, 2019-12-09T12:15:24.640 INFO:teuthology.orchestra.run.smithi121.stdout: "check_on_raw": false, 2019-12-09T12:15:24.640 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size": -1, 2019-12-09T12:15:24.640 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size_kb": 0, 2019-12-09T12:15:24.640 INFO:teuthology.orchestra.run.smithi121.stdout: "max_objects": -1 2019-12-09T12:15:24.640 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2019-12-09T12:15:24.640 INFO:teuthology.orchestra.run.smithi121.stdout: "user_quota": { 2019-12-09T12:15:24.640 INFO:teuthology.orchestra.run.smithi121.stdout: "enabled": false, 2019-12-09T12:15:24.641 INFO:teuthology.orchestra.run.smithi121.stdout: "check_on_raw": false, 2019-12-09T12:15:24.641 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size": -1, 2019-12-09T12:15:24.641 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size_kb": 0, 2019-12-09T12:15:24.642 INFO:teuthology.orchestra.run.smithi121.stdout: "max_objects": -1 2019-12-09T12:15:24.642 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2019-12-09T12:15:24.642 INFO:teuthology.orchestra.run.smithi121.stdout: "temp_url_keys": [], 2019-12-09T12:15:24.642 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "rgw", 2019-12-09T12:15:24.644 INFO:teuthology.orchestra.run.smithi121.stdout: "mfa_ids": [] 2019-12-09T12:15:24.645 INFO:teuthology.orchestra.run.smithi121.stdout:} 2019-12-09T12:15:24.645 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:15:24.690 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:24.684+0000 7f198e5b3ec0 20 remove_watcher() i=0 2019-12-09T12:15:24.690 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:24.684+0000 7f198e5b3ec0 2 removed watcher, disabling cache 2019-12-09T12:15:24.751 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:24.744+0000 7f198e5b3ec0 20 remove_watcher() i=1 2019-12-09T12:15:24.810 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:24.804+0000 7f198e5b3ec0 20 remove_watcher() i=2 2019-12-09T12:15:24.873 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:24.867+0000 7f198e5b3ec0 20 remove_watcher() i=3 2019-12-09T12:15:24.928 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:24.922+0000 7f198e5b3ec0 20 remove_watcher() i=4 2019-12-09T12:15:25.003 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:24.997+0000 7f198e5b3ec0 20 remove_watcher() i=5 2019-12-09T12:15:25.061 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.055+0000 7f198e5b3ec0 20 remove_watcher() i=6 2019-12-09T12:15:25.113 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.106+0000 7f198e5b3ec0 20 remove_watcher() i=7 2019-12-09T12:15:25.120 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 3583307661 --totp-seed 4OY3L5OMWWOKIM7D4K2N3W422AWYCOHRQP4ATO53JVBUDHAXLI64HB6JKU6GKFZZ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-12-09T12:15:25.276 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.270+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:25.328 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.321+0000 7f13d55f5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:25.328 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.321+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:25.338 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.332+0000 7f13d55f5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:25.338 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.332+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:25.348 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.342+0000 7f13d55f5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:25.348 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.342+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:25.370 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.364+0000 7f13d55f5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:25.557 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.550+0000 7f13d55f5ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T12:15:25.557 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.550+0000 7f13d55f5ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T12:15:25.557 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.550+0000 7f13d55f5ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T12:15:25.557 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.550+0000 7f13d55f5ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T12:15:25.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.550+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:25.570 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.564+0000 7f13d55f5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:25.571 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.564+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:25.583 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.577+0000 7f13d55f5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:25.583 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.577+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:25.590 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.584+0000 7f13d55f5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:25.591 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.584+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:25.602 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.596+0000 7f13d55f5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:25.602 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.596+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:25.613 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.607+0000 7f13d55f5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:25.613 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.607+0000 7f13d55f5ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T12:15:25.613 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.607+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:25.618 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.612+0000 7f13d55f5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:25.619 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.612+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:25.630 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.624+0000 7f13d55f5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:25.630 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.624+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:25.653 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.638+0000 7f13d55f5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:25.653 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.638+0000 7f13d55f5ec0 20 zonegroup default 2019-12-09T12:15:25.653 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.638+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:25.653 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.645+0000 7f13d55f5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:25.654 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.645+0000 7f13d55f5ec0 10 Cannot find current period zone using local zone 2019-12-09T12:15:25.654 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.645+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:25.663 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.657+0000 7f13d55f5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:25.663 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.657+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:25.677 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.671+0000 7f13d55f5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:25.677 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.671+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:25.688 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.682+0000 7f13d55f5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:25.689 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.682+0000 7f13d55f5ec0 20 zone default found 2019-12-09T12:15:25.689 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.682+0000 7f13d55f5ec0 20 started sync module instance, tier type = 2019-12-09T12:15:25.689 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:25.682+0000 7f13d55f5ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T12:15:26.106 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:26.100+0000 7f13c281f700 0 -- 172.21.15.121:0/427092548 >> [v2:172.21.15.121:6816/9958,v1:172.21.15.121:6817/9958] conn(0x7f13b4020a50 msgr2=0x7f13b4021040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:15:26.106 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:26.100+0000 7f13d55f5ec0 20 add_watcher() i=0 2019-12-09T12:15:26.107 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:26.100+0000 7f13d55f5ec0 20 add_watcher() i=1 2019-12-09T12:15:26.107 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:26.100+0000 7f13d55f5ec0 20 add_watcher() i=2 2019-12-09T12:15:26.107 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:26.100+0000 7f13d55f5ec0 20 add_watcher() i=3 2019-12-09T12:15:26.107 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:26.100+0000 7f13d55f5ec0 20 add_watcher() i=4 2019-12-09T12:15:26.107 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:26.100+0000 7f13d55f5ec0 20 add_watcher() i=5 2019-12-09T12:15:26.107 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:26.100+0000 7f13d55f5ec0 20 add_watcher() i=6 2019-12-09T12:15:26.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:26.153+0000 7f13d55f5ec0 20 add_watcher() i=7 2019-12-09T12:15:26.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:26.153+0000 7f13d55f5ec0 2 all 8 watchers are set, enabling cache 2019-12-09T12:15:26.159 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:26.153+0000 7f13937de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T12:15:26.180 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:26.174+0000 7f13c201e700 0 -- 172.21.15.121:0/1241055907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56112fbe1c70 msgr2=0x56112fbe4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T12:15:27.805 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:27.798+0000 7f1301ffb700 20 reqs_thread_entry: start 2019-12-09T12:15:27.805 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:27.799+0000 7f12fb7fe700 20 reqs_thread_entry: start 2019-12-09T12:15:27.805 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:27.799+0000 7f13d55f5ec0 20 init_complete bucket index max shards: 0 2019-12-09T12:15:27.806 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:27.799+0000 7f12f9ffb700 20 reqs_thread_entry: start 2019-12-09T12:15:27.806 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:27.799+0000 7f13d55f5ec0 20 get_system_obj_state: rctx=0x7ffc70517e38 obj=default.rgw.meta:users.uid:bar.client.0 state=0x56112fc4fb20 s->prefetch_data=0 2019-12-09T12:15:27.806 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:27.800+0000 7f13d55f5ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-12-09T12:15:27.819 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:27.813+0000 7f13d55f5ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-12-09T12:15:27.819 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:27.813+0000 7f13d55f5ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T12:15:27.819 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:27.813+0000 7f13d55f5ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T12:15:27.820 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:27.813+0000 7f13d55f5ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T12:15:27.820 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:27.813+0000 7f13d55f5ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-09T12:15:27.820 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:27.813+0000 7f13d55f5ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:27.837 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:27.831+0000 7f13d55f5ec0 20 rados_obj.operate() r=0 bl.length=432 2019-12-09T12:15:27.837 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:27.831+0000 7f13d55f5ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-12-09T12:15:27.838 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:27.831+0000 7f13d55f5ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T12:15:30.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:30.187+0000 7f13d55f5ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-09T12:15:30.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:30.187+0000 7f13d55f5ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T12:15:30.194 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:30.187+0000 7f13d55f5ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=631 2019-12-09T12:15:30.213 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:30.207+0000 7f13a3fff700 10 RGWWatcher::handle_notify() notify_id 579820585018 cookie 94631815302880 notifier 4598 bl.length()=631 2019-12-09T12:15:30.213 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:30.207+0000 7f13a3fff700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-09T12:15:30.213 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:30.207+0000 7f13a3fff700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T12:15:30.365 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:30.359+0000 7f13d55f5ec0 20 remove_watcher() i=0 2019-12-09T12:15:30.365 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:30.359+0000 7f13d55f5ec0 2 removed watcher, disabling cache 2019-12-09T12:15:30.413 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:30.406+0000 7f13d55f5ec0 20 remove_watcher() i=1 2019-12-09T12:15:30.449 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:30.443+0000 7f13d55f5ec0 20 remove_watcher() i=2 2019-12-09T12:15:30.498 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:30.492+0000 7f13d55f5ec0 20 remove_watcher() i=3 2019-12-09T12:15:30.532 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:30.526+0000 7f13d55f5ec0 20 remove_watcher() i=4 2019-12-09T12:15:30.571 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:30.565+0000 7f13d55f5ec0 20 remove_watcher() i=5 2019-12-09T12:15:30.608 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:30.601+0000 7f13d55f5ec0 20 remove_watcher() i=6 2019-12-09T12:15:30.825 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:30.818+0000 7f13d55f5ec0 20 remove_watcher() i=7 2019-12-09T12:15:30.833 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2019-12-09T12:15:30.833 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --access-key QKOFOAGEXYRPMHZHBJXS --secret bBmjhxk7/5fHZehiHl35zYpv05+g6/q1uz1lQnFVUrtyL1GJki2laQ== --email foo.client.0+test@test.test --cluster ceph 2019-12-09T12:15:30.955 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:30.949+0000 7f360cf76ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:31.155 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.149+0000 7f360cf76ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:31.156 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.149+0000 7f360cf76ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:31.160 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.153+0000 7f360cf76ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:31.160 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.153+0000 7f360cf76ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:31.164 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.158+0000 7f360cf76ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:31.164 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.158+0000 7f360cf76ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:31.255 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.249+0000 7f360cf76ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:31.422 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.416+0000 7f360cf76ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T12:15:31.422 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.416+0000 7f360cf76ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T12:15:31.422 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.416+0000 7f360cf76ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T12:15:31.423 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.416+0000 7f360cf76ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T12:15:31.423 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.416+0000 7f360cf76ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:31.434 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.428+0000 7f360cf76ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:31.434 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.428+0000 7f360cf76ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:31.446 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.439+0000 7f360cf76ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:31.446 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.439+0000 7f360cf76ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:31.457 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.451+0000 7f360cf76ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:31.457 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.451+0000 7f360cf76ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:31.473 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.466+0000 7f360cf76ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:31.473 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.466+0000 7f360cf76ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:31.485 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.478+0000 7f360cf76ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:31.485 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.478+0000 7f360cf76ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T12:15:31.485 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.478+0000 7f360cf76ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:31.496 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.490+0000 7f360cf76ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:31.496 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.490+0000 7f360cf76ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:31.514 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.508+0000 7f360cf76ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:31.515 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.508+0000 7f360cf76ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:31.531 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.524+0000 7f360cf76ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:31.531 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.525+0000 7f360cf76ec0 20 zonegroup default 2019-12-09T12:15:31.531 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.525+0000 7f360cf76ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:31.540 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.534+0000 7f360cf76ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:31.541 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.534+0000 7f360cf76ec0 10 Cannot find current period zone using local zone 2019-12-09T12:15:31.541 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.534+0000 7f360cf76ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:31.550 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.544+0000 7f360cf76ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:31.551 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.544+0000 7f360cf76ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:31.566 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.560+0000 7f360cf76ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:31.566 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.560+0000 7f360cf76ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:31.584 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.578+0000 7f360cf76ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:31.584 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.578+0000 7f360cf76ec0 20 zone default found 2019-12-09T12:15:31.585 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.578+0000 7f360cf76ec0 20 started sync module instance, tier type = 2019-12-09T12:15:31.585 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.578+0000 7f360cf76ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T12:15:31.969 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.963+0000 7f360cf76ec0 20 add_watcher() i=0 2019-12-09T12:15:31.970 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.963+0000 7f360cf76ec0 20 add_watcher() i=1 2019-12-09T12:15:31.970 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.963+0000 7f360cf76ec0 20 add_watcher() i=2 2019-12-09T12:15:31.970 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.963+0000 7f360cf76ec0 20 add_watcher() i=3 2019-12-09T12:15:31.970 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.963+0000 7f360cf76ec0 20 add_watcher() i=4 2019-12-09T12:15:31.970 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.963+0000 7f360cf76ec0 20 add_watcher() i=5 2019-12-09T12:15:31.970 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.963+0000 7f360cf76ec0 20 add_watcher() i=6 2019-12-09T12:15:32.002 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.995+0000 7f360cf76ec0 20 add_watcher() i=7 2019-12-09T12:15:32.002 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.995+0000 7f360cf76ec0 2 all 8 watchers are set, enabling cache 2019-12-09T12:15:32.002 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:31.996+0000 7f35cafdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T12:15:32.006 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:32.000+0000 7f35fa1a0700 0 -- 172.21.15.121:0/1678379429 >> v2:172.21.15.132:3300/0 conn(0x562707bdac00 msgr2=0x562707be14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T12:15:32.033 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:32.027+0000 7f35fa9a1700 0 -- 172.21.15.121:0/2703687704 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x562707be0cc0 msgr2=0x562707be10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:15:33.762 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.755+0000 7f35397fa700 20 reqs_thread_entry: start 2019-12-09T12:15:33.762 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.755+0000 7f3532ffd700 20 reqs_thread_entry: start 2019-12-09T12:15:33.762 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.755+0000 7f360cf76ec0 20 init_complete bucket index max shards: 0 2019-12-09T12:15:33.763 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.756+0000 7f35317fa700 20 reqs_thread_entry: start 2019-12-09T12:15:33.763 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.756+0000 7f360cf76ec0 20 get_system_obj_state: rctx=0x7fff3dcc1e28 obj=default.rgw.meta:users.uid:foo.client.0 state=0x562707c59910 s->prefetch_data=0 2019-12-09T12:15:33.763 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.756+0000 7f360cf76ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-12-09T12:15:33.767 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.761+0000 7f360cf76ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-12-09T12:15:33.768 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.761+0000 7f360cf76ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T12:15:33.768 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.761+0000 7f360cf76ec0 20 get_system_obj_state: rctx=0x7fff3dcc1e38 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x562707c5b6a0 s->prefetch_data=0 2019-12-09T12:15:33.768 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.761+0000 7f360cf76ec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-12-09T12:15:33.773 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.767+0000 7f360cf76ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-12-09T12:15:33.774 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.767+0000 7f360cf76ec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-09T12:15:33.774 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.767+0000 7f360cf76ec0 20 get_system_obj_state: rctx=0x7fff3dcc1e38 obj=default.rgw.meta:users.keys:QKOFOAGEXYRPMHZHBJXS state=0x562707c5b6a0 s->prefetch_data=0 2019-12-09T12:15:33.774 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.767+0000 7f360cf76ec0 10 cache get: name=default.rgw.meta+users.keys+QKOFOAGEXYRPMHZHBJXS : miss 2019-12-09T12:15:33.778 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.772+0000 7f360cf76ec0 10 cache put: name=default.rgw.meta+users.keys+QKOFOAGEXYRPMHZHBJXS info.flags=0x0 2019-12-09T12:15:33.779 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.772+0000 7f360cf76ec0 10 adding default.rgw.meta+users.keys+QKOFOAGEXYRPMHZHBJXS to cache LRU end 2019-12-09T12:15:33.779 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.772+0000 7f360cf76ec0 20 get_system_obj_state: rctx=0x7fff3dcc1a48 obj=default.rgw.meta:users.keys:QKOFOAGEXYRPMHZHBJXS state=0x562707c5b6a0 s->prefetch_data=0 2019-12-09T12:15:33.779 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.772+0000 7f360cf76ec0 10 cache get: name=default.rgw.meta+users.keys+QKOFOAGEXYRPMHZHBJXS : type miss (requested=0x6, cached=0x0) 2019-12-09T12:15:33.783 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.777+0000 7f360cf76ec0 10 cache put: name=default.rgw.meta+users.keys+QKOFOAGEXYRPMHZHBJXS info.flags=0x0 2019-12-09T12:15:33.783 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.777+0000 7f360cf76ec0 10 moving default.rgw.meta+users.keys+QKOFOAGEXYRPMHZHBJXS to cache LRU end 2019-12-09T12:15:33.784 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.777+0000 7f360cf76ec0 20 get_system_obj_state: rctx=0x7fff3dcc1bc8 obj=default.rgw.meta:users.keys:QKOFOAGEXYRPMHZHBJXS state=0x562707c5b6a0 s->prefetch_data=0 2019-12-09T12:15:33.784 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.777+0000 7f360cf76ec0 10 cache get: name=default.rgw.meta+users.keys+QKOFOAGEXYRPMHZHBJXS : type miss (requested=0x6, cached=0x0) 2019-12-09T12:15:33.787 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.781+0000 7f360cf76ec0 10 cache put: name=default.rgw.meta+users.keys+QKOFOAGEXYRPMHZHBJXS info.flags=0x0 2019-12-09T12:15:33.787 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.781+0000 7f360cf76ec0 10 moving default.rgw.meta+users.keys+QKOFOAGEXYRPMHZHBJXS to cache LRU end 2019-12-09T12:15:33.836 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.830+0000 7f360cf76ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-09T12:15:33.836 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.830+0000 7f360cf76ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T12:15:33.836 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.830+0000 7f360cf76ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=617 2019-12-09T12:15:33.862 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.856+0000 7f35db7fe700 10 RGWWatcher::handle_notify() notify_id 584115552312 cookie 94725633516208 notifier 4610 bl.length()=617 2019-12-09T12:15:33.863 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.856+0000 7f35db7fe700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-09T12:15:33.863 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:33.856+0000 7f35db7fe700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T12:15:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:34.530+0000 7f360cf76ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-12-09T12:15:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:34.530+0000 7f360cf76ec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-09T12:15:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:34.530+0000 7f360cf76ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-12-09T12:15:34.551 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:34.540+0000 7f35db7fe700 10 RGWWatcher::handle_notify() notify_id 584115552288 cookie 94725633529664 notifier 4610 bl.length()=194 2019-12-09T12:15:34.551 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:34.540+0000 7f35db7fe700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-12-09T12:15:34.551 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:34.540+0000 7f35db7fe700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-09T12:15:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:34.633+0000 7f360cf76ec0 10 cache put: name=default.rgw.meta+users.keys+QKOFOAGEXYRPMHZHBJXS info.flags=0x7 2019-12-09T12:15:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:34.633+0000 7f360cf76ec0 10 moving default.rgw.meta+users.keys+QKOFOAGEXYRPMHZHBJXS to cache LRU end 2019-12-09T12:15:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:34.633+0000 7f360cf76ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=186 2019-12-09T12:15:34.647 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:34.641+0000 7f35db7fe700 10 RGWWatcher::handle_notify() notify_id 584115552300 cookie 94725633522432 notifier 4610 bl.length()=186 2019-12-09T12:15:34.648 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:34.641+0000 7f35db7fe700 10 cache put: name=default.rgw.meta+users.keys+QKOFOAGEXYRPMHZHBJXS info.flags=0x7 2019-12-09T12:15:34.648 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:34.641+0000 7f35db7fe700 10 moving default.rgw.meta+users.keys+QKOFOAGEXYRPMHZHBJXS to cache LRU end 2019-12-09T12:15:35.209 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2019-12-09T12:15:35.209 INFO:teuthology.orchestra.run.smithi121.stdout: "user_id": "foo.client.0", 2019-12-09T12:15:35.209 INFO:teuthology.orchestra.run.smithi121.stdout: "display_name": "Mr. foo.client.0", 2019-12-09T12:15:35.209 INFO:teuthology.orchestra.run.smithi121.stdout: "email": "foo.client.0+test@test.test", 2019-12-09T12:15:35.210 INFO:teuthology.orchestra.run.smithi121.stdout: "suspended": 0, 2019-12-09T12:15:35.210 INFO:teuthology.orchestra.run.smithi121.stdout: "max_buckets": 1000, 2019-12-09T12:15:35.210 INFO:teuthology.orchestra.run.smithi121.stdout: "subusers": [], 2019-12-09T12:15:35.210 INFO:teuthology.orchestra.run.smithi121.stdout: "keys": [ 2019-12-09T12:15:35.210 INFO:teuthology.orchestra.run.smithi121.stdout: { 2019-12-09T12:15:35.210 INFO:teuthology.orchestra.run.smithi121.stdout: "user": "foo.client.0", 2019-12-09T12:15:35.210 INFO:teuthology.orchestra.run.smithi121.stdout: "access_key": "QKOFOAGEXYRPMHZHBJXS", 2019-12-09T12:15:35.210 INFO:teuthology.orchestra.run.smithi121.stdout: "secret_key": "bBmjhxk7/5fHZehiHl35zYpv05+g6/q1uz1lQnFVUrtyL1GJki2laQ==" 2019-12-09T12:15:35.211 INFO:teuthology.orchestra.run.smithi121.stdout: } 2019-12-09T12:15:35.211 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2019-12-09T12:15:35.211 INFO:teuthology.orchestra.run.smithi121.stdout: "swift_keys": [], 2019-12-09T12:15:35.211 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": [], 2019-12-09T12:15:35.211 INFO:teuthology.orchestra.run.smithi121.stdout: "op_mask": "read, write, delete", 2019-12-09T12:15:35.211 INFO:teuthology.orchestra.run.smithi121.stdout: "default_placement": "", 2019-12-09T12:15:35.212 INFO:teuthology.orchestra.run.smithi121.stdout: "default_storage_class": "", 2019-12-09T12:15:35.212 INFO:teuthology.orchestra.run.smithi121.stdout: "placement_tags": [], 2019-12-09T12:15:35.212 INFO:teuthology.orchestra.run.smithi121.stdout: "bucket_quota": { 2019-12-09T12:15:35.212 INFO:teuthology.orchestra.run.smithi121.stdout: "enabled": false, 2019-12-09T12:15:35.212 INFO:teuthology.orchestra.run.smithi121.stdout: "check_on_raw": false, 2019-12-09T12:15:35.212 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size": -1, 2019-12-09T12:15:35.212 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size_kb": 0, 2019-12-09T12:15:35.213 INFO:teuthology.orchestra.run.smithi121.stdout: "max_objects": -1 2019-12-09T12:15:35.213 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2019-12-09T12:15:35.213 INFO:teuthology.orchestra.run.smithi121.stdout: "user_quota": { 2019-12-09T12:15:35.213 INFO:teuthology.orchestra.run.smithi121.stdout: "enabled": false, 2019-12-09T12:15:35.213 INFO:teuthology.orchestra.run.smithi121.stdout: "check_on_raw": false, 2019-12-09T12:15:35.213 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size": -1, 2019-12-09T12:15:35.213 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size_kb": 0, 2019-12-09T12:15:35.214 INFO:teuthology.orchestra.run.smithi121.stdout: "max_objects": -1 2019-12-09T12:15:35.214 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2019-12-09T12:15:35.214 INFO:teuthology.orchestra.run.smithi121.stdout: "temp_url_keys": [], 2019-12-09T12:15:35.214 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "rgw", 2019-12-09T12:15:35.214 INFO:teuthology.orchestra.run.smithi121.stdout: "mfa_ids": [] 2019-12-09T12:15:35.214 INFO:teuthology.orchestra.run.smithi121.stdout:} 2019-12-09T12:15:35.214 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:15:35.280 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.274+0000 7f360cf76ec0 20 remove_watcher() i=0 2019-12-09T12:15:35.280 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.274+0000 7f360cf76ec0 2 removed watcher, disabling cache 2019-12-09T12:15:35.346 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.340+0000 7f360cf76ec0 20 remove_watcher() i=1 2019-12-09T12:15:35.393 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.387+0000 7f360cf76ec0 20 remove_watcher() i=2 2019-12-09T12:15:35.452 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.446+0000 7f360cf76ec0 20 remove_watcher() i=3 2019-12-09T12:15:35.489 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.483+0000 7f360cf76ec0 20 remove_watcher() i=4 2019-12-09T12:15:35.520 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.514+0000 7f360cf76ec0 20 remove_watcher() i=5 2019-12-09T12:15:35.552 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.546+0000 7f360cf76ec0 20 remove_watcher() i=6 2019-12-09T12:15:35.583 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.577+0000 7f360cf76ec0 20 remove_watcher() i=7 2019-12-09T12:15:35.591 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 5181935338 --totp-seed G3MPUITAFEP2P7E6RKCKL5JZMVTGRSWSV5MH2K2FAHQQ2C7BCZAK6RCUWXAJU3DS --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-12-09T12:15:35.725 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.719+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:35.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.749+0000 7f93e3af3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:35.755 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.749+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:35.762 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.756+0000 7f93e3af3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:35.762 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.756+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:35.776 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.770+0000 7f93e3af3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:35.776 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.770+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:35.800 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.794+0000 7f93e3af3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:35.980 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.974+0000 7f93e3af3ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T12:15:35.980 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.974+0000 7f93e3af3ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T12:15:35.980 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.974+0000 7f93e3af3ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T12:15:35.981 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.974+0000 7f93e3af3ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T12:15:35.981 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.974+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:35.992 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.986+0000 7f93e3af3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:35.992 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.986+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:36.003 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.996+0000 7f93e3af3ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:36.003 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:35.996+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:36.020 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.013+0000 7f93e3af3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:36.020 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.013+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:36.035 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.028+0000 7f93e3af3ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:36.035 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.028+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:36.042 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.036+0000 7f93e3af3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:36.042 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.036+0000 7f93e3af3ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T12:15:36.042 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.036+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:36.052 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.046+0000 7f93e3af3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:36.052 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.046+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:36.061 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.055+0000 7f93e3af3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:36.061 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.055+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:36.073 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.067+0000 7f93e3af3ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:36.074 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.067+0000 7f93e3af3ec0 20 zonegroup default 2019-12-09T12:15:36.074 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.067+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:36.081 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.074+0000 7f93e3af3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:36.081 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.074+0000 7f93e3af3ec0 10 Cannot find current period zone using local zone 2019-12-09T12:15:36.081 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.074+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:36.093 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.087+0000 7f93e3af3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:36.093 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.087+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:36.111 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.105+0000 7f93e3af3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:36.111 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.105+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:36.121 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.115+0000 7f93e3af3ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:36.121 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.115+0000 7f93e3af3ec0 20 zone default found 2019-12-09T12:15:36.121 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.115+0000 7f93e3af3ec0 20 started sync module instance, tier type = 2019-12-09T12:15:36.121 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.115+0000 7f93e3af3ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T12:15:36.541 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.534+0000 7f93e3af3ec0 20 add_watcher() i=0 2019-12-09T12:15:36.541 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.534+0000 7f93e3af3ec0 20 add_watcher() i=1 2019-12-09T12:15:36.541 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.534+0000 7f93e3af3ec0 20 add_watcher() i=2 2019-12-09T12:15:36.541 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.534+0000 7f93e3af3ec0 20 add_watcher() i=3 2019-12-09T12:15:36.541 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.534+0000 7f93e3af3ec0 20 add_watcher() i=4 2019-12-09T12:15:36.541 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.534+0000 7f93e3af3ec0 20 add_watcher() i=5 2019-12-09T12:15:36.544 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.538+0000 7f93e3af3ec0 20 add_watcher() i=6 2019-12-09T12:15:36.572 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.566+0000 7f93e3af3ec0 20 add_watcher() i=7 2019-12-09T12:15:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.566+0000 7f93e3af3ec0 2 all 8 watchers are set, enabling cache 2019-12-09T12:15:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.566+0000 7f93a0fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T12:15:36.575 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.569+0000 7f93d151e700 0 -- 172.21.15.121:0/3020145826 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55dc6a254700 msgr2=0x55dc6a254b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T12:15:36.616 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:36.610+0000 7f93cbfff700 0 -- 172.21.15.121:0/3525046098 >> [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] conn(0x55dc6a26dc30 msgr2=0x55dc6a270050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:15:38.309 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.303+0000 7f9312ffd700 20 reqs_thread_entry: start 2019-12-09T12:15:38.309 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.303+0000 7f9310ff9700 20 reqs_thread_entry: start 2019-12-09T12:15:38.310 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.303+0000 7f93e3af3ec0 20 init_complete bucket index max shards: 0 2019-12-09T12:15:38.310 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.304+0000 7f92feffd700 20 reqs_thread_entry: start 2019-12-09T12:15:38.310 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.304+0000 7f93e3af3ec0 20 get_system_obj_state: rctx=0x7ffe9e349c48 obj=default.rgw.meta:users.uid:foo.client.0 state=0x55dc6a2d7470 s->prefetch_data=0 2019-12-09T12:15:38.311 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.304+0000 7f93e3af3ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-12-09T12:15:38.331 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.325+0000 7f93e3af3ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-12-09T12:15:38.331 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.325+0000 7f93e3af3ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T12:15:38.332 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.325+0000 7f93e3af3ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T12:15:38.332 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.325+0000 7f93e3af3ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T12:15:38.332 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.325+0000 7f93e3af3ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-09T12:15:38.332 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.325+0000 7f93e3af3ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:38.348 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.342+0000 7f93e3af3ec0 20 rados_obj.operate() r=0 bl.length=432 2019-12-09T12:15:38.348 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.342+0000 7f93e3af3ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-12-09T12:15:38.348 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.342+0000 7f93e3af3ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T12:15:38.482 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.476+0000 7f93e3af3ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-09T12:15:38.483 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.476+0000 7f93e3af3ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T12:15:38.483 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.476+0000 7f93e3af3ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=631 2019-12-09T12:15:38.494 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.488+0000 7f93b9ffb700 10 RGWWatcher::handle_notify() notify_id 584115552313 cookie 94405161926464 notifier 4622 bl.length()=631 2019-12-09T12:15:38.495 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.488+0000 7f93b9ffb700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-09T12:15:38.495 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.488+0000 7f93b9ffb700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T12:15:38.572 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.566+0000 7f93e3af3ec0 20 remove_watcher() i=0 2019-12-09T12:15:38.572 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.566+0000 7f93e3af3ec0 2 removed watcher, disabling cache 2019-12-09T12:15:38.622 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.616+0000 7f93e3af3ec0 20 remove_watcher() i=1 2019-12-09T12:15:38.669 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.662+0000 7f93e3af3ec0 20 remove_watcher() i=2 2019-12-09T12:15:38.729 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.723+0000 7f93e3af3ec0 20 remove_watcher() i=3 2019-12-09T12:15:38.788 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.781+0000 7f93e3af3ec0 20 remove_watcher() i=4 2019-12-09T12:15:38.842 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.836+0000 7f93e3af3ec0 20 remove_watcher() i=5 2019-12-09T12:15:38.909 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.903+0000 7f93e3af3ec0 20 remove_watcher() i=6 2019-12-09T12:15:38.950 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:38.943+0000 7f93e3af3ec0 20 remove_watcher() i=7 2019-12-09T12:15:38.956 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2019-12-09T12:15:38.957 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --access-key HQATBITRCXZJZCJNLCSM --secret r3DUNq4sDt3oVbPhwVn31wQWNspXDhQn97F+e3DqJzecHkIM1X8G2g== --email 'testx$tenanteduser.client.0+test@test.test' --cluster ceph 2019-12-09T12:15:39.128 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.121+0000 7f9fcaf98ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:39.170 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.163+0000 7f9fcaf98ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:39.170 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.163+0000 7f9fcaf98ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:39.180 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.173+0000 7f9fcaf98ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:39.180 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.173+0000 7f9fcaf98ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:39.192 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.186+0000 7f9fcaf98ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:39.192 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.186+0000 7f9fcaf98ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:39.217 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.211+0000 7f9fcaf98ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:39.425 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.419+0000 7f9fcaf98ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T12:15:39.425 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.419+0000 7f9fcaf98ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T12:15:39.425 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.419+0000 7f9fcaf98ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T12:15:39.426 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.419+0000 7f9fcaf98ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T12:15:39.426 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.419+0000 7f9fcaf98ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:39.437 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.431+0000 7f9fcaf98ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:39.437 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.431+0000 7f9fcaf98ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.448+0000 7f9fcaf98ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:39.455 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.448+0000 7f9fcaf98ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:39.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.457+0000 7f9fcaf98ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:39.463 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.457+0000 7f9fcaf98ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:39.476 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.470+0000 7f9fcaf98ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:39.477 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.470+0000 7f9fcaf98ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:39.487 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.481+0000 7f9fcaf98ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:39.488 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.481+0000 7f9fcaf98ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T12:15:39.488 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.481+0000 7f9fcaf98ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:39.499 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.493+0000 7f9fcaf98ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:39.499 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.493+0000 7f9fcaf98ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:39.512 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.506+0000 7f9fcaf98ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:39.512 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.506+0000 7f9fcaf98ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:39.524 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.518+0000 7f9fcaf98ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:39.524 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.518+0000 7f9fcaf98ec0 20 zonegroup default 2019-12-09T12:15:39.524 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.518+0000 7f9fcaf98ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:39.532 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.526+0000 7f9fcaf98ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:39.532 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.526+0000 7f9fcaf98ec0 10 Cannot find current period zone using local zone 2019-12-09T12:15:39.533 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.526+0000 7f9fcaf98ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:39.542 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.536+0000 7f9fcaf98ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:39.542 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.536+0000 7f9fcaf98ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:39.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.552+0000 7f9fcaf98ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:39.559 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.552+0000 7f9fcaf98ec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:39.576 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.569+0000 7f9fcaf98ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:39.576 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.569+0000 7f9fcaf98ec0 20 zone default found 2019-12-09T12:15:39.576 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.569+0000 7f9fcaf98ec0 20 started sync module instance, tier type = 2019-12-09T12:15:39.576 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.569+0000 7f9fcaf98ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T12:15:39.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.919+0000 7f9fcaf98ec0 20 add_watcher() i=0 2019-12-09T12:15:39.926 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.919+0000 7f9fcaf98ec0 20 add_watcher() i=1 2019-12-09T12:15:39.926 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.919+0000 7f9fcaf98ec0 20 add_watcher() i=2 2019-12-09T12:15:39.926 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.919+0000 7f9fcaf98ec0 20 add_watcher() i=3 2019-12-09T12:15:39.926 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.919+0000 7f9fcaf98ec0 20 add_watcher() i=4 2019-12-09T12:15:39.926 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.919+0000 7f9fcaf98ec0 20 add_watcher() i=5 2019-12-09T12:15:39.931 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.925+0000 7f9fcaf98ec0 20 add_watcher() i=6 2019-12-09T12:15:39.957 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.951+0000 7f9fcaf98ec0 20 add_watcher() i=7 2019-12-09T12:15:39.957 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.951+0000 7f9fcaf98ec0 2 all 8 watchers are set, enabling cache 2019-12-09T12:15:39.958 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.951+0000 7f9f88fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T12:15:39.966 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:39.959+0000 7f9fb81c2700 0 -- 172.21.15.121:0/2668695511 >> v2:172.21.15.132:3300/0 conn(0x563ddecdde50 msgr2=0x563ddece4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-12-09T12:15:40.169 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:40.162+0000 7f9fb81c2700 0 --2- 172.21.15.121:0/2668695511 >> v2:172.21.15.132:3300/0 conn(0x563ddecdde50 0x563ddece4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-09T12:15:40.245 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:40.238+0000 7f9fb89c3700 0 -- 172.21.15.121:0/2973730702 >> [v2:172.21.15.132:6800/8843,v1:172.21.15.132:6801/8843] conn(0x7f9efc022490 msgr2=0x7f9efc024960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:15:42.055 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.048+0000 7f9efaffd700 20 reqs_thread_entry: start 2019-12-09T12:15:42.055 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.049+0000 7f9ef8ff9700 20 reqs_thread_entry: start 2019-12-09T12:15:42.055 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.049+0000 7f9fcaf98ec0 20 init_complete bucket index max shards: 0 2019-12-09T12:15:42.056 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.050+0000 7f9eeeffd700 20 reqs_thread_entry: start 2019-12-09T12:15:42.056 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.050+0000 7f9fcaf98ec0 20 get_system_obj_state: rctx=0x7ffcbd50a378 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x563dded5f8a0 s->prefetch_data=0 2019-12-09T12:15:42.056 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.050+0000 7f9fcaf98ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-12-09T12:15:42.066 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.060+0000 7f9fcaf98ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2019-12-09T12:15:42.067 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.060+0000 7f9fcaf98ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T12:15:42.067 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.060+0000 7f9fcaf98ec0 20 get_system_obj_state: rctx=0x7ffcbd50a388 obj=default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test state=0x563dded61650 s->prefetch_data=0 2019-12-09T12:15:42.067 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.060+0000 7f9fcaf98ec0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2019-12-09T12:15:42.076 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.070+0000 7f9fcaf98ec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2019-12-09T12:15:42.076 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.070+0000 7f9fcaf98ec0 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-12-09T12:15:42.077 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.070+0000 7f9fcaf98ec0 20 get_system_obj_state: rctx=0x7ffcbd50a388 obj=default.rgw.meta:users.keys:HQATBITRCXZJZCJNLCSM state=0x563dded61650 s->prefetch_data=0 2019-12-09T12:15:42.077 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.070+0000 7f9fcaf98ec0 10 cache get: name=default.rgw.meta+users.keys+HQATBITRCXZJZCJNLCSM : miss 2019-12-09T12:15:42.087 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.081+0000 7f9fcaf98ec0 10 cache put: name=default.rgw.meta+users.keys+HQATBITRCXZJZCJNLCSM info.flags=0x0 2019-12-09T12:15:42.087 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.081+0000 7f9fcaf98ec0 10 adding default.rgw.meta+users.keys+HQATBITRCXZJZCJNLCSM to cache LRU end 2019-12-09T12:15:42.087 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.081+0000 7f9fcaf98ec0 20 get_system_obj_state: rctx=0x7ffcbd509f98 obj=default.rgw.meta:users.keys:HQATBITRCXZJZCJNLCSM state=0x563dded61650 s->prefetch_data=0 2019-12-09T12:15:42.087 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.081+0000 7f9fcaf98ec0 10 cache get: name=default.rgw.meta+users.keys+HQATBITRCXZJZCJNLCSM : type miss (requested=0x6, cached=0x0) 2019-12-09T12:15:42.096 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.090+0000 7f9fcaf98ec0 10 cache put: name=default.rgw.meta+users.keys+HQATBITRCXZJZCJNLCSM info.flags=0x0 2019-12-09T12:15:42.097 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.090+0000 7f9fcaf98ec0 10 moving default.rgw.meta+users.keys+HQATBITRCXZJZCJNLCSM to cache LRU end 2019-12-09T12:15:42.097 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.090+0000 7f9fcaf98ec0 20 get_system_obj_state: rctx=0x7ffcbd50a118 obj=default.rgw.meta:users.keys:HQATBITRCXZJZCJNLCSM state=0x563dded61650 s->prefetch_data=0 2019-12-09T12:15:42.097 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.090+0000 7f9fcaf98ec0 10 cache get: name=default.rgw.meta+users.keys+HQATBITRCXZJZCJNLCSM : type miss (requested=0x6, cached=0x0) 2019-12-09T12:15:42.106 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.099+0000 7f9fcaf98ec0 10 cache put: name=default.rgw.meta+users.keys+HQATBITRCXZJZCJNLCSM info.flags=0x0 2019-12-09T12:15:42.106 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.099+0000 7f9fcaf98ec0 10 moving default.rgw.meta+users.keys+HQATBITRCXZJZCJNLCSM to cache LRU end 2019-12-09T12:15:42.167 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.160+0000 7f9fcaf98ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-12-09T12:15:42.167 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.160+0000 7f9fcaf98ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T12:15:42.167 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.160+0000 7f9fcaf98ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=691 2019-12-09T12:15:42.181 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.175+0000 7f9fadffb700 10 RGWWatcher::handle_notify() notify_id 584115552315 cookie 94823730967920 notifier 4995 bl.length()=691 2019-12-09T12:15:42.181 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.175+0000 7f9fadffb700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-12-09T12:15:42.182 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.175+0000 7f9fadffb700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T12:15:42.763 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.756+0000 7f9fcaf98ec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-12-09T12:15:42.763 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.756+0000 7f9fcaf98ec0 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-12-09T12:15:42.763 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.756+0000 7f9fcaf98ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=224 2019-12-09T12:15:42.776 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.769+0000 7f9fadffb700 10 RGWWatcher::handle_notify() notify_id 584115552314 cookie 94823730976800 notifier 4995 bl.length()=224 2019-12-09T12:15:42.776 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.769+0000 7f9fadffb700 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-12-09T12:15:42.776 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.769+0000 7f9fadffb700 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-12-09T12:15:42.935 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.928+0000 7f9fcaf98ec0 10 cache put: name=default.rgw.meta+users.keys+HQATBITRCXZJZCJNLCSM info.flags=0x7 2019-12-09T12:15:42.935 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.928+0000 7f9fcaf98ec0 10 moving default.rgw.meta+users.keys+HQATBITRCXZJZCJNLCSM to cache LRU end 2019-12-09T12:15:42.935 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.928+0000 7f9fcaf98ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=201 2019-12-09T12:15:42.951 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.945+0000 7f9fadffb700 10 RGWWatcher::handle_notify() notify_id 584115552316 cookie 94823730967920 notifier 4995 bl.length()=201 2019-12-09T12:15:42.951 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.945+0000 7f9fadffb700 10 cache put: name=default.rgw.meta+users.keys+HQATBITRCXZJZCJNLCSM info.flags=0x7 2019-12-09T12:15:42.952 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:42.945+0000 7f9fadffb700 10 moving default.rgw.meta+users.keys+HQATBITRCXZJZCJNLCSM to cache LRU end 2019-12-09T12:15:43.304 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2019-12-09T12:15:43.304 INFO:teuthology.orchestra.run.smithi121.stdout: "user_id": "testx$tenanteduser.client.0", 2019-12-09T12:15:43.304 INFO:teuthology.orchestra.run.smithi121.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2019-12-09T12:15:43.305 INFO:teuthology.orchestra.run.smithi121.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2019-12-09T12:15:43.305 INFO:teuthology.orchestra.run.smithi121.stdout: "suspended": 0, 2019-12-09T12:15:43.305 INFO:teuthology.orchestra.run.smithi121.stdout: "max_buckets": 1000, 2019-12-09T12:15:43.305 INFO:teuthology.orchestra.run.smithi121.stdout: "subusers": [], 2019-12-09T12:15:43.305 INFO:teuthology.orchestra.run.smithi121.stdout: "keys": [ 2019-12-09T12:15:43.305 INFO:teuthology.orchestra.run.smithi121.stdout: { 2019-12-09T12:15:43.305 INFO:teuthology.orchestra.run.smithi121.stdout: "user": "testx$tenanteduser.client.0", 2019-12-09T12:15:43.306 INFO:teuthology.orchestra.run.smithi121.stdout: "access_key": "HQATBITRCXZJZCJNLCSM", 2019-12-09T12:15:43.306 INFO:teuthology.orchestra.run.smithi121.stdout: "secret_key": "r3DUNq4sDt3oVbPhwVn31wQWNspXDhQn97F+e3DqJzecHkIM1X8G2g==" 2019-12-09T12:15:43.306 INFO:teuthology.orchestra.run.smithi121.stdout: } 2019-12-09T12:15:43.306 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2019-12-09T12:15:43.306 INFO:teuthology.orchestra.run.smithi121.stdout: "swift_keys": [], 2019-12-09T12:15:43.306 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": [], 2019-12-09T12:15:43.306 INFO:teuthology.orchestra.run.smithi121.stdout: "op_mask": "read, write, delete", 2019-12-09T12:15:43.307 INFO:teuthology.orchestra.run.smithi121.stdout: "default_placement": "", 2019-12-09T12:15:43.307 INFO:teuthology.orchestra.run.smithi121.stdout: "default_storage_class": "", 2019-12-09T12:15:43.307 INFO:teuthology.orchestra.run.smithi121.stdout: "placement_tags": [], 2019-12-09T12:15:43.307 INFO:teuthology.orchestra.run.smithi121.stdout: "bucket_quota": { 2019-12-09T12:15:43.307 INFO:teuthology.orchestra.run.smithi121.stdout: "enabled": false, 2019-12-09T12:15:43.307 INFO:teuthology.orchestra.run.smithi121.stdout: "check_on_raw": false, 2019-12-09T12:15:43.307 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size": -1, 2019-12-09T12:15:43.307 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size_kb": 0, 2019-12-09T12:15:43.308 INFO:teuthology.orchestra.run.smithi121.stdout: "max_objects": -1 2019-12-09T12:15:43.308 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2019-12-09T12:15:43.308 INFO:teuthology.orchestra.run.smithi121.stdout: "user_quota": { 2019-12-09T12:15:43.308 INFO:teuthology.orchestra.run.smithi121.stdout: "enabled": false, 2019-12-09T12:15:43.308 INFO:teuthology.orchestra.run.smithi121.stdout: "check_on_raw": false, 2019-12-09T12:15:43.308 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size": -1, 2019-12-09T12:15:43.309 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size_kb": 0, 2019-12-09T12:15:43.309 INFO:teuthology.orchestra.run.smithi121.stdout: "max_objects": -1 2019-12-09T12:15:43.309 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2019-12-09T12:15:43.309 INFO:teuthology.orchestra.run.smithi121.stdout: "temp_url_keys": [], 2019-12-09T12:15:43.309 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "rgw", 2019-12-09T12:15:43.309 INFO:teuthology.orchestra.run.smithi121.stdout: "mfa_ids": [] 2019-12-09T12:15:43.309 INFO:teuthology.orchestra.run.smithi121.stdout:} 2019-12-09T12:15:43.310 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:15:43.346 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.339+0000 7f9fcaf98ec0 20 remove_watcher() i=0 2019-12-09T12:15:43.346 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.339+0000 7f9fcaf98ec0 2 removed watcher, disabling cache 2019-12-09T12:15:43.402 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.395+0000 7f9fcaf98ec0 20 remove_watcher() i=1 2019-12-09T12:15:43.457 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.450+0000 7f9fcaf98ec0 20 remove_watcher() i=2 2019-12-09T12:15:43.506 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.500+0000 7f9fcaf98ec0 20 remove_watcher() i=3 2019-12-09T12:15:43.571 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.564+0000 7f9fcaf98ec0 20 remove_watcher() i=4 2019-12-09T12:15:43.628 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.622+0000 7f9fcaf98ec0 20 remove_watcher() i=5 2019-12-09T12:15:43.684 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.678+0000 7f9fcaf98ec0 20 remove_watcher() i=6 2019-12-09T12:15:43.723 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.716+0000 7f9fcaf98ec0 20 remove_watcher() i=7 2019-12-09T12:15:43.732 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 6823701153 --totp-seed GD4UQRSRXHD4LX3LJK6BELZJAI66CK55GQDQTDVN23VEKLJA7AFEGLMIQ4ALEFYN --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-12-09T12:15:43.866 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.859+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:43.905 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.898+0000 7f4b4f6caec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:43.905 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.898+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:43.930 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.924+0000 7f4b4f6caec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:43.930 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.924+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:43.940 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.934+0000 7f4b4f6caec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:43.941 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.934+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:43.965 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:43.959+0000 7f4b4f6caec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:44.265 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.259+0000 7f4b4f6caec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T12:15:44.265 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.259+0000 7f4b4f6caec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T12:15:44.265 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.259+0000 7f4b4f6caec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T12:15:44.266 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.259+0000 7f4b4f6caec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T12:15:44.266 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.259+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:44.276 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.270+0000 7f4b4f6caec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:44.276 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.270+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:44.290 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.283+0000 7f4b4f6caec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:44.290 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.283+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:44.304 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.297+0000 7f4b4f6caec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:44.304 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.297+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:44.315 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.309+0000 7f4b4f6caec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:44.315 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.309+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:44.325 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.318+0000 7f4b4f6caec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:44.325 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.318+0000 7f4b4f6caec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T12:15:44.325 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.318+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:44.335 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.329+0000 7f4b4f6caec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:44.336 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.329+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:44.351 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.344+0000 7f4b4f6caec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:44.351 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.344+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:44.369 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.362+0000 7f4b4f6caec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T12:15:44.369 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.362+0000 7f4b4f6caec0 20 zonegroup default 2019-12-09T12:15:44.369 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.362+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:44.379 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.373+0000 7f4b4f6caec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:44.379 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.373+0000 7f4b4f6caec0 10 Cannot find current period zone using local zone 2019-12-09T12:15:44.379 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.373+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:44.388 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.382+0000 7f4b4f6caec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T12:15:44.388 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.382+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:44.405 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.398+0000 7f4b4f6caec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T12:15:44.405 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.398+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:44.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.413+0000 7f4b4f6caec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T12:15:44.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.413+0000 7f4b4f6caec0 20 zone default found 2019-12-09T12:15:44.419 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.413+0000 7f4b4f6caec0 20 started sync module instance, tier type = 2019-12-09T12:15:44.420 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.413+0000 7f4b4f6caec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T12:15:44.862 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.854+0000 7f4b4f6caec0 20 add_watcher() i=0 2019-12-09T12:15:44.862 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.854+0000 7f4b4f6caec0 20 add_watcher() i=1 2019-12-09T12:15:44.862 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.854+0000 7f4b4f6caec0 20 add_watcher() i=2 2019-12-09T12:15:44.862 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.854+0000 7f4b4f6caec0 20 add_watcher() i=3 2019-12-09T12:15:44.863 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.854+0000 7f4b4f6caec0 20 add_watcher() i=4 2019-12-09T12:15:44.863 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.854+0000 7f4b4f6caec0 20 add_watcher() i=5 2019-12-09T12:15:44.863 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.854+0000 7f4b4f6caec0 20 add_watcher() i=6 2019-12-09T12:15:44.893 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.887+0000 7f4b4f6caec0 20 add_watcher() i=7 2019-12-09T12:15:44.894 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.887+0000 7f4b4f6caec0 2 all 8 watchers are set, enabling cache 2019-12-09T12:15:44.894 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.887+0000 7f4b0d7e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T12:15:44.897 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.891+0000 7f4b3d0f5700 0 -- 172.21.15.121:0/3947778286 >> v2:172.21.15.121:3300/0 conn(0x55f7ec5e6890 msgr2=0x55f7ec5e6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T12:15:44.951 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:44.945+0000 7f4b3d0f5700 0 -- 172.21.15.121:0/3035481460 >> [v2:172.21.15.132:6800/8843,v1:172.21.15.132:6801/8843] conn(0x7f4a80022490 msgr2=0x7f4a80024960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T12:15:46.610 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.603+0000 7f4a777fe700 20 reqs_thread_entry: start 2019-12-09T12:15:46.610 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.604+0000 7f4a757fa700 20 reqs_thread_entry: start 2019-12-09T12:15:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.604+0000 7f4b4f6caec0 20 init_complete bucket index max shards: 0 2019-12-09T12:15:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.605+0000 7f4a677fe700 20 reqs_thread_entry: start 2019-12-09T12:15:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.605+0000 7f4b4f6caec0 20 get_system_obj_state: rctx=0x7ffe07e080b8 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x55f7ec668770 s->prefetch_data=0 2019-12-09T12:15:46.612 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.605+0000 7f4b4f6caec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-12-09T12:15:46.633 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.627+0000 7f4b4f6caec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-12-09T12:15:46.634 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.627+0000 7f4b4f6caec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T12:15:46.634 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.627+0000 7f4b4f6caec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T12:15:46.634 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.627+0000 7f4b4f6caec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T12:15:46.634 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.627+0000 7f4b4f6caec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-09T12:15:46.634 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.627+0000 7f4b4f6caec0 20 rados->read ofs=0 len=0 2019-12-09T12:15:46.656 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.650+0000 7f4b4f6caec0 20 rados_obj.operate() r=0 bl.length=491 2019-12-09T12:15:46.656 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.650+0000 7f4b4f6caec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-12-09T12:15:46.657 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.650+0000 7f4b4f6caec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T12:15:46.781 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.775+0000 7f4b4f6caec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-12-09T12:15:46.781 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.775+0000 7f4b4f6caec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T12:15:46.782 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.775+0000 7f4b4f6caec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=705 2019-12-09T12:15:46.794 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.787+0000 7f4b227fc700 10 RGWWatcher::handle_notify() notify_id 584115552317 cookie 94523310837232 notifier 5013 bl.length()=705 2019-12-09T12:15:46.794 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.787+0000 7f4b227fc700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-12-09T12:15:46.794 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:46.787+0000 7f4b227fc700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T12:15:47.189 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:47.183+0000 7f4b4f6caec0 20 remove_watcher() i=0 2019-12-09T12:15:47.189 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:47.183+0000 7f4b4f6caec0 2 removed watcher, disabling cache 2019-12-09T12:15:47.242 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:47.235+0000 7f4b4f6caec0 20 remove_watcher() i=1 2019-12-09T12:15:47.287 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:47.281+0000 7f4b4f6caec0 20 remove_watcher() i=2 2019-12-09T12:15:47.343 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:47.337+0000 7f4b4f6caec0 20 remove_watcher() i=3 2019-12-09T12:15:47.396 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:47.389+0000 7f4b4f6caec0 20 remove_watcher() i=4 2019-12-09T12:15:47.449 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:47.443+0000 7f4b4f6caec0 20 remove_watcher() i=5 2019-12-09T12:15:47.510 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:47.503+0000 7f4b4f6caec0 20 remove_watcher() i=6 2019-12-09T12:15:47.559 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T12:15:47.553+0000 7f4b4f6caec0 20 remove_watcher() i=7 2019-12-09T12:15:47.570 INFO:tasks.s3tests:Configuring s3-tests... 2019-12-09T12:15:47.570 INFO:teuthology.orchestra.run.smithi121:> cd /home/ubuntu/cephtest/s3-tests && ./bootstrap 2019-12-09T12:15:53.407 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:36:51.430 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:15:53.423 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:36:51.438 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:15:53.423 INFO:teuthology.orchestra.run.smithi121.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-12-09T12:15:53.424 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:36:51.443 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:15:53.425 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:36:51.448 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:15:53.430 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:36:51.401 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:15:53.437 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:36:51.408 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:15:53.553 INFO:teuthology.orchestra.run.smithi121.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-09T12:15:53.592 INFO:teuthology.orchestra.run.smithi121.stdout:Loading mirror speeds from cached hostfile 2019-12-09T12:15:53.593 INFO:teuthology.orchestra.run.smithi121.stdout: * base: mirror.ash.fastserv.com 2019-12-09T12:15:53.593 INFO:teuthology.orchestra.run.smithi121.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-09T12:15:53.594 INFO:teuthology.orchestra.run.smithi121.stdout: * extras: mirrors.tripadvisor.com 2019-12-09T12:15:53.594 INFO:teuthology.orchestra.run.smithi121.stdout: * updates: mirror.cogentco.com 2019-12-09T12:15:53.618 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:36:51.642 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:15:53.691 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:36:51.714 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:15:53.708 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:36:51.678 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:15:54.283 INFO:teuthology.orchestra.run.smithi121.stdout:7 packages excluded due to repository priority protections 2019-12-09T12:15:54.650 INFO:teuthology.orchestra.run.smithi121.stdout:Resolving Dependencies 2019-12-09T12:15:54.650 INFO:teuthology.orchestra.run.smithi121.stdout:--> Running transaction check 2019-12-09T12:15:54.651 INFO:teuthology.orchestra.run.smithi121.stdout:---> Package libffi-devel.x86_64 0:3.0.13-18.el7 will be installed 2019-12-09T12:15:55.042 INFO:teuthology.orchestra.run.smithi121.stdout:--> Finished Dependency Resolution 2019-12-09T12:15:55.276 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:15:55.276 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies Resolved 2019-12-09T12:15:55.277 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:15:55.277 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T12:15:55.277 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2019-12-09T12:15:55.277 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T12:15:55.278 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2019-12-09T12:15:55.278 INFO:teuthology.orchestra.run.smithi121.stdout: libffi-devel x86_64 3.0.13-18.el7 base 23 k 2019-12-09T12:15:55.278 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:15:55.278 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2019-12-09T12:15:55.278 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2019-12-09T12:15:55.278 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2019-12-09T12:15:55.278 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:15:55.279 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 23 k 2019-12-09T12:15:55.279 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 27 k 2019-12-09T12:15:55.279 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading packages: 2019-12-09T12:15:55.492 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2019-12-09T12:15:55.496 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2019-12-09T12:15:55.499 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded 2019-12-09T12:15:55.500 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2019-12-09T12:15:55.967 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-12-09T12:15:56.403 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-12-09T12:15:56.404 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:15:56.404 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2019-12-09T12:15:56.404 INFO:teuthology.orchestra.run.smithi121.stdout: libffi-devel.x86_64 0:3.0.13-18.el7 2019-12-09T12:15:56.404 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:15:56.404 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2019-12-09T12:15:56.584 INFO:teuthology.orchestra.run.smithi121.stdout:New python executable in /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python 2019-12-09T12:15:58.078 INFO:teuthology.orchestra.run.smithi121.stdout:Installing setuptools, pip, wheel...done. 2019-12-09T12:15:58.409 INFO:teuthology.orchestra.run.smithi121.stderr:Cache entry deserialization failed, entry ignored 2019-12-09T12:15:58.550 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting pip 2019-12-09T12:15:58.630 INFO:teuthology.orchestra.run.smithi121.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-12-09T12:15:58.694 INFO:teuthology.orchestra.run.smithi121.stdout:Installing collected packages: pip 2019-12-09T12:15:58.695 INFO:teuthology.orchestra.run.smithi121.stdout: Found existing installation: pip 9.0.1 2019-12-09T12:15:58.754 INFO:teuthology.orchestra.run.smithi121.stdout: Uninstalling pip-9.0.1: 2019-12-09T12:15:58.796 INFO:teuthology.orchestra.run.smithi121.stdout: Successfully uninstalled pip-9.0.1 2019-12-09T12:15:59.375 INFO:teuthology.orchestra.run.smithi121.stdout:Successfully installed pip-19.3.1 2019-12-09T12:15:59.686 INFO:teuthology.orchestra.run.smithi121.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-09T12:16:00.153 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting setuptools==32.3.1 2019-12-09T12:16:00.156 INFO:teuthology.orchestra.run.smithi121.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-12-09T12:16:00.195 INFO:teuthology.orchestra.run.smithi121.stdout:Installing collected packages: setuptools 2019-12-09T12:16:00.195 INFO:teuthology.orchestra.run.smithi121.stdout: Found existing installation: setuptools 28.8.0 2019-12-09T12:16:00.209 INFO:teuthology.orchestra.run.smithi121.stdout: Uninstalling setuptools-28.8.0: 2019-12-09T12:16:00.219 INFO:teuthology.orchestra.run.smithi121.stdout: Successfully uninstalled setuptools-28.8.0 2019-12-09T12:16:00.342 INFO:teuthology.orchestra.run.smithi121.stdout:Successfully installed setuptools-32.3.1 2019-12-09T12:16:00.837 INFO:teuthology.orchestra.run.smithi121.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-09T12:16:01.002 INFO:teuthology.orchestra.run.smithi121.stdout:Processing /home/ubuntu/.cache/pip/wheels/54/b7/c7/2ada654ee54483c9329871665aaf4a6056c3ce36f29cf66e67/PyYAML-5.2-cp27-cp27mu-linux_x86_64.whl 2019-12-09T12:16:01.057 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting nose>=1.0.0 2019-12-09T12:16:01.059 INFO:teuthology.orchestra.run.smithi121.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-12-09T12:16:01.180 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting boto>=2.6.0 2019-12-09T12:16:01.187 INFO:teuthology.orchestra.run.smithi121.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-12-09T12:16:01.673 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting boto3>=1.0.0 2019-12-09T12:16:01.718 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/1f/a5/6b25e39aea40bc03163615c07572d90aaddc9951f5af9c21204d3da46398/boto3-1.10.34-py2.py3-none-any.whl (128kB) 2019-12-09T12:16:01.853 INFO:teuthology.orchestra.run.smithi121.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-12-09T12:16:02.135 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting gevent>=1.0 2019-12-09T12:16:02.150 INFO:teuthology.orchestra.run.smithi121.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-09T12:16:02.415 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting isodate>=0.4.4 2019-12-09T12:16:02.426 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl (45kB) 2019-12-09T12:16:02.565 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting requests>=0.14.0 2019-12-09T12:16:02.575 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB) 2019-12-09T12:16:02.803 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting pytz>=2011k 2019-12-09T12:16:02.812 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/e7/f9/f0b53f88060247251bf481fa6ea62cd0d25bf1b11a87888e53ce5b7c8ad2/pytz-2019.3-py2.py3-none-any.whl (509kB) 2019-12-09T12:16:03.015 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting ordereddict 2019-12-09T12:16:03.024 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/53/25/ef88e8e45db141faa9598fbf7ad0062df8f50f881a36ed6a0073e1572126/ordereddict-1.1.tar.gz 2019-12-09T12:16:03.402 INFO:teuthology.orchestra.run.smithi121.stdout:Processing /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488/httplib2-0.14.0-cp27-none-any.whl 2019-12-09T12:16:03.833 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting lxml 2019-12-09T12:16:03.847 INFO:teuthology.orchestra.run.smithi121.stdout: Using cached https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-09T12:16:04.032 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting jmespath<1.0.0,>=0.7.1 2019-12-09T12:16:04.042 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/83/94/7179c3832a6d45b266ddb2aac329e101367fbdb11f425f13771d27f225bb/jmespath-0.9.4-py2.py3-none-any.whl 2019-12-09T12:16:04.688 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting botocore<1.14.0,>=1.13.34 2019-12-09T12:16:04.697 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/59/cb/b4772a4abc128f6fd637af9d7fc93a1db11617859af680fc2b2e6282eb95/botocore-1.13.34-py2.py3-none-any.whl (5.8MB) 2019-12-09T12:16:05.214 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting s3transfer<0.3.0,>=0.2.0 2019-12-09T12:16:05.224 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/16/8a/1fc3dba0c4923c2a76e1ff0d52b305c44606da63f718d14d3231e21c51b0/s3transfer-0.2.1-py2.py3-none-any.whl (70kB) 2019-12-09T12:16:05.444 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-12-09T12:16:05.449 INFO:teuthology.orchestra.run.smithi121.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-09T12:16:05.520 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting six 2019-12-09T12:16:05.530 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-12-09T12:16:05.597 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting chardet<3.1.0,>=3.0.2 2019-12-09T12:16:05.607 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB) 2019-12-09T12:16:05.693 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting idna<2.9,>=2.5 2019-12-09T12:16:05.704 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB) 2019-12-09T12:16:05.846 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 2019-12-09T12:16:05.856 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/b4/40/a9837291310ee1ccc242ceb6ebfd9eb21539649f193a7c8c86ba15b98539/urllib3-1.25.7-py2.py3-none-any.whl (125kB) 2019-12-09T12:16:05.983 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting certifi>=2017.4.17 2019-12-09T12:16:05.992 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/b9/63/df50cac98ea0d5b006c55a399c3bf1db9da7b5a24de7890bc9cfd5dd9e99/certifi-2019.11.28-py2.py3-none-any.whl (156kB) 2019-12-09T12:16:06.106 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting docutils<0.16,>=0.10 2019-12-09T12:16:06.116 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/3a/dc/bf2b15d1fa15a6f7a9e77a61b74ecbbae7258558fcda8ffc9a6638a6b327/docutils-0.15.2-py2-none-any.whl (548kB) 2019-12-09T12:16:06.311 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting python-dateutil<2.8.1,>=2.1; python_version >= "2.7" 2019-12-09T12:16:06.322 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB) 2019-12-09T12:16:06.432 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting futures<4.0.0,>=2.2.0; python_version == "2.6" or python_version == "2.7" 2019-12-09T12:16:06.441 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/d8/a6/f46ae3f1da0cd4361c344888f59ec2f5785e69c872e175a748ef6071cdb5/futures-3.3.0-py2-none-any.whl 2019-12-09T12:16:06.465 INFO:teuthology.orchestra.run.smithi121.stdout:Building wheels for collected packages: ordereddict 2019-12-09T12:16:06.466 INFO:teuthology.orchestra.run.smithi121.stdout: Building wheel for ordereddict (setup.py): started 2019-12-09T12:16:06.696 INFO:teuthology.orchestra.run.smithi121.stdout: Building wheel for ordereddict (setup.py): finished with status 'done' 2019-12-09T12:16:06.697 INFO:teuthology.orchestra.run.smithi121.stdout: Created wheel for ordereddict: filename=ordereddict-1.1-cp27-none-any.whl size=3327 sha256=886cbd837e8e7074720626267bd865cfdc16a0dee7fbbd1330205b551019d20f 2019-12-09T12:16:06.697 INFO:teuthology.orchestra.run.smithi121.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/78/d3/a8/9f52c7a389a0ffba6f575a3886b5f7a55461fb6ec34aa5fd38 2019-12-09T12:16:06.699 INFO:teuthology.orchestra.run.smithi121.stdout:Successfully built ordereddict 2019-12-09T12:16:06.778 INFO:teuthology.orchestra.run.smithi121.stdout:Installing collected packages: PyYAML, nose, boto, jmespath, docutils, six, python-dateutil, urllib3, botocore, futures, s3transfer, boto3, bunch, greenlet, gevent, isodate, chardet, idna, certifi, requests, pytz, ordereddict, httplib2, lxml 2019-12-09T12:16:09.044 INFO:teuthology.orchestra.run.smithi121.stdout:Successfully installed PyYAML-5.2 boto-2.49.0 boto3-1.10.34 botocore-1.13.34 bunch-1.0.1 certifi-2019.11.28 chardet-3.0.4 docutils-0.15.2 futures-3.3.0 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 idna-2.8 isodate-0.6.0 jmespath-0.9.4 lxml-4.4.2 nose-1.3.7 ordereddict-1.1 python-dateutil-2.8.0 pytz-2019.3 requests-2.22.0 s3transfer-0.2.1 six-1.13.0 urllib3-1.25.7 2019-12-09T12:16:09.435 INFO:teuthology.orchestra.run.smithi121.stdout:running develop 2019-12-09T12:16:09.493 INFO:teuthology.orchestra.run.smithi121.stdout:running egg_info 2019-12-09T12:16:09.493 INFO:teuthology.orchestra.run.smithi121.stdout:creating s3tests.egg-info 2019-12-09T12:16:09.493 INFO:teuthology.orchestra.run.smithi121.stdout:writing requirements to s3tests.egg-info/requires.txt 2019-12-09T12:16:09.493 INFO:teuthology.orchestra.run.smithi121.stdout:writing s3tests.egg-info/PKG-INFO 2019-12-09T12:16:09.493 INFO:teuthology.orchestra.run.smithi121.stdout:writing top-level names to s3tests.egg-info/top_level.txt 2019-12-09T12:16:09.493 INFO:teuthology.orchestra.run.smithi121.stdout:writing dependency_links to s3tests.egg-info/dependency_links.txt 2019-12-09T12:16:09.494 INFO:teuthology.orchestra.run.smithi121.stdout:writing entry points to s3tests.egg-info/entry_points.txt 2019-12-09T12:16:09.495 INFO:teuthology.orchestra.run.smithi121.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-12-09T12:16:09.496 INFO:teuthology.orchestra.run.smithi121.stdout:reading manifest file 's3tests.egg-info/SOURCES.txt' 2019-12-09T12:16:09.497 INFO:teuthology.orchestra.run.smithi121.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-12-09T12:16:09.498 INFO:teuthology.orchestra.run.smithi121.stdout:running build_ext 2019-12-09T12:16:09.499 INFO:teuthology.orchestra.run.smithi121.stdout:Creating /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/s3tests.egg-link (link to .) 2019-12-09T12:16:09.499 INFO:teuthology.orchestra.run.smithi121.stdout:Adding s3tests 0.0.1 to easy-install.pth file 2019-12-09T12:16:09.502 INFO:teuthology.orchestra.run.smithi121.stdout:Installing s3tests-fuzz-headers script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-09T12:16:09.502 INFO:teuthology.orchestra.run.smithi121.stdout:Installing s3tests-generate-objects script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-09T12:16:09.503 INFO:teuthology.orchestra.run.smithi121.stdout:Installing s3tests-test-roundtrip script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-09T12:16:09.503 INFO:teuthology.orchestra.run.smithi121.stdout:Installing s3tests-analysis-rwstats script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-09T12:16:09.503 INFO:teuthology.orchestra.run.smithi121.stdout:Installing s3tests-test-readwrite script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-09T12:16:09.503 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:16:09.503 INFO:teuthology.orchestra.run.smithi121.stdout:Installed /home/ubuntu/cephtest/s3-tests 2019-12-09T12:16:09.504 INFO:teuthology.orchestra.run.smithi121.stdout:Processing dependencies for s3tests==0.0.1 2019-12-09T12:16:09.553 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for isodate==0.6.0 2019-12-09T12:16:09.554 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: isodate 0.6.0 2019-12-09T12:16:09.554 INFO:teuthology.orchestra.run.smithi121.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-12-09T12:16:09.554 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:16:09.554 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T12:16:09.555 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for gevent==1.4.0 2019-12-09T12:16:09.555 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: gevent 1.4.0 2019-12-09T12:16:09.555 INFO:teuthology.orchestra.run.smithi121.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-12-09T12:16:09.555 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:16:09.555 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T12:16:09.556 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for bunch==1.0.1 2019-12-09T12:16:09.557 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: bunch 1.0.1 2019-12-09T12:16:09.557 INFO:teuthology.orchestra.run.smithi121.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-12-09T12:16:09.557 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:16:09.557 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T12:16:09.557 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for PyYAML==5.2 2019-12-09T12:16:09.557 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: PyYAML 5.2 2019-12-09T12:16:09.558 INFO:teuthology.orchestra.run.smithi121.stdout:Adding PyYAML 5.2 to easy-install.pth file 2019-12-09T12:16:09.558 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:16:09.558 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T12:16:09.559 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for boto3==1.10.34 2019-12-09T12:16:09.559 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: boto3 1.10.34 2019-12-09T12:16:09.559 INFO:teuthology.orchestra.run.smithi121.stdout:Adding boto3 1.10.34 to easy-install.pth file 2019-12-09T12:16:09.559 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:16:09.559 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T12:16:09.559 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for boto==2.49.0 2019-12-09T12:16:09.564 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: boto 2.49.0 2019-12-09T12:16:09.564 INFO:teuthology.orchestra.run.smithi121.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-12-09T12:16:09.564 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:16:09.564 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T12:16:09.564 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for six==1.13.0 2019-12-09T12:16:09.565 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: six 1.13.0 2019-12-09T12:16:09.565 INFO:teuthology.orchestra.run.smithi121.stdout:Adding six 1.13.0 to easy-install.pth file 2019-12-09T12:16:09.565 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:16:09.565 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T12:16:09.569 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for greenlet==0.4.15 2019-12-09T12:16:09.569 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: greenlet 0.4.15 2019-12-09T12:16:09.569 INFO:teuthology.orchestra.run.smithi121.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-12-09T12:16:09.570 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:16:09.570 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T12:16:09.570 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for s3transfer==0.2.1 2019-12-09T12:16:09.570 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: s3transfer 0.2.1 2019-12-09T12:16:09.570 INFO:teuthology.orchestra.run.smithi121.stdout:Adding s3transfer 0.2.1 to easy-install.pth file 2019-12-09T12:16:09.571 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:16:09.571 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T12:16:09.572 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for botocore==1.13.34 2019-12-09T12:16:09.572 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: botocore 1.13.34 2019-12-09T12:16:09.572 INFO:teuthology.orchestra.run.smithi121.stdout:Adding botocore 1.13.34 to easy-install.pth file 2019-12-09T12:16:09.572 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:16:09.572 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T12:16:09.572 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for jmespath==0.9.4 2019-12-09T12:16:09.574 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: jmespath 0.9.4 2019-12-09T12:16:09.574 INFO:teuthology.orchestra.run.smithi121.stdout:Adding jmespath 0.9.4 to easy-install.pth file 2019-12-09T12:16:09.574 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:16:09.574 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T12:16:09.574 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for futures==3.3.0 2019-12-09T12:16:09.574 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: futures 3.3.0 2019-12-09T12:16:09.575 INFO:teuthology.orchestra.run.smithi121.stdout:Adding futures 3.3.0 to easy-install.pth file 2019-12-09T12:16:09.575 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:16:09.575 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T12:16:09.575 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for urllib3==1.25.7 2019-12-09T12:16:09.575 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: urllib3 1.25.7 2019-12-09T12:16:09.575 INFO:teuthology.orchestra.run.smithi121.stdout:Adding urllib3 1.25.7 to easy-install.pth file 2019-12-09T12:16:09.575 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:16:09.575 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T12:16:09.576 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for python-dateutil==2.8.0 2019-12-09T12:16:09.576 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: python-dateutil 2.8.0 2019-12-09T12:16:09.576 INFO:teuthology.orchestra.run.smithi121.stdout:Adding python-dateutil 2.8.0 to easy-install.pth file 2019-12-09T12:16:09.576 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:16:09.576 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T12:16:09.576 INFO:teuthology.orchestra.run.smithi121.stdout:Searching for docutils==0.15.2 2019-12-09T12:16:09.576 INFO:teuthology.orchestra.run.smithi121.stdout:Best match: docutils 0.15.2 2019-12-09T12:16:09.577 INFO:teuthology.orchestra.run.smithi121.stdout:Adding docutils 0.15.2 to easy-install.pth file 2019-12-09T12:16:09.577 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T12:16:09.577 INFO:teuthology.orchestra.run.smithi121.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-09T12:16:09.577 INFO:teuthology.orchestra.run.smithi121.stdout:Finished processing dependencies for s3tests==0.0.1 2019-12-09T12:16:09.580 INFO:teuthology.orchestra.run.smithi121:> cat > /home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2019-12-09T12:16:09.642 INFO:tasks.s3tests:Configuring boto... 2019-12-09T12:16:09.642 INFO:teuthology.orchestra.run.smithi121:> cat > /home/ubuntu/cephtest/boto.cfg 2019-12-09T12:16:09.735 INFO:teuthology.orchestra.run.smithi121:s3 tests against rgw> S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!fails_with_subdomain' 2019-12-09T12:16:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_none ... ok 2019-12-09T12:16:19.692 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_empty ... ok 2019-12-09T12:16:23.319 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_date_and_amz_date ... ok 2019-12-09T12:16:26.751 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_amz_date_and_no_date ... ok 2019-12-09T12:16:30.389 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_none ... ok 2019-12-09T12:16:33.616 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_contentlength_none ... ok 2019-12-09T12:16:39.285 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_acl_create_contentlength_none ... ok 2019-12-09T12:16:42.522 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_contentlength_none ... ok 2019-12-09T12:16:43.305 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_empty ... ok 2019-12-09T12:16:43.900 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_none ... ok 2019-12-09T12:16:46.729 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws2 ... ok 2019-12-09T12:16:51.741 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws2 ... ok 2019-12-09T12:16:54.353 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws2 ... ok 2019-12-09T12:16:56.177 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws2 ... ok 2019-12-09T12:16:56.755 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws2 ... ok 2019-12-09T12:16:57.148 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws2 ... ok 2019-12-09T12:16:57.148 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws4 ... SKIP 2019-12-09T12:16:57.148 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws4 ... SKIP 2019-12-09T12:16:57.148 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws4 ... SKIP 2019-12-09T12:16:57.149 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws4 ... SKIP 2019-12-09T12:16:57.149 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_empty_aws4 ... SKIP 2019-12-09T12:16:57.149 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_none_aws4 ... SKIP 2019-12-09T12:16:57.149 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_date_invalid_aws4 ... SKIP 2019-12-09T12:16:57.149 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_invalid_aws4 ... SKIP 2019-12-09T12:16:57.149 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_date_empty_aws4 ... SKIP 2019-12-09T12:16:57.149 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_empty_aws4 ... SKIP 2019-12-09T12:16:57.150 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws4 ... SKIP 2019-12-09T12:16:57.150 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_none_aws4 ... SKIP 2019-12-09T12:16:57.150 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_today_aws4 ... SKIP 2019-12-09T12:16:57.150 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_today_aws4 ... SKIP 2019-12-09T12:16:57.150 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_today_aws4 ... SKIP 2019-12-09T12:16:57.150 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_today_aws4 ... SKIP 2019-12-09T12:16:57.150 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_epoch_aws4 ... SKIP 2019-12-09T12:16:57.151 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-12-09T12:16:57.151 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_end_aws4 ... SKIP 2019-12-09T12:16:57.151 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_end_aws4 ... SKIP 2019-12-09T12:16:57.151 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_custom_header_aws4 ... SKIP 2019-12-09T12:16:57.151 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_header_aws4 ... SKIP 2019-12-09T12:16:57.151 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws4 ... SKIP 2019-12-09T12:16:57.151 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_empty_aws4 ... SKIP 2019-12-09T12:16:57.152 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_none_aws4 ... SKIP 2019-12-09T12:16:57.152 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_invalid_aws4 ... SKIP 2019-12-09T12:16:57.152 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_invalid_aws4 ... SKIP 2019-12-09T12:16:57.152 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_empty_aws4 ... SKIP 2019-12-09T12:16:57.152 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_empty_aws4 ... SKIP 2019-12-09T12:16:57.152 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws4 ... SKIP 2019-12-09T12:16:57.153 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_none_aws4 ... SKIP 2019-12-09T12:16:57.153 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_today_aws4 ... SKIP 2019-12-09T12:16:57.155 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_today_aws4 ... SKIP 2019-12-09T12:16:57.155 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_after_today_aws4 ... SKIP 2019-12-09T12:16:57.155 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_after_today_aws4 ... SKIP 2019-12-09T12:16:57.155 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws4 ... SKIP 2019-12-09T12:16:57.155 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-12-09T12:17:06.209 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_versioning_obj_read_not_exist_null ... ok 2019-12-09T12:17:06.209 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_lifecycle_transition ... SKIP 2019-12-09T12:17:06.209 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_lifecycle_transition_single_rule_multi_trans ... SKIP 2019-12-09T12:17:06.210 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_lifecycle_set_noncurrent_transition ... SKIP 2019-12-09T12:17:06.210 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_object_storage_class ... SKIP 2019-12-09T12:17:06.210 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_object_storage_class_multipart ... SKIP 2019-12-09T12:17:06.210 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_object_modify_storage_class ... SKIP 2019-12-09T12:17:06.210 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_object_modify_storage_class_multipart ... SKIP 2019-12-09T12:17:06.210 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_object_storage_class_copy ... SKIP 2019-12-09T12:17:06.210 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_object_storage_class_copy_multipart ... SKIP 2019-12-09T12:17:19.512 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_atomic_dual_conditional_write_1mb ... ok 2019-12-09T12:17:27.163 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_atomic_write_bucket_gone ... ok 2019-12-09T12:18:54.452 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:39:52.475 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:18:54.475 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:39:52.499 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:18:54.486 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:39:52.509 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:18:54.501 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:39:52.525 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:18:54.536 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:39:52.506 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:18:54.542 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:39:52.512 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:18:54.553 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:39:52.576 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:18:54.653 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:39:52.676 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:18:54.655 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:39:52.623 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:19:54.985 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_1 ... ok 2019-12-09T12:21:05.031 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:42:03.054 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:21:05.041 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:42:03.065 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:21:05.041 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:42:03.065 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:21:05.046 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:42:03.070 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:21:05.050 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:42:03.019 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:21:05.055 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:42:03.025 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:21:05.140 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:42:03.163 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:21:05.189 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:42:03.159 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:21:05.190 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:42:03.214 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:23:15.420 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_2 ... ok 2019-12-09T12:23:24.689 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_bucket_policy_set_condition_operator_end_with_IfExists ... ok 2019-12-09T12:23:29.300 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_enc ... ok 2019-12-09T12:23:34.463 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_request_obj_tag ... ok 2019-12-09T12:23:37.915 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.check_can_test_website ... SKIP 2019-12-09T12:23:37.915 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_nonexistant_bucket_rgw ... SKIP 2019-12-09T12:23:37.915 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_public_index ... SKIP 2019-12-09T12:23:37.915 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_public_index ... SKIP 2019-12-09T12:23:37.915 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty ... SKIP 2019-12-09T12:23:37.915 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty ... SKIP 2019-12-09T12:23:37.916 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index ... SKIP 2019-12-09T12:23:37.917 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index ... SKIP 2019-12-09T12:23:37.917 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_missingerrordoc ... SKIP 2019-12-09T12:23:37.917 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_missingerrordoc ... SKIP 2019-12-09T12:23:37.917 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_missingerrordoc ... SKIP 2019-12-09T12:23:37.920 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_missingerrordoc ... SKIP 2019-12-09T12:23:37.921 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_blockederrordoc ... SKIP 2019-12-09T12:23:37.921 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_blockederrordoc ... SKIP 2019-12-09T12:23:37.921 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_blockederrordoc ... SKIP 2019-12-09T12:23:37.921 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_blockederrordoc ... SKIP 2019-12-09T12:23:37.921 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_gooderrordoc ... SKIP 2019-12-09T12:23:37.921 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_gooderrordoc ... SKIP 2019-12-09T12:23:37.922 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_gooderrordoc ... SKIP 2019-12-09T12:23:37.922 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_gooderrordoc ... SKIP 2019-12-09T12:23:37.922 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_base ... SKIP 2019-12-09T12:23:37.922 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path ... SKIP 2019-12-09T12:23:37.922 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path_upgrade ... SKIP 2019-12-09T12:23:37.922 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_xredirect_nonwebsite ... SKIP 2019-12-09T12:23:37.922 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_relative ... SKIP 2019-12-09T12:23:37.923 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_abs ... SKIP 2019-12-09T12:23:37.923 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_relative ... SKIP 2019-12-09T12:23:37.923 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_abs ... SKIP 2019-12-09T12:23:37.923 INFO:teuthology.orchestra.run.smithi121.stderr:SKIP 2019-12-09T12:23:37.941 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.functional.test_utils.test_generate ... ok 2019-12-09T12:24:55.166 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-12-09T12:24:55.166 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-12-09T12:24:55.166 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-12-09T12:24:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-12-09T12:24:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-12-09T12:24:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-12-09T12:24:55.167 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-12-09T12:24:55.616 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-12-09T12:24:55.931 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-12-09T12:24:56.275 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-12-09T12:24:56.299 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-12-09T12:24:56.318 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-12-09T12:24:56.319 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-12-09T12:24:56.319 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-12-09T12:24:56.319 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-12-09T12:24:56.319 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-12-09T12:24:56.319 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-12-09T12:24:56.319 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-12-09T12:24:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-12-09T12:24:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-12-09T12:24:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-12-09T12:24:56.320 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-12-09T12:24:56.325 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-12-09T12:24:56.326 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-12-09T12:24:56.326 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-12-09T12:24:56.326 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_null_child ... ok 2019-12-09T12:24:56.330 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-12-09T12:24:56.330 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-12-09T12:24:56.330 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-12-09T12:24:56.331 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-12-09T12:24:56.355 INFO:teuthology.orchestra.run.smithi121.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-12-09T12:24:56.380 INFO:teuthology.orchestra.run.smithi121.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-12-09T12:24:56.380 INFO:teuthology.orchestra.run.smithi121.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-12-09T12:24:56.533 INFO:teuthology.orchestra.run.smithi121.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-12-09T12:24:57.655 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:24:57.656 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:24:58.512 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:24:58.513 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:24:59.787 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:24:59.788 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:00.938 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_short ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:00.939 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:05.203 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:05.203 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:05.583 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:25:05.902 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_bad ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:05.902 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:08.002 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:08.003 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:20.037 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:25:20.374 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:20.374 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:23.534 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:23.534 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:23.851 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:25:24.266 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:24.266 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:26.318 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:26.318 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:27.290 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:27.290 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:29.377 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:25:29.618 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_mismatch ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:29.618 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:33.043 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:33.043 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:34.812 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:34.813 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:36.484 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:25:36.784 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:36.784 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:39.810 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:39.810 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:42.486 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:42.487 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:43.438 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:25:43.728 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:43.728 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:45.955 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:45.955 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:47.891 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:47.891 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:49.479 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:25:49.751 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contentlength_negative ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:49.751 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:51.872 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:51.872 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:51.940 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:25:52.345 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_invalid ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:52.345 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:56.085 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:56.086 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:58.170 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:25:58.170 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:25:59.742 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:00.064 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:00.064 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:02.273 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:02.273 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:03.342 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:03.813 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:03.813 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:07.060 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:07.060 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:07.805 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:08.323 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_bucket_put_bad_canned_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:08.323 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:11.106 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:11.106 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:11.539 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:11.795 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_mismatch ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:11.795 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:13.639 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:13.902 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:13.902 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:15.138 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:15.582 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_contentlength_negative ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:15.582 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:15.634 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:15.957 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:47:13.982 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:26:15.966 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:47:13.991 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:26:15.974 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:47:13.998 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:26:15.977 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:47:14.002 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:26:15.982 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:47:13.951 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:26:15.988 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:47:13.957 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:26:16.018 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:16.018 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:16.173 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:47:14.197 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:26:16.173 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:47:14.197 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:26:16.227 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:47:14.196 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:26:18.037 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:18.037 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:18.162 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_empty_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:18.451 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:22.998 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:22.998 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:26.748 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:27.063 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_none_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:27.063 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:30.003 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:30.003 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:31.934 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:32.181 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_invalid_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:32.181 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:34.898 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:34.899 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:34.986 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:35.796 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_empty_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:35.797 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:39.381 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:39.381 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:39.484 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:39.736 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_today_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:39.736 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:42.984 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:42.984 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:43.499 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:44.017 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_epoch_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:44.017 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:46.390 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:46.390 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:46.618 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:46.915 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_after_end_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:46.915 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:49.352 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:49.352 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:49.655 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:50.087 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_empty_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:50.087 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:52.878 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:53.212 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_none_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:53.212 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:55.879 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:56.128 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_invalid_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:56.129 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:56.235 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:56.810 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_empty_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:56.810 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:56.997 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:57.572 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_today_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:57.572 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:57.757 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:58.153 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_after_today_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:58.153 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:58.254 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:59.299 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:59.300 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:26:59.419 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:26:59.863 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:26:59.864 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:27:03.002 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:27:03.348 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_distinct ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:27:03.349 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:27:05.832 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:27:05.833 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:27:10.990 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:27:11.290 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_many ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:27:11.290 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:27:16.177 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:48:14.201 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:27:16.221 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:48:14.245 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:27:16.224 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:48:14.193 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:27:16.241 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:48:14.210 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:27:16.253 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:48:14.277 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:27:16.259 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:48:14.284 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:27:16.265 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:48:14.289 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:27:16.294 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:48:14.318 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:27:16.295 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:48:14.264 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:27:17.429 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:27:17.429 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:27:18.443 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:27:18.727 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_many ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:27:18.727 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:27:22.631 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:27:22.631 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:27:23.571 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:27:23.845 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_basic_key_count ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:27:23.845 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:27:34.502 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:27:34.824 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:27:34.824 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:27:43.280 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:27:43.280 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:27:43.960 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:27:44.361 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:27:44.361 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:27:51.682 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:27:51.682 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:27:52.128 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:27:52.539 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:27:52.539 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:01.774 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:01.774 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:02.927 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:02.927 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:04.401 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:04.401 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:05.716 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:05.716 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:06.745 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:06.746 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:07.495 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:07.496 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:08.260 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:08.260 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:09.851 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:09.851 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:11.329 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:28:11.707 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:11.707 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:22.480 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:22.481 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:23.495 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:23.495 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:24.598 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:24.598 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:25.696 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:25.696 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:26.602 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:26.602 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:27.955 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:27.955 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:28.921 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:28.922 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:30.526 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:30.526 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:31.188 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:28:31.634 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_ends_with_delimiter ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:31.635 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:35.645 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:35.645 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:36.387 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:28:36.695 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_ends_with_delimiter ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:36.695 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:39.362 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:39.363 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:39.557 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:28:39.792 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:39.792 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:49.906 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:49.906 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:50.562 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:28:51.007 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:51.007 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:58.842 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:28:58.842 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:28:59.852 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:29:00.110 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_underscore ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:00.110 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:11.577 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:11.578 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:12.565 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:12.565 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:13.307 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:13.308 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:14.663 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:14.663 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:16.531 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:16.531 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:17.922 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:17.922 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:18.957 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:18.957 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:20.386 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:20.386 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:21.311 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:29:21.536 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_underscore ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:21.537 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:30.238 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:30.239 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:31.420 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:31.420 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:31.935 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:31.935 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:33.207 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:33.207 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:34.137 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:34.137 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:35.189 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:35.190 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:36.534 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:36.534 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:37.478 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:37.478 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:38.027 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:29:38.417 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_percentage ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:38.417 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:47.482 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:47.482 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:48.008 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:29:48.385 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_percentage ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:48.385 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:58.026 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:58.026 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:29:58.677 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:29:59.079 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_whitespace ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:29:59.079 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:30:08.630 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:30:08.630 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:30:08.828 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:30:09.937 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_whitespace ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:30:09.937 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:30:17.155 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:30:17.155 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:30:17.772 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:30:18.018 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_dot ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:30:18.018 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:30:26.914 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:30:26.914 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:30:27.621 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:30:27.889 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_dot ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:30:27.889 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:30:34.213 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:30:34.213 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:30:35.121 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:30:35.565 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:30:35.565 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:30:46.075 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:30:46.075 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:30:46.661 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:30:46.921 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:30:46.922 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:30:55.757 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:30:55.757 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:30:56.950 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:30:57.309 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:30:57.309 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:31:06.082 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:31:06.082 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:31:06.400 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:31:07.041 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:31:07.041 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:31:14.225 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:31:14.225 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:31:14.782 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:31:15.062 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:31:15.063 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:31:21.483 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:31:21.483 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:31:21.870 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:31:22.129 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:31:22.129 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:31:28.101 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:52:26.126 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:31:28.113 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:52:26.133 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:31:28.119 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:52:26.143 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:31:28.120 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:52:26.089 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:31:28.124 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:52:26.093 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:31:28.125 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:52:26.150 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:31:28.292 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:52:26.317 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:31:28.312 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:52:26.281 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:31:28.320 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:52:26.344 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:31:28.748 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:31:28.749 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:31:28.966 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:31:29.343 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_notempty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:31:29.344 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:31:35.498 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:31:35.498 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:31:35.897 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:31:36.186 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_defaultempty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:31:36.186 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:31:42.503 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:31:42.503 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:31:43.321 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:31:44.021 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:31:44.021 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:31:50.049 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:31:50.049 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:31:50.439 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:31:50.819 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:31:50.819 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:31:56.521 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:31:56.522 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:31:56.815 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:31:57.257 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:31:57.257 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:32:04.733 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:32:04.733 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:32:05.096 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:32:05.409 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_skip_special ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:32:05.410 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:35:37.840 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:56:35.865 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:35:37.910 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:56:35.935 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:35:37.962 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:56:35.931 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:35:37.963 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:56:35.987 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:35:37.965 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:56:35.989 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:35:37.969 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:56:35.938 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:35:38.010 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:56:36.034 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:35:38.091 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:56:36.116 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:35:38.109 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:56:36.078 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:36:39.117 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:57:37.142 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:36:39.123 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:57:37.148 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:36:39.136 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:57:37.161 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:36:39.141 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:57:37.165 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:36:39.148 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:57:37.117 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:36:39.152 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:57:37.121 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:36:39.202 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:02:57:37.227 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:36:39.216 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:02:57:37.240 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:36:39.249 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:02:57:37.217 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:41:52.515 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:02:50.539 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:41:53.497 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:02:50.508 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:41:53.497 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:02:50.513 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:41:53.497 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:02:50.776 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:41:53.497 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:02:50.547 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:41:53.497 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:02:50.748 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:41:53.497 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:02:50.559 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:41:53.498 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:02:50.563 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:41:53.498 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:02:50.757 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:42:49.356 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:03:47.381 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:42:49.400 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:03:47.425 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:42:49.423 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:03:47.448 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:42:49.432 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:03:47.456 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:42:49.452 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:03:47.421 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:42:49.458 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:03:47.483 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:42:49.461 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:03:47.430 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:42:49.479 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:03:47.504 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:42:49.510 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:03:47.479 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:43:59.728 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:04:57.753 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:43:59.773 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:04:57.798 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:43:59.829 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:04:57.854 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:43:59.833 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:04:57.858 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:43:59.837 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:04:57.862 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:43:59.877 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:04:57.846 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:43:59.878 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:04:57.847 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:43:59.896 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:04:57.920 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:43:59.957 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:04:57.926 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:02.725 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:08:00.749 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:02.738 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:08:00.762 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:02.739 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:08:00.763 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:02.742 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:08:00.711 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:02.744 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:08:00.769 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:02.751 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:08:00.720 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:02.876 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:08:00.845 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:02.879 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:08:00.904 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:47:02.955 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:08:00.979 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:16.246 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:13:14.270 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:16.255 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:13:14.279 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:16.264 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:13:14.233 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:16.268 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:13:14.293 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:16.271 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:13:14.240 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:16.273 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:13:14.297 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:16.490 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:13:14.515 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:16.499 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:13:14.468 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:16.543 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:13:14.567 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:21.251 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:13:19.275 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:21.258 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:13:19.283 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:21.284 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:13:19.308 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:21.290 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:13:19.314 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:21.316 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:13:19.340 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:21.325 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:13:19.295 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:21.331 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:13:19.356 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:21.351 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:13:19.321 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:52:21.376 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:13:19.345 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:54:06.594 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:54:06.595 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:54:08.399 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:54:08.710 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:54:08.710 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:54:14.727 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:54:14.727 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:54:15.217 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:54:15.442 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:54:15.442 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:54:22.274 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:54:22.274 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:54:22.843 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:54:23.118 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:54:23.119 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:54:31.408 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:54:31.409 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:54:31.842 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:54:32.139 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:54:32.139 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:54:40.574 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:54:40.574 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:54:40.915 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:54:41.242 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:54:41.242 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:54:47.383 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:54:47.383 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:54:48.108 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:54:48.367 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:54:48.367 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:54:56.464 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:54:56.464 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:54:56.955 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:54:57.321 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:54:57.322 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:55:05.406 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:55:05.406 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:55:05.770 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:55:06.433 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:55:06.433 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:55:13.923 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:55:13.924 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:55:14.741 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:55:15.104 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:55:15.105 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:55:21.984 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:55:21.984 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:55:22.394 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:55:22.713 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:55:22.713 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:55:31.966 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:55:31.966 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:55:33.482 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:55:33.807 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:55:33.807 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:55:40.297 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:55:40.297 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:55:41.008 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:55:41.334 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:55:41.334 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:55:49.192 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:55:49.192 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:55:49.722 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:55:50.595 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:55:50.595 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:55:58.706 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:55:58.707 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:55:59.488 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:55:59.738 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_basic ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:55:59.738 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:56:07.305 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:56:07.305 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:56:07.715 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:56:07.967 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:56:07.967 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:56:16.600 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:56:16.601 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:56:17.080 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:56:17.510 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_alt ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:56:17.511 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:56:25.365 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:56:25.365 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:56:26.325 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:56:26.584 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:56:26.585 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:56:34.990 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:56:34.990 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:56:35.741 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:56:36.603 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:56:36.603 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:56:44.811 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:56:44.812 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:56:45.056 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:56:45.707 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:56:45.707 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:56:53.392 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:56:53.392 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:56:54.183 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:56:54.468 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:56:54.469 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:57:00.227 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:57:00.227 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:57:00.698 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:57:01.498 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:57:01.498 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:57:11.382 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:57:11.382 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:57:12.288 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:57:13.040 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:57:13.041 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:57:21.545 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:57:21.545 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:57:22.132 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:57:22.411 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_one ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:57:22.411 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:57:27.267 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:18:25.292 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:57:27.274 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:18:25.299 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:57:27.283 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:18:25.252 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:57:27.285 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:18:25.310 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:57:27.286 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:18:25.256 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:57:27.288 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:18:25.313 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:57:27.464 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:18:25.434 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T12:57:27.466 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:18:25.491 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T12:57:27.536 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:18:25.561 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T12:57:28.526 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:57:28.526 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:57:29.726 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:57:30.039 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_one ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:57:30.039 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:57:39.756 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:57:39.757 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:57:40.487 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:57:41.014 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_zero ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:57:41.014 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:57:48.662 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:57:48.662 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:57:49.157 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:57:49.438 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_zero ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:57:49.438 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:57:57.525 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:57:57.526 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:57:58.497 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:57:58.823 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:57:58.824 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:58:06.325 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:58:06.326 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:58:06.626 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:58:07.073 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:58:07.073 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:58:16.298 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:58:16.298 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:58:16.959 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:58:17.533 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_unordered ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:58:17.533 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:58:58.397 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:58:58.397 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:59:01.289 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:59:01.936 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_unordered ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:59:01.936 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:59:39.442 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:59:39.443 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:59:42.594 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:59:43.233 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_invalid ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:59:43.233 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:59:53.988 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:59:53.989 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T12:59:54.097 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T12:59:54.492 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_none ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T12:59:54.493 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:00:02.724 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:00:02.724 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:00:03.842 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:00:04.320 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:00:04.320 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:00:13.652 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:00:13.652 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:00:14.277 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:00:14.725 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_continuationtoken_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:00:14.725 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:00:23.544 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:00:23.545 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:00:24.048 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:00:24.323 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:00:24.324 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:00:33.846 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:00:33.846 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:00:34.445 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:00:34.932 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_unreadable ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:00:34.933 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:00:42.885 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:21:40.910 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:42.891 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:21:40.916 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:42.903 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:21:40.928 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:42.905 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:21:40.930 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:42.930 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:21:40.900 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:42.941 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:21:40.911 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:42.975 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:21:41.000 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:42.994 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:21:41.019 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:43.060 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:21:41.029 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:00:43.306 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:00:43.307 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:00:43.639 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:00:43.873 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_not_in_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:00:43.873 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:00:53.676 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:00:53.676 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:00:54.547 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:00:54.819 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_not_in_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:00:54.820 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:01:01.972 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:01:01.973 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:01:02.573 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:01:03.386 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_after_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:01:03.386 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:01:11.623 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:01:11.623 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:01:11.949 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:01:12.363 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_after_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:01:12.363 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:01:18.180 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:01:18.181 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:01:18.902 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:01:19.173 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:01:19.173 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:01:25.676 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:01:25.676 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:01:28.152 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:01:28.493 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data_versioning ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:01:28.493 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:01:31.037 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:01:31.037 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:01:33.166 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:01:33.166 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:01:45.528 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:01:45.528 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:01:51.170 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:01:51.497 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:01:51.498 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:01:54.459 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:01:54.459 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:01:56.263 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:01:56.264 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:01:57.227 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:01:57.552 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:01:57.552 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:01:59.911 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:01:59.911 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:01.023 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:01.023 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:01.944 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:02:02.628 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous_fail ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:02.628 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:05.173 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:05.173 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:05.863 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:02:06.485 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous_fail ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:06.486 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:08.948 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:08.948 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:09.153 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:02:09.538 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:09.539 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:09.987 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:02:10.419 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:10.419 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:10.823 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:02:11.178 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:11.178 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:11.597 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:02:12.091 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_nonempty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:12.091 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:15.612 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:15.613 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:16.565 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:02:16.882 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_concurrent_set_canned_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:16.882 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:19.201 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:19.202 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:19.641 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:19.641 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:19.884 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:19.885 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:20.433 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:20.433 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:20.608 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:20.609 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:21.201 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:21.201 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:21.863 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:21.863 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:22.470 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:22.471 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:22.877 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:22.877 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:23.249 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:23.249 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:23.592 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:23.592 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:23.805 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:23.806 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:24.487 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:24.487 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:24.945 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:24.945 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:26.156 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:26.156 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:26.824 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:26.824 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:26.841 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:26.841 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:26.843 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:26.843 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:27.490 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:27.490 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:27.676 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:27.676 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:28.640 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:28.640 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:29.014 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:29.014 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:29.447 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:29.447 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:30.332 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:30.333 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:30.555 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:30.555 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:31.079 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:31.079 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:31.345 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:31.345 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:31.594 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:31.595 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:32.064 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:32.065 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:32.665 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:32.665 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:32.925 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:32.926 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:33.403 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:33.403 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:34.038 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:34.039 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:34.945 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:34.946 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:35.407 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:35.407 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:35.738 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:35.739 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:36.127 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:36.127 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:36.816 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:36.817 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:37.195 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:37.196 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:37.997 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:37.997 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:38.322 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:38.322 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:38.359 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:23:36.384 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:02:38.391 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:23:36.416 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:02:38.405 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:23:36.430 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:02:38.409 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:23:36.435 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:02:38.444 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:23:36.413 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:02:38.454 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:23:36.424 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:02:38.477 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:23:36.503 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:02:38.490 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:23:36.516 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:02:38.569 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:23:36.539 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:02:38.961 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:38.961 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:39.549 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:39.549 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:39.966 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:39.966 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:40.340 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:40.340 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:40.910 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:40.910 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:41.462 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:41.462 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:41.706 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:41.706 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:43.125 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:43.125 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:43.319 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:43.319 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:46.192 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:02:46.736 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_write_to_nonexist_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:46.736 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:47.275 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:02:47.566 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:47.566 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:49.837 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:49.838 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:54.172 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:02:54.394 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_read_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:54.394 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:56.774 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:56.775 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:02:57.150 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:02:57.406 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_requestid_matches_header_on_error ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:02:57.407 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:03:00.270 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:03:00.270 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:03:00.863 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:03:01.313 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multi_object_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:03:01.313 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:03:07.205 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:03:07.205 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:03:14.559 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:03:15.246 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multi_objectv2_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:03:15.246 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:03:22.096 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:03:22.096 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:03:31.419 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:03:31.697 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_head_zero_bytes ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:03:31.698 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:03:33.964 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:03:33.964 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:03:35.267 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:03:35.547 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_write_check_etag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:03:35.547 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:03:38.537 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:03:38.537 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:03:39.876 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:03:41.091 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_write_cache_control ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:03:41.091 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:03:44.959 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:03:44.960 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:03:47.214 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:03:47.641 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_write_expires ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:03:47.641 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:03:50.278 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:03:50.278 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:03:51.461 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:03:51.988 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_write_read_update_read_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:03:51.989 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:03:54.407 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:03:54.407 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:03.274 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:04:03.612 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:03.613 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:06.792 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:06.792 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:07.795 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:04:08.055 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:08.055 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:10.394 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:10.395 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:12.428 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:04:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_overwrite_to_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:12.689 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:15.722 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:15.722 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:17.465 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:17.465 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:19.730 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:04:20.044 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_unicode_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:20.044 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:22.165 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:22.165 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:23.407 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:04:23.636 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_metadata_replaced_on_put ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:23.636 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:26.690 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:26.690 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:30.306 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:04:31.237 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_write_file ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:31.237 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:34.180 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:34.180 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:36.088 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:04:36.539 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_anonymous_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:36.539 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:39.571 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:39.571 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:41.559 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:04:42.037 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:42.037 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:44.979 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:44.980 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:47.438 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:47.438 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:48.163 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:04:48.556 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_no_content_type ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:48.556 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:52.424 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:52.424 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:55.195 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:04:55.449 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request_bad_access_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:55.449 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:58.116 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:58.116 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:04:59.114 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:04:59.406 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_success_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:04:59.407 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:01.698 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:01.698 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:03.318 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:05:03.598 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_invalid_success_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:03.599 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:06.442 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:06.443 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:07.923 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:05:08.322 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_larger_than_chunk ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:08.322 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:11.347 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:11.348 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:19.652 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:19.652 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:22.487 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:05:22.859 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_key_from_filename ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:22.859 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:25.938 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:25.938 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:27.693 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:27.693 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:28.168 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:05:28.425 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_ignored_header ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:28.425 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:32.364 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:32.364 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:34.933 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:05:35.603 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_case_insensitive_condition_fields ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:35.603 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:37.957 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:37.957 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:39.826 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:05:40.121 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_escaped_field_values ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:40.121 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:43.487 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:43.487 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:45.930 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:45.930 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:46.243 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:05:46.972 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_success_redirect_action ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:46.973 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:49.545 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:49.546 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:55.384 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:05:55.778 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_signature ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:55.779 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:59.460 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:05:59.460 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:05:59.785 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:06:00.176 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_access_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:00.177 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:02.671 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:02.671 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:03.821 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:06:04.105 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_date_format ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:04.105 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:07.351 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:07.352 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:07.910 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:06:08.463 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_no_key_specified ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:08.463 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:11.617 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:11.618 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:11.788 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:06:12.030 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_signature ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:12.030 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:15.402 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:15.402 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:15.995 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:06:16.311 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_policy_condition ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:16.341 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:18.363 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:18.364 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:18.908 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:06:19.157 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_user_specified_header ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:19.158 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:22.587 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:22.588 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:24.250 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:24.250 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:24.889 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:06:25.178 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_request_missing_policy_specified_field ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:25.178 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:28.452 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:28.452 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:28.922 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:06:29.230 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_condition_is_case_sensitive ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:29.230 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:31.730 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:31.730 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:32.352 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:06:32.806 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_expires_is_case_sensitive ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:32.806 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:35.489 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:35.489 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:36.157 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:06:36.889 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_expired_policy ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:36.889 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:39.872 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:39.873 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:40.685 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:06:41.228 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_request_field_value ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:41.228 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:43.449 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:43.449 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:43.708 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:06:44.372 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_expires_condition ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:44.372 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:47.293 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:47.293 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:47.742 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:06:48.040 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_conditions_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:48.040 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:50.947 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:50.948 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:51.834 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:06:52.431 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_limit_exceeded ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:52.431 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:55.768 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:55.769 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:56.183 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:06:56.651 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_content_length_argument ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:56.651 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:06:59.369 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:06:59.370 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:00.008 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:07:00.286 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_content_length_argument ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:00.287 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:02.905 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:02.906 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:03.539 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:07:03.759 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_below_minimum ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:03.759 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:07.416 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:07.416 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:07.854 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:07:08.179 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_empty_conditions ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:08.179 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:11.525 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:11.525 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:11.792 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:07:12.158 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:12.158 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:15.519 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:15.520 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:17.889 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:07:18.453 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:18.453 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:20.466 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:20.466 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:23.051 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:07:28.961 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:28.961 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:28.961 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:28.961 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:28.961 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:07:28.962 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:28.962 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:30.569 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:30.569 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:32.148 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:07:32.365 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:32.366 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:35.660 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:35.660 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:36.995 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:07:37.428 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:37.428 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:40.031 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:40.031 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:43.230 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:43.230 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:43.541 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:07:43.779 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:43.779 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:46.713 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:46.714 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:49.133 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:07:49.625 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:49.626 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:50.467 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:28:48.492 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:07:50.470 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:28:48.496 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:07:50.479 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:28:48.505 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:07:50.523 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:28:48.549 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:07:50.554 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:28:48.524 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:07:50.557 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:28:48.526 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:07:50.724 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:28:48.750 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:07:50.753 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:28:48.779 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:07:50.772 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:28:48.741 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:07:52.015 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:52.015 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:53.955 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:07:54.206 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:54.206 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:07:57.009 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:07:57.009 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:02.849 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:08:03.138 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:03.139 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:06.300 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:06.300 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:08.747 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:08:09.476 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_overwrite_existed_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:09.476 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:12.596 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:12.596 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:17.549 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:08:18.108 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_nonexisted_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:18.108 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:21.003 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:21.003 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:22.403 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:08:22.611 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:22.611 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:25.057 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:25.057 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:29.348 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:08:29.630 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:29.630 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:32.162 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:32.162 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:36.203 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:08:36.720 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_nonexisted_good ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:36.721 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:39.292 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:39.292 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:40.631 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:08:41.577 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_overwrite_existed_failed ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:41.578 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:45.060 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:45.061 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:48.798 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:08:49.525 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:49.729 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:54.792 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:54.793 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:55.255 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:08:55.579 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:55.579 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:08:58.690 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:08:58.690 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:04.576 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:30:02.602 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:09:04.587 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:30:02.613 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:09:04.627 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:30:02.653 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:09:04.630 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:30:02.655 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:09:04.654 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:30:02.624 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:09:04.662 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:30:02.630 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:09:04.666 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:30:02.692 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:09:04.677 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:30:02.702 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:09:04.715 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:30:02.684 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:09:05.978 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:05.979 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:06.258 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:09:06.508 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_delete_key_bucket_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:06.508 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:10.850 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:10.850 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:15.976 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:15.976 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:16.592 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:09:17.239 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:17.239 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:22.264 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:22.264 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:24.419 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:24.419 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:25.332 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:09:25.824 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_head ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:25.824 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:28.449 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:28.449 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:28.736 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:09:29.709 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_head_extended ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:29.709 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:32.402 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:32.402 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:33.519 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:33.519 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:42.745 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:09:43.005 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:43.005 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:45.625 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:45.626 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:46.772 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:09:47.039 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:47.039 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:51.642 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:51.643 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:52.602 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:09:52.909 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:52.909 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:56.963 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:56.964 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:09:57.229 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:09:57.581 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_raw_response_headers ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:09:57.581 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:01.363 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:01.363 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:01.706 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:10:01.944 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:01.944 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:05.970 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:05.970 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:06.729 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:10:07.046 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:07.046 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:11.793 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:11.793 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:12.044 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:10:12.507 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:12.508 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:16.467 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:16.467 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:21.556 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:10:21.817 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_gone ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:21.817 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:26.217 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:26.217 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:27.793 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:10:28.610 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_not_expired ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:28.611 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:32.192 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:32.192 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:32.580 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:10:33.221 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_range_zero ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:33.221 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:37.024 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:37.025 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:37.089 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:10:37.526 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_max_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:37.526 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:41.182 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:41.182 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:41.293 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:10:41.553 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_positive_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:41.750 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:44.770 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:44.770 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:44.881 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:10:45.225 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:45.225 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:47.588 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:47.588 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:48.512 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:48.846 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:49.109 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:10:49.481 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put_write_access ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:49.482 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:52.264 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:52.264 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:53.961 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:53.961 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:56.039 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:10:56.399 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_put_authenticated ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:56.400 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:10:59.889 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:10:59.889 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:01.385 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:01.683 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_raw_put_authenticated_expired ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:01.683 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:04.306 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:04.307 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:06.978 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:06.978 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:07.114 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:07.679 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_one ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:07.679 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:08.402 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:08.696 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_two ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:08.696 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:09.187 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:09.915 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_ip ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:09.915 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:10.564 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:11.275 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_dns_underscore ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:11.275 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:12.059 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:12.307 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:12.307 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:17.632 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:17.927 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_get_location ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:17.928 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:19.486 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:19.738 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists_nonowner ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:19.738 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:21.995 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:21.995 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:23.441 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:23.739 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_default ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:23.739 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:26.550 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:26.551 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:26.721 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:26.982 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_during_create ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:26.982 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:28.501 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:28.980 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:28.980 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:32.185 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:32.631 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:32.631 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:35.447 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:35.724 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_authenticatedread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:35.724 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:38.095 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:38.324 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_acl_default ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:38.324 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:40.864 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:40.865 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:42.489 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:42.710 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_during_create ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:42.711 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:46.024 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:46.024 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:47.079 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:47.356 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:47.357 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:50.046 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:50.047 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:51.840 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:52.082 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:52.082 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:54.946 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:54.946 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:56.785 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:11:57.101 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_authenticatedread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:57.101 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:11:59.831 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:11:59.831 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:01.481 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:12:02.000 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:02.000 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:04.798 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:04.798 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:08.275 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:12:08.560 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerfullcontrol ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:08.560 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:11.353 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:11.354 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:14.823 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:12:15.316 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_owner ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:15.317 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:20.012 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:20.012 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:22.706 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:12:23.020 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_attributes ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:23.020 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:25.731 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:25.731 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:26.895 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:26.895 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:27.942 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:12:28.252 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_private_to_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:28.252 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:30.394 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:30.395 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:31.520 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:12:31.796 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:31.796 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:34.462 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:34.462 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:37.415 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:12:37.695 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_acl_write ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:37.695 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:39.826 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:39.827 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:43.454 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:12:43.807 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_acl_writeacp ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:43.807 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:47.025 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:47.025 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:51.102 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:12:51.793 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_acl_read ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:51.793 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:53.798 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:53.798 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:56.284 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:12:56.543 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_acl_readacp ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:56.544 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:12:58.862 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:12:58.862 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:02.660 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:13:03.120 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_fullcontrol ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:03.121 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:06.318 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:06.319 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:07.377 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:07.377 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:09.654 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:09.655 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:10.188 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:10.188 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:10.659 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:10.659 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:12.003 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:12.004 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:13.430 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:13.430 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:13.766 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:13:14.024 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_read ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:14.024 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:16.735 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:16.735 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:17.414 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:17.414 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:19.203 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:19.203 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:20.503 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:20.503 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:21.222 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:21.222 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:22.014 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:22.014 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:22.164 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:13:22.511 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_readacp ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:22.511 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:25.601 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:25.602 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:26.108 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:26.109 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:27.652 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:27.652 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:28.189 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:28.190 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:28.579 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:28.580 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:29.236 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:29.236 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:29.859 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:13:30.167 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_write ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:30.208 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:32.326 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:32.326 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:33.138 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:33.138 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:34.911 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:34.911 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:35.432 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:35.432 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:35.854 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:35.854 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:37.352 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:37.352 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:37.520 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:13:38.049 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_writeacp ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:38.049 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:40.698 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:40.699 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:41.789 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:41.789 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:43.797 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:43.797 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:44.273 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:44.273 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:44.863 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:44.863 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:45.475 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:45.475 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:47.421 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:13:47.745 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_nonexist_user ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:47.745 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:49.882 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:49.882 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:50.519 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:50.519 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:51.128 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:13:51.691 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_no_grants ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:51.692 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:54.274 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:54.275 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:57.949 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:57.949 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:13:58.430 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:13:58.430 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:00.414 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:14:00.631 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_header_acl_grants ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:00.632 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:02.950 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:02.950 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:04.729 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:14:05.534 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_header_acl_grants ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:05.534 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:08.435 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:08.435 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:11.671 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:14:12.056 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:12.057 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:14.802 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:14.802 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:15.228 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:15.228 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:16.710 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:14:17.010 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email_notexist ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:17.010 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:19.159 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:19.160 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:19.563 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:19.563 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:19.952 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:14:20.433 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_revoke_all ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:20.433 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:23.398 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:23.400 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:27.566 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:14:27.883 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:27.884 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:31.123 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:34.875 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:34.876 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:36.462 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:36.462 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:37.287 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:37.287 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:37.643 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:14:37.845 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:37.957 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:40.787 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:40.788 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:47.774 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:47.774 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:49.376 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:49.377 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:50.127 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:50.127 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:50.241 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:14:50.702 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:50.702 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:14:54.742 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:14:54.742 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:00.130 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:00.131 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:01.348 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:01.348 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:02.408 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:02.408 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:02.783 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:15:03.274 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:03.274 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:05.702 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:05.702 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:11.633 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:11.633 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:12.448 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:12.448 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:13.873 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:13.873 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:14.376 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:15:14.726 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:14.726 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:18.111 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:18.112 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:22.894 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:22.894 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:23.983 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:23.984 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:25.021 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:25.021 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:25.578 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:15:25.933 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:25.934 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:28.161 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:28.162 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:35.058 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:35.058 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:36.186 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:36.186 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:37.165 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:37.165 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:37.648 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:15:37.965 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:37.965 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:41.426 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:41.426 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:46.930 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:46.930 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:48.340 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:48.340 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:49.969 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:49.969 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:50.844 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:15:51.259 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:51.260 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:15:55.119 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:15:55.119 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:02.396 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:02.404 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:04.153 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:04.153 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:06.008 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:06.008 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:06.896 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:16:07.241 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:07.241 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:10.076 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:10.076 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:14.663 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:14.663 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:16.033 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:16.033 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:17.462 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:17.462 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:18.371 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:16:18.614 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_private ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:18.614 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:21.689 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:21.689 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:26.347 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:26.348 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:32.870 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:16:33.231 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicread ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:33.231 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:36.210 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:41.154 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:41.162 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:48.987 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:16:49.292 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicreadwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:49.292 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:53.071 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:53.071 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:16:57.437 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:16:57.437 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:17:05.106 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:17:05.706 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_buckets_create_then_list ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:17:05.706 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:17:18.659 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:17:18.665 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:17:20.544 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:17:21.147 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_anonymous ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:17:21.147 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:17:22.294 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:17:22.632 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_invalid_auth ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:17:22.632 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:17:23.210 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:17:23.859 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_bad_auth ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:17:23.859 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:17:24.062 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:17:24.444 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_alpha ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:17:24.444 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:17:26.288 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:17:26.289 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:17:26.363 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:38:24.388 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:17:26.371 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:38:24.398 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:17:26.382 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:38:24.408 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:17:26.415 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:38:24.440 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:17:26.458 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:38:24.421 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:17:26.462 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:38:24.427 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:17:26.611 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:38:24.637 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:17:26.621 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:38:24.647 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:17:26.687 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:38:24.656 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:17:27.928 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:17:27.929 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:17:35.904 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:17:36.232 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_digit ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:17:36.232 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:17:37.592 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:17:37.592 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:17:40.380 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:17:40.380 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:17:48.333 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:17:48.755 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_period ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:17:48.756 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:17:51.125 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:17:51.427 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_hyphen ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:17:51.427 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:17:53.803 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:17:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_recreate_not_overriding ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:17:54.418 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:18:01.126 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:18:01.126 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:18:01.688 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:18:01.688 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:18:05.314 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:18:05.314 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:18:06.514 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:18:07.291 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_special_key_names ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:18:07.292 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:18:14.129 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:39:12.155 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:18:14.139 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:39:12.165 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:18:14.146 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:39:12.172 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:18:14.152 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:39:12.178 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:18:14.161 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:39:12.130 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:18:14.169 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:39:12.138 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:18:14.205 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:39:12.231 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:18:14.217 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:39:12.243 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:18:14.247 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:39:12.216 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:18:23.784 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:18:23.785 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:18:24.957 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:18:24.958 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:18:46.787 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:18:47.284 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_special_prefix ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:18:47.284 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:18:59.154 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:18:59.155 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:19:00.248 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:19:00.248 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:19:00.721 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:19:01.144 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_copy_zero_size ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:19:01.144 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:19:04.731 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:19:04.732 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:19:09.206 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:19:09.579 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_copy_same_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:19:09.579 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:19:12.615 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:19:12.616 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:19:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:19:19.302 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_copy_verify_contenttype ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:19:19.303 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:19:22.577 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:19:22.578 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:19:29.711 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:19:30.198 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:19:30.198 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:19:33.928 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:19:33.929 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:19:36.113 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:19:36.340 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself_with_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:19:36.341 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:19:39.162 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:19:39.163 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:19:43.470 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:19:43.775 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_copy_diff_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:19:43.776 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:19:46.630 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:19:46.630 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:19:49.739 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:19:49.740 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:19:53.593 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:19:54.275 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:19:54.275 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:19:57.362 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:19:57.377 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:01.947 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:20:02.447 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_object_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:02.448 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:06.200 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:06.200 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:08.035 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:08.035 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:09.948 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:09.949 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:11.124 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:11.124 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:13.881 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:20:14.243 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_copy_canned_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:14.243 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:17.170 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:17.170 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:19.127 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:19.127 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:21.897 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:21.897 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:22.489 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:20:22.863 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_copy_retaining_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:22.863 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:25.217 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:25.250 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:29.094 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:29.094 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:32.664 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:32.665 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:39.479 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:20:39.756 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_copy_replacing_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:39.757 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:42.077 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:42.078 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:46.147 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:46.147 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:50.535 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:50.536 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:55.564 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:20:55.855 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_copy_bucket_not_found ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:55.856 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:55.866 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:20:55.614+0000 13a86c700 -1 handle_data failed with exit code -32 2019-12-09T13:20:58.515 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:58.515 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:20:58.887 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:20:59.145 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_copy_key_not_found ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:20:59.145 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:21:01.393 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:21:01.393 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:21:02.098 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:21:02.485 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:21:02.485 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:21:06.406 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:21:06.406 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:21:08.542 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:21:08.542 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:21:13.358 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:21:13.359 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:21:22.618 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:21:22.619 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:21:24.625 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:21:24.625 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:21:30.852 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:21:30.853 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:21:39.962 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:21:40.321 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_url_encoding ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:21:40.321 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:21:42.910 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:21:42.910 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:21:52.259 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:21:52.536 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioning_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:21:52.537 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:21:55.385 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:21:55.386 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:21:56.657 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:21:56.658 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:22:57.830 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:22:57.839 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:23:05.375 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:23:05.375 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:23:27.424 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:44:25.448 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:23:27.431 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:44:25.458 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:23:27.441 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:44:25.466 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:23:27.444 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:44:25.470 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:23:27.449 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:44:25.418 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:23:27.454 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:44:25.423 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:23:27.650 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:44:25.619 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:23:27.666 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:44:25.692 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:23:27.674 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:44:25.700 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:24:29.987 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:24:30.119 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:24:33.625 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:24:33.625 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:25:18.118 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:25:18.131 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:25:48.670 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:46:46.696 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:25:48.693 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:46:46.719 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:25:48.707 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:46:46.733 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:25:48.718 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:46:46.744 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:25:48.741 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:46:46.710 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:25:48.747 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:46:46.716 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:25:48.777 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:46:46.803 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:25:48.793 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:46:46.819 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:25:48.849 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:46:46.818 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:26:37.831 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:26:38.360 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_empty ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:26:38.360 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:26:42.093 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:26:42.093 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:26:45.076 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:26:45.076 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:26:45.256 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:26:45.695 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_small ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:26:45.695 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:26:48.569 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:26:48.569 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:26:53.209 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:26:53.209 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:26:58.514 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:26:58.808 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_small ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:26:58.809 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:27:03.318 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:27:03.318 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:27:16.269 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:27:16.270 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:27:18.705 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:27:18.706 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:27:22.559 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:27:22.560 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:27:27.396 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:27:27.396 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:27:28.558 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:27:28.559 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:27:29.385 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:27:29.363+0000 118027700 -1 handle_data failed with exit code -104 2019-12-09T13:27:30.270 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:27:30.628 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_invalid_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:27:30.629 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:27:34.149 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:27:34.149 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:27:35.787 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:27:35.787 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:27:37.612 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:27:38.040 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_without_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:27:38.041 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:27:41.392 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:27:41.392 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:27:44.424 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:27:44.424 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:27:47.619 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:27:47.619 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:27:57.299 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:27:57.315 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:27:57.836 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:27:57.836 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:27:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:28:00.042 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_special_names ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:28:00.042 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:28:03.995 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:28:03.995 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:28:06.574 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:28:06.575 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:28:19.404 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:28:19.404 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:28:24.779 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:28:24.780 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:28:28.790 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:28:29.025 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:28:30.579 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:28:30.579 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:28:31.625 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:28:31.552+0000 f47e0700 -1 handle_data failed with exit code -104 2019-12-09T13:28:32.705 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:28:32.705 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:28:38.618 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:49:36.644 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:38.623 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:49:36.649 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:38.634 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:49:36.660 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:38.635 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:49:36.604 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:38.639 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:49:36.665 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:38.643 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:49:36.611 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:38.738 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:49:36.764 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:38.764 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:49:36.790 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:38.795 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:49:36.764 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:28:44.165 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:28:44.165 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:28:49.439 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:28:49.439 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:28:56.568 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:28:56.568 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:28:57.431 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:28:57.432 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:28:58.308 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:28:58.189+0000 12283c700 -1 handle_data failed with exit code -104 2019-12-09T13:28:58.908 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:28:58.908 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:29:14.650 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:29:14.651 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:29:18.147 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:29:18.147 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:29:24.351 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:29:24.352 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:29:26.032 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:29:26.033 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:29:28.412 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:29:28.412 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:29:41.910 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:29:41.911 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:29:46.484 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:29:46.485 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:29:52.607 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:29:52.607 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:29:54.083 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:29:54.084 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:29:54.714 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:29:54.693+0000 4d27c700 -1 handle_data failed with exit code -104 2019-12-09T13:29:56.604 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:29:56.919 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:29:56.919 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:30:00.013 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:30:00.013 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:31:05.859 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:31:05.861 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:31:37.710 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:31:37.711 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:31:38.555 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:31:38.556 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:31:39.778 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:31:39.737+0000 120037700 -1 handle_data failed with exit code -104 2019-12-09T13:32:39.869 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:32:39.882 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:32:40.701 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:32:40.701 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:32:41.585 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:32:41.534+0000 cdf93700 -1 handle_data failed with exit code -104 2019-12-09T13:33:14.438 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:33:14.753 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_versioned ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:33:14.753 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:33:18.520 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:33:18.521 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:33:22.487 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:33:22.487 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:33:22.944 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:33:22.945 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:33:24.747 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:33:24.747 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:33:50.343 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:54:48.369 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:33:50.358 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:54:48.384 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:33:50.376 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:54:48.402 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:33:50.378 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:54:48.347 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:33:50.382 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:54:48.408 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:33:50.388 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:54:48.357 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:33:50.569 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:54:48.592 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:33:50.572 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:54:48.598 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:33:50.634 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:54:48.602 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:33:51.612 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:33:51.612 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:34:10.444 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:55:08.470 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:34:10.459 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:55:08.485 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:34:10.467 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:55:08.493 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:34:10.472 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:55:08.497 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:34:10.493 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:55:08.461 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:34:10.496 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:55:08.522 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:34:10.497 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:55:08.465 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:34:10.527 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:55:08.494 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:34:10.551 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:55:08.577 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:34:16.755 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:16.756 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:34:46.831 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:46.832 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:34:47.878 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:34:47.878 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:35:11.283 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:11.284 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:35:12.070 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:12.070 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:35:13.857 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:35:13.786+0000 97726700 -1 handle_data failed with exit code -104 2019-12-09T13:35:45.261 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:35:45.286 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:36:07.369 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:07.370 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:36:13.398 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:13.399 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:36:14.677 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:14.678 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:36:48.666 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:36:48.693 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:37:10.042 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:10.057 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:37:14.631 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:37:14.563+0000 a8f49700 -1 handle_data failed with exit code -104 2019-12-09T13:37:16.790 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:16.790 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:37:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:18.676 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:37:56.594 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:37:56.905 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_resend_part ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:56.905 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:37:59.326 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:37:59.326 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:39:00.908 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:59:58.934 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:39:00.934 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:59:58.943 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:39:00.934 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:59:58.950 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:39:00.934 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:59:58.955 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:39:00.949 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:59:58.918 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:39:00.968 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:59:58.937 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:39:01.105 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:03:59:59.131 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:39:01.108 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:03:59:59.134 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:39:01.170 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:03:59:59.139 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:39:20.244 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:20.245 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:39:58.414 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:58.417 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:39:59.624 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:39:59.624 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:40:00.923 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:40:00.882+0000 4b278700 -1 handle_data failed with exit code -104 2019-12-09T13:41:12.990 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:41:13.000 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:41:14.246 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:41:14.247 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:41:15.193 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:41:15.168+0000 5a6ac700 -1 handle_data failed with exit code -104 2019-12-09T13:41:48.144 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:41:48.144 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:42:32.250 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:03:30.276 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:32.292 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:03:30.318 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:32.295 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:03:30.263 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:32.297 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:03:30.266 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:32.315 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:03:30.341 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:32.321 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:03:30.347 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:32.387 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:03:30.355 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:32.390 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:03:30.416 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:32.419 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:03:30.445 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:42:52.946 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:42:52.946 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:43:33.677 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:43:33.679 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:43:35.136 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:43:35.136 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:43:36.072 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:43:35.993+0000 a1f3b700 -1 handle_data failed with exit code -104 2019-12-09T13:44:11.070 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:05:09.096 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:44:11.072 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:05:09.099 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:44:11.109 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:05:09.077 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:44:11.118 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:05:09.086 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:44:11.128 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:05:09.154 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:44:11.132 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:05:09.158 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:44:11.162 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:05:09.187 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:44:11.212 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:05:09.180 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:44:11.222 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:05:09.247 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:44:50.399 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:44:50.399 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:44:51.377 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:44:51.377 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:44:52.477 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:44:52.469+0000 726dc700 -1 handle_data failed with exit code -104 2019-12-09T13:45:25.885 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:45:25.885 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:46:42.054 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:46:42.054 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:47:21.367 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:47:21.367 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:47:22.760 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:47:22.760 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:47:23.970 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:47:23.912+0000 71edb700 -1 handle_data failed with exit code -104 2019-12-09T13:48:37.571 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:48:37.584 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:48:38.998 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:48:38.999 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:48:39.763 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:48:39.725+0000 53288700 -1 handle_data failed with exit code -104 2019-12-09T13:49:13.350 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:49:13.351 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:49:23.747 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:10:21.774 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:49:23.759 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:10:21.785 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:49:23.765 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:10:21.791 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:49:23.771 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:10:21.797 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:49:23.776 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:10:21.744 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:49:23.782 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:10:21.749 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:49:23.953 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:10:21.979 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:49:23.956 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:10:21.982 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:49:24.003 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:10:21.970 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:50:47.360 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:50:47.361 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:50:54.015 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:11:52.041 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:50:54.028 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:11:52.054 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:50:54.086 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:11:52.053 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:50:54.088 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:11:52.055 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:50:54.119 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:11:52.145 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:50:54.133 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:11:52.160 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:50:54.139 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:11:52.165 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:50:54.153 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:11:52.121 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:50:54.189 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:11:52.215 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:51:25.478 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:51:25.478 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:51:27.331 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:51:27.331 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:51:28.138 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:51:28.059+0000 9171a700 -1 handle_data failed with exit code -104 2019-12-09T13:52:31.534 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:52:31.534 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:52:32.754 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:52:32.754 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:52:33.723 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:52:33.644+0000 d7fa7700 -1 handle_data failed with exit code -104 2019-12-09T13:53:09.099 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:53:09.099 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:54:35.916 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:15:33.942 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:35.927 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:15:33.948 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:35.932 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:15:33.958 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:35.937 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:15:33.963 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:35.946 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:15:33.913 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:35.956 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:15:33.923 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:36.075 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:15:34.101 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:36.077 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:15:34.103 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:54:36.175 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:15:34.142 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:55:23.736 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:55:23.757 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:56:02.039 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:56:02.040 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:56:03.177 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:56:03.178 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:56:03.831 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:56:03.727+0000 b8f69700 -1 handle_data failed with exit code -104 2019-12-09T13:57:12.974 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:57:12.974 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:57:14.017 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:57:14.017 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:57:14.761 INFO:tasks.rgw.client.0.smithi121.stdout:2019-12-09T13:57:14.735+0000 117025700 -1 handle_data failed with exit code -104 2019-12-09T13:57:50.572 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T13:57:51.059 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_multiple_sizes ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:57:51.060 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:57:53.927 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:57:53.927 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:58:07.611 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:58:07.611 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:58:11.965 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:58:11.966 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:58:31.473 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:58:31.474 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:58:49.814 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:58:49.814 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:59:15.735 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:20:13.762 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:15.787 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:20:13.813 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:15.803 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:20:13.829 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:15.811 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:20:13.838 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:15.821 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:20:13.788 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:15.829 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:20:13.796 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:15.936 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:20:13.962 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:15.957 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:20:13.983 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:15.997 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:20:13.963 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:20.322 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:59:20.322 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T13:59:48.500 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:20:46.527 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:48.512 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:20:46.538 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:48.524 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:20:46.550 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:48.530 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:20:46.556 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:48.547 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:20:46.514 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:48.556 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:20:46.523 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:48.573 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:20:46.599 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:48.589 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:20:46.615 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:48.631 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:20:46.598 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T13:59:49.776 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T13:59:49.776 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:00:16.523 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:00:17.993 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_multiple_sizes ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:17.993 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:00:22.861 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:22.862 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:00:47.483 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:47.483 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:00:49.762 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:49.762 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:00:57.382 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:00:57.382 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:01:00.921 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:00.922 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:01:03.958 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:03.958 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:01:16.987 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:16.987 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:01:28.945 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:28.945 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:01:30.659 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:30.659 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:01:44.672 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:44.672 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:01:59.347 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:01:59.347 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:02:00.492 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:00.492 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:02:15.245 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:15.245 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:02:37.026 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:37.027 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:02:38.525 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:02:38.525 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:03:02.415 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:03:02.416 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:03:23.875 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:03:23.876 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:03:25.385 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:03:25.386 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:03:54.354 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:03:54.354 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:04:09.513 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:04:09.514 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:04:11.530 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:04:11.530 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:04:37.299 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:04:37.995 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_size_too_small ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:04:37.996 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:04:40.884 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:04:40.884 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:05:00.061 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:25:58.088 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:00.069 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:25:58.095 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:00.080 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:25:58.047 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:00.082 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:25:58.108 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:00.084 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:25:58.051 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:00.086 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:25:58.113 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:00.275 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:25:58.301 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:00.345 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:25:58.372 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:00.365 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:25:58.332 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:06.899 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:05:06.899 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:05:07.868 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:05:08.741 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_contents ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:05:08.741 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:05:11.843 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:05:11.843 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:05:22.078 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:26:20.105 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:22.123 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:26:20.150 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:22.124 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:26:20.150 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:22.144 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:26:20.110 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:22.145 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:26:20.171 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:22.158 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:26:20.184 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:22.179 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:26:20.206 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:22.194 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:26:20.160 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:05:22.240 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:26:20.207 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:06:11.463 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:06:11.763 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_overwrite_existing_object ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:11.763 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:06:14.953 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:06:14.953 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:07:08.593 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:07:08.786 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:08.786 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:07:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:12.178 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:07:36.617 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:36.617 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:07:37.619 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:28:35.646 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:37.670 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:28:35.697 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:37.671 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:28:35.638 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:37.678 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:28:35.704 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:37.679 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:28:35.706 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:37.694 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:28:35.660 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:37.748 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:28:35.775 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:37.764 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:28:35.731 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:37.765 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:28:35.791 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:07:38.017 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:07:38.452 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload_not_found ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:38.452 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:07:40.886 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:40.886 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:07:42.423 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:07:42.801 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_list_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:42.801 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:07:45.624 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:45.624 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:07:57.477 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:07:57.478 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:08:13.411 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:13.412 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:08:27.345 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:27.345 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:08:34.088 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:08:34.485 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_missing_part ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:34.486 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:08:37.961 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:37.961 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:08:43.149 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:08:43.564 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_incorrect_etag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:43.564 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:08:46.679 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:46.679 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:08:51.944 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:08:52.392 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_100_continue ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:52.392 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:08:57.660 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:08:57.982 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_set_cors ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:08:57.982 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:00.562 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:00.562 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:04.599 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:09:04.856 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_response ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:04.856 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:07.601 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:07.601 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:12.546 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:12.547 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:13.564 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:13.564 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:14.969 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:14.969 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:16.318 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:16.319 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:17.273 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:17.275 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:18.501 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:18.502 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:20.150 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:20.150 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:21.250 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:21.250 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:22.786 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:22.787 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:24.046 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:24.047 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:26.179 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:26.179 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:27.589 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:27.590 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:28.406 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:28.407 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:28.869 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:28.869 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:29.251 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:29.252 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:29.810 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:29.810 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:30.394 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:30.394 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:31.057 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:31.057 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:32.581 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:32.582 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:33.193 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:33.193 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:34.847 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:34.847 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:36.375 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:36.376 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:37.528 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:37.528 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:38.549 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:38.549 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:39.782 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:39.783 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:40.368 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:40.368 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:41.540 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:41.540 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:42.182 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:42.182 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:43.078 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:43.078 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:43.799 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:43.799 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:44.292 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:44.293 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:44.916 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:44.917 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:45.745 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:45.745 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:46.018 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:09:46.336 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_wildcard ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:46.336 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:50.171 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:50.171 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:55.194 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:55.194 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:57.513 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:57.513 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:09:58.854 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:09:59.207 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_cors_header_option ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:09:59.207 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:10:03.057 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:03.057 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:10:07.903 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:07.903 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:10:08.082 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:10:08.406 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_1mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:08.406 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:10:10.173 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:31:08.200 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:10.185 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:31:08.212 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:10.189 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:31:08.216 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:10.192 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:31:08.218 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:10.203 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:31:08.169 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:10.210 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:31:08.176 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:10.285 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:31:08.312 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:10.315 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:31:08.341 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:10.371 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:31:08.337 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:10:10.594 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:10.594 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:10:14.918 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:14.919 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:10:19.741 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:19.741 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:10:22.349 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:10:22.734 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_4mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:22.734 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:10:26.082 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:26.082 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:10:33.523 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:33.523 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:10:44.585 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:44.586 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:10:50.188 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:10:50.453 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_8mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:50.453 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:10:52.648 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:10:52.649 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:11:08.012 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:08.012 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:11:22.129 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:22.129 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:11:30.491 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:11:30.985 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_1mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:30.985 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:11:34.345 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:34.345 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:11:37.244 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:37.244 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:11:40.086 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:40.087 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:11:42.965 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:42.965 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:11:46.491 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:46.491 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:11:49.387 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:11:49.681 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_4mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:49.681 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:11:52.063 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:52.063 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:11:58.108 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:11:58.108 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:12:04.552 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:04.553 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:12:11.897 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:11.898 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:12:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:18.652 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:12:22.951 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:12:23.533 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_8mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:23.534 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:12:25.850 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:25.850 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:12:38.655 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:38.655 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:12:47.471 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:12:47.471 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:13:08.590 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:08.590 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:13:22.519 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:22.519 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:13:31.554 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:13:32.480 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_1mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:32.480 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:13:35.825 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:35.825 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:13:40.614 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:40.614 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:13:45.692 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:45.693 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:13:47.936 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:13:48.222 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_4mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:48.222 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:13:50.968 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:13:50.969 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:14:05.910 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:05.910 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:14:16.686 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:16.686 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:14:21.975 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:14:22.702 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_8mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:22.703 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:14:25.623 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:25.624 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:14:48.965 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:14:48.966 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:15:06.902 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:06.903 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:15:17.101 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:15:17.870 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_atomic_conditional_write_1mb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:17.870 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:15:20.365 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:20.365 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:15:24.059 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:24.059 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:15:24.204 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:36:22.231 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:24.213 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:36:22.240 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:24.226 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:36:22.252 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:24.229 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:36:22.256 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:24.232 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:36:22.198 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:24.254 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:36:22.220 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:24.425 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:36:22.452 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:24.430 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:36:22.456 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:24.535 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:36:22.501 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:26.538 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:26.538 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:15:30.913 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:30.914 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:15:33.601 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:15:33.834 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_atomic_multipart_upload_write ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:33.834 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:15:36.619 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:36.620 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:15:42.920 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:15:43.295 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_multipart_resend_first_finishes_last ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:43.295 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:15:46.720 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:46.720 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:15:56.845 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:15:56.845 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:15:59.282 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:36:57.309 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:59.335 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:36:57.362 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:59.353 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:36:57.379 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:59.373 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:36:57.339 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:59.382 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:36:57.348 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:59.390 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:36:57.417 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:59.397 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:36:57.424 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:59.437 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:36:57.403 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:15:59.439 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:36:57.465 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:16:05.517 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:05.518 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:16:07.252 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:16:07.877 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_response_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:07.878 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:16:11.119 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:11.119 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:16:13.710 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:16:14.511 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_ranged_big_request_response_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:14.512 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:16:17.818 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:17.818 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:16:38.679 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:16:38.918 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_skip_leading_bytes_response_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:38.919 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:16:41.981 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:41.982 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:16:43.476 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:16:43.934 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_return_trailing_bytes_response_code ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:43.934 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:16:47.583 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:47.584 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:16:49.456 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:16:49.994 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_invalid_range ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:49.994 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:16:54.619 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:54.620 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:16:56.227 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:16:56.717 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_empty_object ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:56.717 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:16:59.880 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:16:59.880 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:17:02.018 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:17:02.549 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_create_suspend ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:02.549 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:17:05.855 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:05.855 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:17:06.628 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:06.628 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:17:07.832 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:07.833 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:17:09.046 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:09.046 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:17:11.431 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:11.431 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:17:12.415 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:17:12.703 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:12.704 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:17:15.096 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:17:15.096 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:20:35.263 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:41:33.290 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:20:35.270 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:41:33.296 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:20:35.286 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:41:33.252 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:20:35.287 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:41:33.314 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:20:35.292 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:41:33.319 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:20:35.294 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:41:33.260 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:20:35.502 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:41:33.529 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:20:35.503 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:41:33.529 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:20:35.513 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:41:33.480 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:22:39.544 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:22:39.911 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove_head ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:39.911 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:22:42.864 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:22:42.865 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:23:43.206 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:23:43.461 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_removal ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:43.461 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:23:46.845 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:46.845 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:23:47.226 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:47.226 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:23:49.789 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:49.789 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:23:56.990 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:23:57.286 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:57.287 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:23:59.789 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:23:59.790 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:24:00.191 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:00.191 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:24:01.792 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:01.792 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:24:20.935 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:45:18.961 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:24:20.972 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:45:18.999 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:24:21.024 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:24:21.033 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:45:18.999 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:24:21.033 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:45:19.060 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:24:21.035 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:45:19.062 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:24:21.045 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:45:19.010 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:24:21.090 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:45:19.116 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:24:21.174 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:45:19.200 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:24:21.223 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:45:19.188 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:24:21.303 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite_suspended ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:21.304 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:24:24.742 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:24.742 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:24:25.143 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:25.143 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:24:26.715 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:26.715 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:24:28.257 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:28.257 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:24:40.490 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:24:40.700 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_suspend_versions ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:40.700 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:24:42.902 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:42.903 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:24:45.181 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:24:45.181 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:25:07.299 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:07.299 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:25:31.762 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:25:31.775 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:25:47.406 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:46:45.433 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:25:47.413 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:46:45.440 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:25:47.428 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:46:45.455 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:25:47.433 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:46:45.459 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:25:47.436 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:46:45.402 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:25:47.442 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:46:45.408 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:25:47.497 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:46:45.523 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:25:47.499 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:46:45.526 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:25:47.543 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:46:45.508 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:26:49.653 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:26:49.874 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_all ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:26:49.874 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:26:53.124 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:26:53.125 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:26:55.723 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:26:55.723 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:28:49.215 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:28:49.626 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_special_names ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:28:49.626 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:28:52.596 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:28:52.597 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:28:54.830 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:28:54.831 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:30:59.438 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:51:57.464 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:30:59.440 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:51:57.467 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:30:59.456 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:51:57.483 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:30:59.458 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:51:57.484 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:30:59.460 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:51:57.426 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:30:59.470 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:51:57.436 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:30:59.631 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:51:57.658 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:30:59.649 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:51:57.675 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:30:59.726 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:51:57.692 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:32:42.579 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:53:40.606 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:32:42.581 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:53:40.608 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:32:42.615 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:53:40.581 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:32:42.624 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:53:40.590 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:32:42.656 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:53:40.683 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:32:42.677 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:53:40.703 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:32:42.688 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:53:40.655 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:32:42.697 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:53:40.724 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:32:42.773 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:53:40.799 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:36:09.603 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:57:07.630 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:36:09.615 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:57:07.642 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:36:09.620 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:57:07.647 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:36:09.625 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:57:07.592 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:36:09.630 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:57:07.657 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:36:09.632 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:57:07.599 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:36:09.764 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:04:57:07.791 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:36:09.770 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:04:57:07.794 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:36:09.816 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:04:57:07.782 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:37:11.522 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:37:11.788 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_overwrite_multipart ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:37:11.789 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:37:14.234 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:37:14.234 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:37:15.775 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:37:15.775 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:38:23.797 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:38:23.798 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:39:31.448 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:39:31.448 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:40:37.680 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:40:37.680 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:41:04.379 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:02:02.405 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:04.425 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:02:02.451 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:04.432 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:02:02.458 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:04.448 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:02:02.474 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:04.456 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:02:02.421 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:04.460 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:02:02.426 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:04.552 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:02:02.578 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:04.605 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:02:02.631 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:04.634 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:02:02.599 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:19.459 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:02:17.486 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:19.470 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:02:17.496 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:19.472 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:02:17.499 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:19.475 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:02:17.502 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:19.483 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:02:17.449 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:19.490 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:02:17.456 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:19.500 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:02:17.526 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:19.509 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:02:17.535 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:41:19.539 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:02:17.504 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:43:41.772 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:43:42.225 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_list_marker ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:43:42.225 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:43:46.153 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:43:46.153 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:43:47.849 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:43:47.850 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:44:37.546 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:44:37.848 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_copy_obj_version ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:44:37.848 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:44:41.152 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:44:41.152 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:44:42.529 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:44:42.530 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:45:15.549 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:45:15.549 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:45:28.536 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:45:29.088 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:45:29.089 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:45:31.491 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:45:31.492 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:45:33.596 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:45:33.597 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:45:54.749 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:45:55.095 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:45:55.095 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:45:57.856 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:45:57.856 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:45:59.822 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:45:59.823 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:46:20.690 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:07:18.717 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:20.695 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:07:18.722 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:20.750 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:07:18.777 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:20.753 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:07:18.780 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:20.786 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:07:18.752 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:20.790 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:07:18.757 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:20.914 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:07:18.941 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:20.942 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:07:18.969 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:21.042 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:07:19.008 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:27.240 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:46:27.584 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker_create ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:46:27.584 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:46:30.034 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:07:28.061 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:30.038 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:07:28.065 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:30.047 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:07:28.074 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:30.052 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:07:28.079 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:30.053 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:07:28.019 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:30.063 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:07:28.030 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:30.071 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:07:28.098 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:30.079 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:07:28.106 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:30.109 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:07:28.075 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:46:30.576 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:46:30.576 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:46:32.485 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:46:32.486 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:46:34.465 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:46:34.728 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:46:34.728 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:46:38.109 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:46:38.110 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:46:41.643 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:46:41.643 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:47:03.021 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:47:03.487 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl_no_version_specified ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:47:03.487 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:47:06.083 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:47:06.083 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:47:07.465 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:47:07.465 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:47:21.876 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:47:21.876 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:47:25.081 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:47:25.464 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_concurrent_remove ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:47:25.464 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:47:28.721 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:47:28.721 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:47:30.119 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:47:30.119 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:47:30.573 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:47:30.573 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:47:30.865 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:47:30.865 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:47:31.152 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:47:31.153 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:47:31.433 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:47:31.433 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:47:34.078 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-52: 2019-12-09T14:47:34.078 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:47:34.079 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:47:34.079 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:47:34.079 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:47:34.079 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:47:34.079 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:47:34.079 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:47:34.079 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:47:34.080 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:47:34.080 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:47:34.080 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:47:34.080 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:47:34.080 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:47:34.544 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-54: 2019-12-09T14:47:34.544 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:47:34.544 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:47:34.544 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:47:34.544 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:47:34.545 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:47:34.545 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:47:34.545 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:47:34.545 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:47:34.545 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:47:34.545 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:47:34.545 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:47:34.546 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:47:34.546 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:47:34.596 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-55: 2019-12-09T14:47:34.596 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:47:34.596 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:47:34.597 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:47:34.597 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:47:34.597 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:47:34.597 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:47:34.597 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:47:34.598 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:47:34.598 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:47:34.598 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:47:34.598 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:47:34.598 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:47:34.599 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:47:35.988 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-51: 2019-12-09T14:47:35.988 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:47:35.988 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:47:35.989 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:47:35.989 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:47:35.989 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:47:35.989 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:47:35.989 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:47:35.989 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:47:35.990 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:47:35.990 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:47:35.990 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:47:35.990 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:47:35.990 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:47:50.745 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-65: 2019-12-09T14:47:50.745 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:47:50.745 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:47:50.745 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:47:50.746 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:47:50.746 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:47:50.746 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:47:50.746 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:47:50.746 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:47:50.747 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:47:50.747 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:47:50.747 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:47:50.747 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:47:50.748 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:47:50.754 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-61: 2019-12-09T14:47:50.754 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:47:50.755 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:47:50.755 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:47:50.755 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:47:50.755 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:47:50.755 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:47:50.756 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:47:50.756 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:47:50.756 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:47:50.756 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:47:50.756 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:47:50.756 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:47:50.757 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:47:50.760 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-62: 2019-12-09T14:47:50.761 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:47:50.761 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:47:50.761 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:47:50.761 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:47:50.762 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:47:50.762 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:47:50.762 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:47:50.762 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:47:50.763 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:47:50.763 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:47:50.763 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:47:50.763 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:47:50.764 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:47:50.818 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-63: 2019-12-09T14:47:50.818 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:47:50.818 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:47:50.818 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:47:50.818 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:47:50.818 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:47:50.819 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:47:50.819 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:47:50.819 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:47:50.819 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:47:50.819 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:47:50.819 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:47:50.820 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:47:50.820 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:02.185 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-75: 2019-12-09T14:48:02.185 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:02.185 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:02.185 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:02.185 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:02.186 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:02.186 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:02.186 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:02.186 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:02.186 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:02.186 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:02.187 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:02.187 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:02.187 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:02.542 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-74: 2019-12-09T14:48:02.543 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:02.543 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:02.543 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:02.543 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:02.543 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:02.543 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:02.543 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:02.544 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:02.544 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:02.544 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:02.544 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:02.544 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:02.545 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:02.578 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-72: 2019-12-09T14:48:02.578 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:02.578 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:02.578 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:02.579 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:02.579 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:02.579 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:02.579 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:02.579 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:02.579 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:02.579 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:02.580 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:02.580 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:02.580 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:02.774 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-73: 2019-12-09T14:48:02.775 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:02.775 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:02.775 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:02.775 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:02.776 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:02.776 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:02.776 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:02.776 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:02.776 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:02.776 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:02.776 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:02.777 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:02.777 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:16.322 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-84: 2019-12-09T14:48:16.323 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:16.323 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:16.323 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:16.323 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:16.323 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:16.324 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:16.324 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:16.324 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:16.324 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:16.324 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:16.324 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:16.324 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:16.325 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:16.528 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-82: 2019-12-09T14:48:16.528 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:16.528 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:16.528 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:16.528 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:16.529 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:16.529 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:16.529 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:16.529 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:16.529 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:16.529 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:16.529 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:16.530 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:16.530 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:16.530 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-83: 2019-12-09T14:48:16.530 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:16.530 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:16.530 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:16.530 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:16.531 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:16.531 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:16.531 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:16.531 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:16.531 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:16.531 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:16.531 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:16.532 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:16.532 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:16.724 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-85: 2019-12-09T14:48:16.724 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:16.724 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:16.725 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:16.725 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:16.725 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:16.725 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:16.725 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:16.725 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:16.726 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:16.726 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:16.726 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:16.726 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:16.726 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:30.258 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-91: 2019-12-09T14:48:30.258 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:30.259 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:30.259 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:30.259 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:30.259 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:30.259 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:30.259 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:30.259 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:30.260 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:30.260 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:30.260 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:30.260 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:30.260 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:30.666 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-92: 2019-12-09T14:48:30.667 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:30.667 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:30.667 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:30.667 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:30.667 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:30.667 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:30.667 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:30.668 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:30.668 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:30.668 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:30.668 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:30.668 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:30.668 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:31.283 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-93: 2019-12-09T14:48:31.283 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:31.283 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:31.284 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:31.284 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:31.284 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:31.284 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:31.284 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:31.284 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:31.285 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:31.285 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:31.285 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:31.285 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:31.285 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:31.305 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-95: 2019-12-09T14:48:31.306 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:31.306 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:31.306 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:31.306 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:31.306 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:31.306 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:31.307 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:31.307 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:31.307 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:31.307 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:31.307 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:31.307 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:31.307 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:42.834 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:48:43.450 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_and_remove ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:48:43.450 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:48:46.518 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:48:46.518 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:48:48.317 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:48:48.317 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:48:48.507 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:48:48.507 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:48:48.752 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:48:48.752 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:48:49.101 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:48:49.101 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:48:50.757 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:48:50.758 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:48:50.766 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:48:50.766 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:48:51.010 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:48:51.010 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:48:52.027 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:48:52.027 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:48:52.479 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:48:52.480 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:48:52.703 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:48:52.703 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:48:54.346 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-102: 2019-12-09T14:48:54.346 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:54.346 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:54.346 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:54.346 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:54.347 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:54.347 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:54.347 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:54.347 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:54.347 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:54.347 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:54.347 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:54.348 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:54.348 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:54.517 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-103: 2019-12-09T14:48:54.518 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:54.518 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:54.518 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:54.519 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:54.519 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:54.519 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:54.519 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:54.519 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:54.520 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:54.520 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:54.520 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:54.520 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:54.521 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:54.991 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-104: 2019-12-09T14:48:54.992 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:54.992 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:54.992 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:54.992 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:54.992 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:54.992 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:54.993 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:54.993 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:54.993 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:54.993 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:54.993 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:54.993 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:54.993 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:55.019 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-106: 2019-12-09T14:48:55.020 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:55.020 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:55.020 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:55.020 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:55.020 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:55.020 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:55.021 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:55.021 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:55.021 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:55.021 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:55.021 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:55.021 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:55.021 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:48:55.138 INFO:teuthology.orchestra.run.smithi121.stderr:Exception in thread Thread-105: 2019-12-09T14:48:55.138 INFO:teuthology.orchestra.run.smithi121.stderr:Traceback (most recent call last): 2019-12-09T14:48:55.138 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-09T14:48:55.138 INFO:teuthology.orchestra.run.smithi121.stderr: self.run() 2019-12-09T14:48:55.139 INFO:teuthology.orchestra.run.smithi121.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-09T14:48:55.139 INFO:teuthology.orchestra.run.smithi121.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-09T14:48:55.139 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-09T14:48:55.139 INFO:teuthology.orchestra.run.smithi121.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-09T14:48:55.139 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-09T14:48:55.139 INFO:teuthology.orchestra.run.smithi121.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-09T14:48:55.139 INFO:teuthology.orchestra.run.smithi121.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-09T14:48:55.140 INFO:teuthology.orchestra.run.smithi121.stderr: raise error_class(parsed_response, operation_name) 2019-12-09T14:48:55.140 INFO:teuthology.orchestra.run.smithi121.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-09T14:48:55.140 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T14:49:10.250 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:49:11.143 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:11.143 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:13.530 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:13.530 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:15.852 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:49:16.087 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:16.087 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:19.609 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:19.610 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:23.819 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:49:24.084 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get_no_id ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:24.084 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:26.502 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:10:24.529 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:26.551 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:10:24.577 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:26.555 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:10:24.582 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:26.577 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:10:24.604 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:26.597 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:10:24.563 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:26.603 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:10:24.569 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:26.636 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:10:24.663 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:26.675 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:10:24.702 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:26.725 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:10:24.691 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:49:26.868 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:26.868 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:28.683 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:49:29.151 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_id_too_long ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:29.151 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:31.766 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:31.766 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:32.317 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:49:32.807 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_same_id ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:32.807 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:35.259 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:35.260 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:35.729 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:49:36.241 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_invalid_status ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:36.241 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:39.746 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:39.746 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:41.422 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:49:41.663 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_date ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:41.664 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:44.699 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:44.699 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:46.037 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:49:46.640 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_invalid_date ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:46.641 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:49.656 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:49.656 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:49.933 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:49:50.680 INFO:teuthology.orchestra.run.smithi121.stderr:Check for valid x-amz-expiration header after PUT ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:50.680 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:53.121 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:53.121 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:49:56.782 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:49:57.037 INFO:teuthology.orchestra.run.smithi121.stderr:Check for valid x-amz-expiration header on HEAD request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:49:57.037 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:00.134 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:00.135 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:03.550 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:03.550 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:03.937 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:50:04.187 INFO:teuthology.orchestra.run.smithi121.stderr:Check for valid x-amz-expiration header on GET request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:04.187 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:07.357 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:07.357 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:12.052 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:12.052 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:12.668 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:50:12.908 INFO:teuthology.orchestra.run.smithi121.stderr:Check x-amz-expiration-header object tags interaction ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:12.908 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:15.939 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:15.939 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:25.533 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:50:26.023 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_noncurrent ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:26.024 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:31.202 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:31.202 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:33.026 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:50:33.369 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_deletemarker ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:33.370 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:36.840 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:36.840 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:38.868 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:50:39.087 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_filter ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:39.088 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:43.102 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:43.102 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:45.175 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:50:45.869 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_empty_filter ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:45.869 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:48.377 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:48.377 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:49.816 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:50:50.064 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_multipart ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:50.064 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:53.183 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:53.184 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:55.562 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:50:55.923 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1b ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:55.923 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:50:59.669 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:50:59.669 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:01.319 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:51:01.706 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1kb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:01.706 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:05.075 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:05.076 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:06.210 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:51:06.535 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1MB ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:06.536 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:09.466 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:09.466 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:13.564 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:51:14.070 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_13b ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:14.070 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:17.216 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:17.216 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:19.000 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:51:19.231 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_method_head ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:19.231 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:21.470 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:21.470 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:24.211 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:51:24.501 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_present ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:24.501 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:27.038 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:27.038 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:28.372 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:51:28.636 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_other_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:28.636 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:31.597 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:31.597 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:33.175 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:51:33.419 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_invalid_md5 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:33.419 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:36.714 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:36.714 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:37.106 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:51:37.402 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_md5 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:37.402 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:39.592 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:39.593 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:39.997 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:51:40.156 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:12:38.183 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:51:40.164 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:12:38.191 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:51:40.176 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:12:38.203 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:51:40.177 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:12:38.142 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:51:40.180 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:12:38.207 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:51:40.205 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:12:38.171 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:51:40.252 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:12:38.279 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:51:40.319 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:40.319 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:40.330 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:12:38.357 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:51:40.402 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:12:38.368 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:51:42.780 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:42.780 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:42.941 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:51:43.215 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_encryption_key_no_sse_c ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:43.216 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:45.787 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:45.788 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:46.124 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:51:46.436 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:46.436 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:51:48.412 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:51:48.412 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:53:31.338 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:53:31.339 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:54:46.088 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:54:46.089 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:55:23.483 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:55:24.036 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_bad_download ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:55:24.036 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:55:26.549 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:55:26.549 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:56:44.492 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:56:44.492 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:56:45.328 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:56:45.601 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_post_object_authenticated_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:56:45.602 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:56:48.671 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:56:48.671 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:56:50.601 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:56:50.601 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:56:51.220 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:56:51.612 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_method_head ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:56:51.612 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:56:52.436 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:17:50.463 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:56:52.445 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:17:50.472 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:56:52.451 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:17:50.478 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:56:52.455 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:17:50.482 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:56:52.474 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:17:50.440 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:56:52.487 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:17:50.453 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:56:52.636 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:17:50.663 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:56:52.690 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:17:50.717 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:56:52.712 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:17:50.678 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:56:54.060 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:56:54.060 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:56:57.163 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:56:57.497 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_present ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:56:57.497 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:57:00.499 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:57:00.499 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:57:02.360 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:57:02.595 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_no_key ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:57:02.595 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:57:05.101 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:57:05.102 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:57:05.302 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:57:05.603 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_not_declared ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:57:05.603 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:57:08.958 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:57:08.958 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:57:09.478 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T14:57:09.812 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_upload ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:57:09.812 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:57:12.731 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:57:12.731 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:57:48.426 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:18:46.453 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:57:48.458 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:18:46.485 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:57:48.469 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:18:46.496 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:57:48.487 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:18:46.513 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:57:48.498 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:18:46.464 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:57:48.504 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:18:46.530 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T14:57:48.508 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:18:46.475 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:57:48.523 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:18:46.550 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T14:57:48.577 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:18:46.543 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T14:59:11.135 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:59:11.135 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T14:59:14.235 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T14:59:14.235 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:00:27.006 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:00:27.006 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:00:29.604 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:00:29.604 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:01:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:01:12.531 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_1 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:01:12.532 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:01:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:01:14.597 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:02:03.647 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:23:01.674 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:02:03.655 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:23:01.682 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:02:03.664 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:23:01.691 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:02:03.665 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:23:01.631 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:02:03.668 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:23:01.694 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:02:03.672 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:23:01.638 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:02:03.852 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:23:01.818 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:02:03.897 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:23:01.923 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:02:03.913 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:23:01.940 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:02:13.507 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:02:13.778 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_2 ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:02:13.778 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:02:16.442 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:02:16.443 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:03:21.291 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:03:21.585 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_post_object_authenticated_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:21.585 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:03:24.812 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:24.813 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:03:26.773 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:26.773 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:03:27.516 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:03:27.861 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1b ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:27.861 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:03:31.195 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:31.195 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:03:33.524 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:03:33.779 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1kb ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:33.779 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:03:36.777 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:36.777 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:03:38.086 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:03:38.413 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1MB ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:38.413 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:03:41.058 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:41.058 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:03:45.409 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:03:45.776 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_13b ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:45.776 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:03:48.733 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:48.733 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:03:50.287 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:03:50.537 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_read_declare ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:50.537 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:03:52.992 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:52.992 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:03:55.137 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:03:55.479 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:55.480 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:03:59.306 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:03:59.306 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:02.758 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:02.758 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:05.955 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:04:06.187 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:06.187 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:09.840 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:09.840 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:11.939 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:11.940 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:12.573 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:04:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:12.832 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:16.724 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:16.724 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:21.163 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:21.164 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:23.699 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:04:24.092 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:24.092 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:26.569 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:26.570 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:29.946 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:29.946 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:32.477 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:04:32.746 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_another_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:32.746 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:35.366 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:35.366 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:37.987 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:37.987 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:43.246 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:43.247 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:44.739 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:44.739 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:45.428 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:04:45.702 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_another_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:45.702 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:48.936 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:48.936 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:52.491 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:52.492 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:58.230 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:58.230 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:58.801 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:58.801 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:04:59.434 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:04:59.880 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_get_obj_tagging ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:04:59.881 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:05:02.908 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:05:02.908 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:05:16.364 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:05:16.364 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:05:17.734 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:05:18.221 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_get_obj_head_tagging ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:05:18.222 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:05:22.596 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:05:22.596 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:05:35.346 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:05:35.346 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:05:36.996 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:05:37.286 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_max_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:05:37.286 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:05:40.103 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:05:40.103 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:05:55.334 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:05:55.334 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:05:57.062 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:05:57.538 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_excess_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:05:57.538 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:06:00.346 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:06:00.347 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:06:10.084 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:27:08.111 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:06:10.100 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:27:08.127 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:06:10.126 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:27:08.152 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:06:10.151 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:27:08.177 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:06:10.178 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:27:08.143 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:06:10.184 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:27:08.150 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:06:10.253 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:27:08.280 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:06:10.259 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:27:08.286 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:06:10.336 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:27:08.302 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:06:11.953 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:06:11.953 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:06:12.909 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:06:13.435 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_max_kvsize_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:06:13.435 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:06:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:06:16.800 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:06:28.188 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:06:28.188 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:06:29.804 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:06:30.353 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_excess_key_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:06:30.353 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:06:33.616 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:06:33.616 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:06:47.061 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:06:47.062 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:06:47.949 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:06:48.215 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_excess_val_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:06:48.216 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:06:50.262 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:06:50.263 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:07:04.688 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:07:04.689 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:07:05.388 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:07:05.609 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_modify_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:07:05.610 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:07:08.380 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:07:08.380 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:07:14.835 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:28:12.862 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:07:14.844 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:28:12.871 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:07:14.858 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:28:12.885 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:07:14.859 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:28:12.825 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:07:14.862 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:28:12.889 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:07:14.863 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:28:12.829 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:07:14.901 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:28:12.928 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:07:14.937 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:28:12.964 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:07:14.956 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:28:12.922 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:07:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:07:18.289 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:07:21.412 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:07:21.659 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_delete_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:07:21.660 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:07:24.376 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:07:24.376 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:07:41.087 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:07:41.087 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:07:46.367 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:07:46.831 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_anonymous_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:07:46.831 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:07:49.047 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:07:49.048 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:07:53.375 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:07:53.619 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_authenticated_request ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:07:53.619 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:07:56.795 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:07:56.795 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:07:57.949 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:07:57.949 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:07:58.890 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:07:59.132 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_obj_with_tags ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:07:59.133 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:08:02.507 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:08:02.507 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:08:04.630 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:08:04.927 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_get_tags_acl_public ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:08:04.928 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:08:07.893 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:08:07.893 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:08:20.870 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:08:20.871 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:08:24.614 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:08:24.614 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:08:25.233 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:08:25.516 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_put_tags_acl_public ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:08:25.516 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:08:27.461 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:08:27.462 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:08:42.916 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:08:42.916 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:08:45.166 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:08:45.166 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:08:47.442 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:08:48.003 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_delete_tags_obj_public ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:08:48.003 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:08:51.297 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:08:51.297 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:09:05.982 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:05.982 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:09:08.405 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:08.405 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:09:10.856 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:09:11.131 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_atomic_upload_return_version_id ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:11.131 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:09:13.670 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:13.670 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:09:21.253 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:21.253 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:09:26.338 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:26.338 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:09:29.551 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:29.551 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:09:31.081 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:09:31.489 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_multipart_upload_return_version_id ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:31.489 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:09:34.758 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:34.758 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:09:36.724 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:09:36.724 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:10:52.956 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:10:52.967 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:11:49.485 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:49.485 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:11:52.966 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:11:52.966 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:12:27.390 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:33:25.417 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:12:27.405 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:33:25.426 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:12:27.406 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:33:25.433 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:12:27.411 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:33:25.376 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:12:27.411 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:33:25.438 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:12:27.418 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:33:25.384 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:12:27.607 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:33:25.634 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:12:27.611 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:33:25.638 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:12:27.617 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:33:25.583 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:12:55.038 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:12:55.251 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_existing_tag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:12:55.252 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:13:02.980 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:02.980 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:13:07.745 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:07.746 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:13:08.618 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:08.618 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:13:09.672 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:13:09.945 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_tagging_existing_tag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:09.946 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:13:17.606 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:17.606 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:13:23.278 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:23.279 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:13:26.196 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:13:26.547 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_tagging_existing_tag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:26.547 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:13:33.408 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:33.409 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:13:38.060 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:38.060 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:13:41.414 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:13:41.824 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:41.824 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:13:48.654 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:48.654 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:13:49.877 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:49.878 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:13:55.715 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:13:55.716 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:01.598 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:14:01.822 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source_meta ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:01.823 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:07.338 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:07.338 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:09.137 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:09.137 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:13.585 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:13.586 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:16.650 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:14:16.918 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_acl ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:16.919 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:18.632 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:18.632 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:20.901 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:20.901 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:22.424 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:14:22.934 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_grant ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:22.934 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:25.991 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:25.991 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:29.456 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:29.456 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:32.556 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:32.556 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:35.468 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:14:35.820 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_acl_existing_tag ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:35.820 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:42.780 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:42.781 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:49.126 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:49.127 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:50.914 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:14:51.319 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:51.319 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:56.909 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:14:57.161 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:14:57.161 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:14:59.969 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:15:00.648 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_with_days_and_years ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:00.648 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:15:04.045 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:15:04.371 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_days ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:04.372 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:15:06.209 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:15:06.405 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_years ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:06.405 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:15:09.560 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:15:09.825 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_status ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:09.825 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:15:14.092 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:15:14.328 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_suspend_versioning ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:14.328 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:15:17.253 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:15:17.551 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:17.551 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:15:21.155 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:15:21.380 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:21.380 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:15:23.893 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:15:24.615 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:24.615 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:15:38.109 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:15:38.388 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:38.389 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:15:43.974 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:15:44.317 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_mode ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:44.317 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:15:53.091 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:15:53.328 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:15:53.329 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:16:06.108 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:16:06.433 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:16:06.433 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:16:09.858 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:16:10.054 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_versionid ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:16:10.055 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:16:24.874 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:16:25.142 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_override_default_retention ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:16:25.143 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:16:38.322 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:16:38.628 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_increase_period ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:16:38.628 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:16:55.156 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:16:55.452 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:16:55.452 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:17:07.825 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:17:08.066 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period_bypass ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:08.066 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:17:25.877 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:17:26.247 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_retention ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:26.248 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:17:37.400 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:17:37.731 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:37.731 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:17:38.646 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:38:36.673 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:38.655 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:38:36.682 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:38.676 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:38:36.703 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:38.681 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:38:36.708 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:38.682 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:38:36.648 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:38.691 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:38:36.657 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:38.819 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:38:36.846 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:38.848 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:38:36.875 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:38.951 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:38:36.917 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:17:45.970 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:17:46.215 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:46.215 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:17:52.074 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:17:52.315 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_status ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:52.315 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:17:59.201 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:17:59.523 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:17:59.523 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:18:09.617 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:18:09.884 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold_invalid_bucket ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:09.885 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:18:13.528 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:18:13.965 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_on ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:13.965 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:18:21.318 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:18:21.647 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_off ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:21.647 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:18:33.844 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:18:34.141 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_metadata ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:34.142 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:18:54.649 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:18:54.959 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_s3.test_object_lock_uploading_obj ... /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:18:54.959 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:19:08.952 INFO:teuthology.orchestra.run.smithi121.stderr:ok 2019-12-09T15:19:08.980 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.functional.test_utils.test_generate ... ok 2019-12-09T15:19:09.276 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T15:19:09.276 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T15:22:51.757 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:43:49.783 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:51.770 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:43:49.796 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:51.782 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:43:49.748 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:51.788 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:43:49.755 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:51.796 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:43:49.818 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:51.797 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:43:49.824 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:51.973 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:43:49.997 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:52.006 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:43:49.972 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:52.017 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:43:50.043 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:53.581 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:43:51.608 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:53.617 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:43:51.644 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:53.631 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:43:51.657 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:53.634 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:43:51.600 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:53.638 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:43:51.604 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:53.654 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:43:51.620 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:53.688 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:43:51.714 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:53.689 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:43:51.716 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:22:53.724 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:43:51.750 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:27:19.568 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:48:17.595 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:27:19.621 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:48:17.648 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:27:19.628 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:48:17.652 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:27:19.632 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:48:17.658 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:27:19.643 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:48:17.608 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:27:19.660 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:48:17.626 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:27:19.778 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:48:17.805 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:27:19.814 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:48:17.780 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:27:19.899 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:48:17.926 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:28:01.866 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:48:59.893 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:28:01.876 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:48:59.900 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:28:01.877 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:48:59.904 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:28:01.884 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:48:59.910 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:28:01.900 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:48:59.866 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:28:01.910 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:48:59.876 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:28:01.920 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:48:59.947 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:28:01.957 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:48:59.982 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:28:02.056 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:49:00.022 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:31:15.453 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:52:13.480 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:31:15.491 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:52:13.518 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:31:15.503 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:52:13.469 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:31:15.512 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:52:13.539 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:31:15.517 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:52:13.544 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:31:15.530 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:52:13.496 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:31:15.628 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:52:13.654 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:31:15.646 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:52:13.673 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:31:15.649 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:52:13.615 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:33:12.495 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:54:10.522 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:33:12.503 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:54:10.530 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:33:12.513 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:54:10.540 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:33:12.517 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:54:10.544 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:33:12.532 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:54:10.498 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:33:12.543 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:54:10.509 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:33:12.606 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:54:10.633 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:33:12.607 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:54:10.634 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:33:12.670 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:54:10.636 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:38:26.535 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:59:24.562 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:38:26.548 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:59:24.575 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:38:26.566 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:59:24.592 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:38:26.571 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:59:24.537 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:38:26.573 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:59:24.600 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:38:26.585 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:59:24.551 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:38:26.734 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:05:59:24.761 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:38:26.828 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:05:59:24.793 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:38:26.835 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:05:59:24.862 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:39:37.330 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:00:35.357 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:39:37.361 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:00:35.388 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:39:37.374 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:00:35.401 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:39:37.375 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:00:35.402 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:39:37.411 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:00:35.377 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:39:37.421 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:00:35.387 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:39:37.440 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:00:35.467 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:39:37.441 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:00:35.467 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:39:37.491 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:00:35.457 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:43:36.778 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:04:34.805 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:43:36.790 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:04:34.816 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:43:36.798 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:04:34.824 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:43:36.803 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:04:34.829 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:43:36.811 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:04:34.777 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:43:36.817 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:04:34.783 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:43:37.000 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:04:34.966 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:43:37.021 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:04:35.048 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:43:37.048 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:04:35.074 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:47:59.159 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:08:57.186 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:47:59.181 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:08:57.206 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:47:59.253 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:08:57.275 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:47:59.253 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:08:57.277 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:47:59.268 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:08:57.233 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:47:59.270 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:08:57.236 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:47:59.302 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:08:57.329 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:47:59.406 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:08:57.433 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:47:59.433 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:08:57.399 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:48:47.989 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:09:46.016 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:48:47.999 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:09:46.026 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:48:48.008 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:09:46.035 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:48:48.011 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:09:46.038 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:48:48.017 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:09:45.983 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:48:48.022 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:09:45.988 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:48:48.067 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:09:46.093 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:48:48.069 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:09:46.096 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:48:48.140 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:09:46.106 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:54:00.464 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:14:58.491 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:54:00.478 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:14:58.504 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:54:00.492 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:14:58.518 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:54:00.497 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:14:58.463 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:54:00.498 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:14:58.524 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:54:00.512 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:14:58.475 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:54:00.670 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:14:58.696 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:54:00.702 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:14:58.729 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:54:00.807 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:14:58.773 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:20.849 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:17:18.876 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:20.871 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:17:18.898 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:20.928 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:17:18.954 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:20.930 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:17:18.957 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:20.931 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:17:18.897 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:20.939 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:17:18.905 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:20.994 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:17:19.016 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:21.039 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:17:19.066 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:56:21.053 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:17:19.015 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:11.562 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:20:09.588 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:11.571 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:20:09.593 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:11.572 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:20:09.598 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:11.575 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:20:09.602 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:11.585 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:20:09.551 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:11.587 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:20:09.553 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:11.673 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:20:09.700 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:11.688 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:20:09.715 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T15:59:11.702 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:20:09.667 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:23.695 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:25:21.722 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:23.707 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:25:21.727 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:23.709 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:25:21.736 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:23.714 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:25:21.741 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:23.716 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:25:21.682 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:23.723 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:25:21.689 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:23.890 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:25:21.917 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:23.914 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:25:21.940 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:23.955 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:25:21.921 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:42.457 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:25:40.477 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:42.475 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:25:40.502 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:42.500 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:25:40.526 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:42.503 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:25:40.530 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:42.508 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:25:40.474 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:42.515 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:25:40.481 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:42.528 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:25:40.555 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:42.542 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:25:40.508 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:04:42.557 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:25:40.584 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:38.552 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:29:36.579 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:38.591 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:29:36.617 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:38.665 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:29:36.631 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:38.669 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:29:36.634 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:38.733 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:29:36.759 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:38.751 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:29:36.778 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:38.773 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:29:36.800 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:38.857 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:29:36.822 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:08:38.970 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:29:36.997 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:09:38.733 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:30:36.760 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:09:38.740 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:30:36.767 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:09:38.761 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:30:36.727 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:09:38.769 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:30:36.796 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:09:38.770 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:30:36.736 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:09:38.774 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:30:36.801 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:09:38.793 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:30:36.820 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:09:38.862 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:30:36.828 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:09:38.865 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:30:36.891 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:13:04.890 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:34:02.917 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:13:04.893 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:34:02.920 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:13:05.033 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:34:03.060 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:13:05.104 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:34:03.131 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:13:05.105 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:34:03.071 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:13:05.107 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:34:03.073 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:13:05.111 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:34:03.138 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:13:05.235 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:34:03.261 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:13:05.256 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:34:03.222 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:14:50.059 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:35:48.086 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:14:50.066 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:35:48.093 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:14:50.073 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:35:48.100 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:14:50.076 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:35:48.103 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:14:50.078 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:35:48.043 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:14:50.084 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:35:48.050 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:14:50.150 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:35:48.177 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:14:50.154 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:35:48.181 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:14:50.214 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:35:48.180 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:20:04.325 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:41:02.352 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:20:04.339 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:41:02.358 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:20:04.339 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:41:02.365 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:20:04.344 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:41:02.371 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:20:04.345 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:41:02.310 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:20:04.353 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:41:02.319 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:20:04.507 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:41:02.534 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:20:04.514 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:41:02.541 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:20:04.568 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:41:02.533 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:21:26.763 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:42:24.790 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:21:26.769 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:42:24.796 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:21:26.829 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:42:24.855 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:21:26.831 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:42:24.858 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:21:26.833 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:42:24.798 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:21:26.835 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:42:24.801 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:21:26.869 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:42:24.896 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:21:26.920 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:42:24.947 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:21:26.937 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:42:24.903 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:25:16.493 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:46:14.520 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:25:16.499 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:46:14.526 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:25:16.508 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:46:14.534 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:25:16.511 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:46:14.538 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:25:16.523 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:46:14.489 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:25:16.552 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:46:14.517 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:25:16.634 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:46:14.661 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:25:16.640 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:46:14.667 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:25:16.783 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:46:14.748 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:29:48.662 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:50:46.689 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:29:48.952 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:50:46.710 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:29:48.952 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:50:46.721 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:29:48.953 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:50:46.722 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:29:48.953 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:50:46.911 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:29:48.953 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:50:46.747 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:29:48.953 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:50:46.751 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:29:48.953 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:50:46.930 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:29:48.956 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:50:46.922 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:30:27.998 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:51:26.024 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:30:28.006 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:51:26.033 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:30:28.007 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:51:26.034 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:30:28.015 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:51:26.042 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:30:28.017 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:51:25.983 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:30:28.042 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:51:26.007 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:30:28.056 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:51:26.083 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:30:28.061 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:51:26.087 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:30:28.126 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:51:26.091 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:35:39.908 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:56:37.935 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:35:39.918 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:56:37.945 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:35:39.936 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:56:37.901 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:35:39.936 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:56:37.964 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:35:39.945 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:56:37.910 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:35:39.945 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:56:37.972 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:35:40.118 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:56:38.145 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:35:40.167 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:56:38.133 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:35:40.190 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:56:38.217 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:10.413 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:59:08.440 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:10.414 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:59:08.442 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:10.418 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:59:08.445 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:10.427 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:59:08.454 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:10.432 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:59:08.397 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:10.434 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:59:08.399 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:10.505 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:06:59:08.532 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:10.533 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:06:59:08.499 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:38:10.536 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:06:59:08.563 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:40:51.070 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:01:49.097 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:40:51.076 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:01:49.103 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:40:51.085 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:01:49.112 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:40:51.088 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:01:49.115 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:40:51.095 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:01:49.060 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:40:51.102 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:01:49.067 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:40:51.195 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:01:49.222 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:40:51.196 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:01:49.223 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:40:51.256 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:01:49.219 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:45:59.500 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:06:57.527 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:45:59.515 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:06:57.533 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:45:59.517 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:06:57.544 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:45:59.520 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:06:57.547 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:45:59.534 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:06:57.500 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:45:59.543 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:06:57.509 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:45:59.706 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:06:57.733 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:45:59.712 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:06:57.739 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:45:59.823 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:06:57.789 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:46:32.030 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:07:30.057 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:46:32.068 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:07:30.095 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:46:32.090 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:07:30.117 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:46:32.098 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:07:30.126 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:46:32.113 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:07:30.140 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:46:32.126 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:07:30.091 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:46:32.128 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:07:30.094 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:46:32.152 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:07:30.179 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:46:32.181 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:07:30.137 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:49:53.088 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:10:51.115 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:49:53.107 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:10:51.134 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:49:53.159 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:10:51.186 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:49:53.162 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:10:51.190 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:49:53.220 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:10:51.186 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:49:53.225 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:10:51.191 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:49:53.260 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:10:51.288 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:49:53.334 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:10:51.362 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:49:53.365 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:10:51.330 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:09.688 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:12:07.715 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:09.695 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:12:07.723 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:09.705 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:12:07.733 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:09.708 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:12:07.674 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:09.712 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:12:07.739 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:09.714 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:12:07.680 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:09.776 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:12:07.803 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:09.777 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:12:07.805 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:51:09.805 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:12:07.770 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:54:54.066 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:15:52.093 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:54:54.120 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:15:52.147 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:54:54.141 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:15:52.167 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:54:54.157 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:15:52.122 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:54:54.165 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:15:52.130 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:54:54.192 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:15:52.220 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:54:54.221 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:15:52.248 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:54:54.274 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:15:52.239 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:54:54.293 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:15:52.320 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:56:23.895 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:17:21.922 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:56:23.913 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:17:21.933 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:56:23.915 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:17:21.881 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:56:23.920 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:17:21.947 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:56:23.922 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:17:21.887 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T16:56:23.923 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:17:21.950 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:56:23.974 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:17:22.001 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T16:56:23.997 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:17:22.024 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T16:56:24.017 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:17:21.982 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:01:35.542 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:22:33.570 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:01:35.556 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:22:33.583 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:01:35.570 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:22:33.535 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:01:35.574 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:22:33.602 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:01:35.579 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:22:33.545 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:01:35.582 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:22:33.608 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:01:35.773 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:22:33.800 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:01:35.816 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:22:33.843 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:01:35.918 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:22:33.884 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:03:15.803 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:24:13.831 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:03:15.823 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:24:13.850 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:03:15.870 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:24:13.835 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:03:15.873 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:24:13.839 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:03:15.905 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:24:13.932 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:03:15.953 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:24:13.980 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:03:15.963 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:24:13.990 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:03:15.984 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:24:13.949 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:03:16.019 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:24:14.046 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:46.318 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:27:44.345 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:46.327 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:27:44.353 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:46.334 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:27:44.362 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:46.338 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:27:44.366 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:46.354 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:27:44.319 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:46.361 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:27:44.326 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:46.459 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:27:44.486 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:46.514 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:27:44.541 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:06:46.520 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:27:44.485 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:07:39.952 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T17:07:39.952 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T17:07:51.272 INFO:teuthology.orchestra.run.smithi121.stderr:/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/urllib3/connection.py:418: SubjectAltNameWarning: Certificate for smithi121.front.sepia.ceph.com has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/urllib3/urllib3/issues/497 for details.) 2019-12-09T17:07:51.272 INFO:teuthology.orchestra.run.smithi121.stderr: SubjectAltNameWarning, 2019-12-09T17:07:53.750 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-12-09T17:07:53.757 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-12-09T17:07:53.758 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-12-09T17:07:53.758 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-12-09T17:07:53.758 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-12-09T17:07:53.758 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-12-09T17:07:53.759 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-12-09T17:07:54.122 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-12-09T17:07:54.377 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-12-09T17:07:54.952 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-12-09T17:07:54.975 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-12-09T17:07:54.994 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-12-09T17:07:54.995 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-12-09T17:07:54.995 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-12-09T17:07:54.995 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-12-09T17:07:54.995 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-12-09T17:07:54.995 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-12-09T17:07:54.995 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-12-09T17:07:54.996 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-12-09T17:07:54.997 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-12-09T17:07:54.997 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-12-09T17:07:54.997 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-12-09T17:07:55.000 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-12-09T17:07:55.000 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-12-09T17:07:55.000 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-12-09T17:07:55.000 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_child ... ok 2019-12-09T17:07:55.005 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-12-09T17:07:55.005 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-12-09T17:07:55.005 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-12-09T17:07:55.006 INFO:teuthology.orchestra.run.smithi121.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-12-09T17:07:55.025 INFO:teuthology.orchestra.run.smithi121.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-12-09T17:07:55.047 INFO:teuthology.orchestra.run.smithi121.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-12-09T17:07:55.047 INFO:teuthology.orchestra.run.smithi121.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-12-09T17:07:55.187 INFO:teuthology.orchestra.run.smithi121.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-12-09T17:07:55.187 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T17:07:55.187 INFO:teuthology.orchestra.run.smithi121.stderr:---------------------------------------------------------------------- 2019-12-09T17:07:55.187 INFO:teuthology.orchestra.run.smithi121.stderr:Ran 611 tests in 17505.137s 2019-12-09T17:07:55.188 INFO:teuthology.orchestra.run.smithi121.stderr: 2019-12-09T17:07:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:OK (SKIP=75) 2019-12-09T17:07:55.236 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2019-12-09T17:07:55.236 INFO:teuthology.orchestra.run.smithi121:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2019-12-09T17:07:55.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-09T17:07:55.389 INFO:tasks.s3tests:Cleaning up boto... 2019-12-09T17:07:55.389 INFO:teuthology.orchestra.run.smithi121:> rm /home/ubuntu/cephtest/boto.cfg 2019-12-09T17:07:55.440 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid bar.client.0 --purge-data --cluster ceph 2019-12-09T17:07:55.559 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.557+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:55.587 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.585+0000 7f0182411ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:07:55.587 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.585+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:55.596 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.594+0000 7f0182411ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:07:55.596 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.594+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:55.604 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.602+0000 7f0182411ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:07:55.605 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.603+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:55.622 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.619+0000 7f0182411ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:07:55.800 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.798+0000 7f0182411ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T17:07:55.801 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.798+0000 7f0182411ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T17:07:55.801 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.798+0000 7f0182411ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T17:07:55.801 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.798+0000 7f0182411ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T17:07:55.801 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.798+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:55.811 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.809+0000 7f0182411ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:07:55.811 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.809+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:55.824 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.822+0000 7f0182411ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:07:55.824 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.822+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:55.839 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.837+0000 7f0182411ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:07:55.839 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.837+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:55.847 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.845+0000 7f0182411ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:07:55.848 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.845+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:55.855 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.853+0000 7f0182411ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:07:55.856 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.853+0000 7f0182411ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T17:07:55.856 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.853+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:55.861 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.859+0000 7f0182411ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:07:55.861 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.859+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:55.870 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.869+0000 7f0182411ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:07:55.871 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.869+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:55.878 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.876+0000 7f0182411ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:07:55.878 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.876+0000 7f0182411ec0 20 zonegroup default 2019-12-09T17:07:55.878 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.876+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:55.883 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.881+0000 7f0182411ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:07:55.883 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.881+0000 7f0182411ec0 10 Cannot find current period zone using local zone 2019-12-09T17:07:55.884 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.881+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:55.888 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.886+0000 7f0182411ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:07:55.888 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.886+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:55.899 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.897+0000 7f0182411ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:07:55.899 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.897+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:55.912 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.910+0000 7f0182411ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:07:55.912 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.910+0000 7f0182411ec0 20 zone default found 2019-12-09T17:07:55.912 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.910+0000 7f0182411ec0 20 started sync module instance, tier type = 2019-12-09T17:07:55.913 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:55.910+0000 7f0182411ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T17:07:56.238 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:56.236+0000 7f0182411ec0 20 add_watcher() i=0 2019-12-09T17:07:56.238 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:56.236+0000 7f0182411ec0 20 add_watcher() i=1 2019-12-09T17:07:56.239 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:56.236+0000 7f0182411ec0 20 add_watcher() i=2 2019-12-09T17:07:56.239 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:56.236+0000 7f0182411ec0 20 add_watcher() i=3 2019-12-09T17:07:56.239 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:56.236+0000 7f0182411ec0 20 add_watcher() i=4 2019-12-09T17:07:56.239 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:56.236+0000 7f0182411ec0 20 add_watcher() i=5 2019-12-09T17:07:56.240 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:56.236+0000 7f0182411ec0 20 add_watcher() i=6 2019-12-09T17:07:56.274 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:56.271+0000 7f0182411ec0 20 add_watcher() i=7 2019-12-09T17:07:56.274 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:56.271+0000 7f0182411ec0 2 all 8 watchers are set, enabling cache 2019-12-09T17:07:56.274 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:56.272+0000 7f013ffdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T17:07:56.279 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:56.277+0000 7f016fe3c700 0 -- 172.21.15.121:0/1041021690 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c382243630 msgr2=0x55c382243a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T17:07:56.481 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:56.480+0000 7f016fe3c700 0 --2- 172.21.15.121:0/1041021690 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x55c382243630 0x55c382243a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-09T17:07:56.557 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:56.555+0000 7f016fe3c700 0 -- 172.21.15.121:0/1993755560 >> [v2:172.21.15.132:6800/8843,v1:172.21.15.132:6801/8843] conn(0x7f00b0022440 msgr2=0x7f00b0024970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T17:07:58.086 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.083+0000 7f00ae7fc700 20 reqs_thread_entry: start 2019-12-09T17:07:58.087 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.083+0000 7f00a7fff700 20 reqs_thread_entry: start 2019-12-09T17:07:58.087 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.084+0000 7f0182411ec0 20 init_complete bucket index max shards: 0 2019-12-09T17:07:58.087 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.084+0000 7f00a67fc700 20 reqs_thread_entry: start 2019-12-09T17:07:58.087 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.084+0000 7f0182411ec0 20 get_system_obj_state: rctx=0x7ffe86395aa8 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55c3822c54a0 s->prefetch_data=0 2019-12-09T17:07:58.087 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.084+0000 7f0182411ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-12-09T17:07:58.102 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.101+0000 7f0182411ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-12-09T17:07:58.102 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.101+0000 7f0182411ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T17:07:58.103 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.101+0000 7f0182411ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T17:07:58.103 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.101+0000 7f0182411ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T17:07:58.103 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.101+0000 7f0182411ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-09T17:07:58.103 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.101+0000 7f0182411ec0 20 rados->read ofs=0 len=0 2019-12-09T17:07:58.117 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.116+0000 7f0182411ec0 20 rados_obj.operate() r=0 bl.length=446 2019-12-09T17:07:58.117 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.116+0000 7f0182411ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-12-09T17:07:58.117 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.116+0000 7f0182411ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T17:07:58.127 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.126+0000 7f0182411ec0 10 removing key index: UWLADHTXUGJXFBIKBPYD 2019-12-09T17:07:58.128 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.126+0000 7f0182411ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=170 2019-12-09T17:07:58.137 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.135+0000 7f0164ff9700 10 RGWWatcher::handle_notify() notify_id 584115552413 cookie 94298190340464 notifier 4643 bl.length()=170 2019-12-09T17:07:58.625 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.623+0000 7f0182411ec0 10 removing email index: bar.client.0+test@test.test 2019-12-09T17:07:58.626 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.623+0000 7f0182411ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=178 2019-12-09T17:07:58.639 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:58.635+0000 7f0164ff9700 10 RGWWatcher::handle_notify() notify_id 584115552414 cookie 94298190330128 notifier 4643 bl.length()=178 2019-12-09T17:07:59.039 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:59.037+0000 7f0182411ec0 10 removing user buckets index 2019-12-09T17:07:59.039 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:59.037+0000 7f0182411ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=169 2019-12-09T17:07:59.051 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:59.049+0000 7f0164ff9700 10 RGWWatcher::handle_notify() notify_id 584115552446 cookie 94298190334752 notifier 4643 bl.length()=169 2019-12-09T17:07:59.501 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:59.499+0000 7f0182411ec0 10 removing user index: bar.client.0 2019-12-09T17:07:59.501 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:59.499+0000 7f0182411ec0 10 removing default.rgw.meta+users.uid+bar.client.0 from cache 2019-12-09T17:07:59.501 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:59.499+0000 7f0182411ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=161 2019-12-09T17:07:59.508 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:59.507+0000 7f0164ff9700 10 RGWWatcher::handle_notify() notify_id 584115552415 cookie 94298190330128 notifier 4643 bl.length()=161 2019-12-09T17:07:59.688 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:59.686+0000 7f0182411ec0 20 remove_watcher() i=0 2019-12-09T17:07:59.688 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:59.686+0000 7f0182411ec0 2 removed watcher, disabling cache 2019-12-09T17:07:59.719 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:59.717+0000 7f0182411ec0 20 remove_watcher() i=1 2019-12-09T17:07:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:59.747+0000 7f0182411ec0 20 remove_watcher() i=2 2019-12-09T17:07:59.792 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:59.790+0000 7f0182411ec0 20 remove_watcher() i=3 2019-12-09T17:07:59.825 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:59.823+0000 7f0182411ec0 20 remove_watcher() i=4 2019-12-09T17:07:59.873 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:59.871+0000 7f0182411ec0 20 remove_watcher() i=5 2019-12-09T17:07:59.907 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:59.905+0000 7f0182411ec0 20 remove_watcher() i=6 2019-12-09T17:07:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:07:59.945+0000 7f0182411ec0 20 remove_watcher() i=7 2019-12-09T17:07:59.953 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph 2019-12-09T17:08:00.060 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.058+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:00.088 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.086+0000 7f2d180f8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:00.088 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.086+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:00.096 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.094+0000 7f2d180f8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:00.096 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.094+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:00.102 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.100+0000 7f2d180f8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:00.102 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.100+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:00.118 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.117+0000 7f2d180f8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:00.300 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.298+0000 7f2d180f8ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T17:08:00.301 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.298+0000 7f2d180f8ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T17:08:00.301 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.298+0000 7f2d180f8ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T17:08:00.301 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.298+0000 7f2d180f8ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T17:08:00.301 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.298+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:00.315 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.313+0000 7f2d180f8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:00.315 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.313+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:00.330 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.328+0000 7f2d180f8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:08:00.330 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.328+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:00.348 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.346+0000 7f2d180f8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:00.348 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.346+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:00.365 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.363+0000 7f2d180f8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:08:00.365 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.363+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:00.389 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.387+0000 7f2d180f8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:00.389 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.387+0000 7f2d180f8ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T17:08:00.389 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.387+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:00.417 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.416+0000 7f2d180f8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:00.418 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.416+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:00.431 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.429+0000 7f2d180f8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:00.431 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.429+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:00.450 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.448+0000 7f2d180f8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:08:00.450 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.448+0000 7f2d180f8ec0 20 zonegroup default 2019-12-09T17:08:00.450 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.448+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:00.460 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.458+0000 7f2d180f8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:00.460 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.458+0000 7f2d180f8ec0 10 Cannot find current period zone using local zone 2019-12-09T17:08:00.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.458+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:00.471 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.469+0000 7f2d180f8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:00.471 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.469+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:00.481 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.479+0000 7f2d180f8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:00.481 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.479+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:00.490 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.488+0000 7f2d180f8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:08:00.490 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.488+0000 7f2d180f8ec0 20 zone default found 2019-12-09T17:08:00.490 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.488+0000 7f2d180f8ec0 20 started sync module instance, tier type = 2019-12-09T17:08:00.491 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.488+0000 7f2d180f8ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T17:08:00.918 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.916+0000 7f2d180f8ec0 20 add_watcher() i=0 2019-12-09T17:08:00.918 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.916+0000 7f2d180f8ec0 20 add_watcher() i=1 2019-12-09T17:08:00.918 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.916+0000 7f2d180f8ec0 20 add_watcher() i=2 2019-12-09T17:08:00.919 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.916+0000 7f2d180f8ec0 20 add_watcher() i=3 2019-12-09T17:08:00.919 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.916+0000 7f2d180f8ec0 20 add_watcher() i=4 2019-12-09T17:08:00.919 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.916+0000 7f2d180f8ec0 20 add_watcher() i=5 2019-12-09T17:08:00.924 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.922+0000 7f2d180f8ec0 20 add_watcher() i=6 2019-12-09T17:08:00.956 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.954+0000 7f2d180f8ec0 20 add_watcher() i=7 2019-12-09T17:08:00.956 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.954+0000 7f2d180f8ec0 2 all 8 watchers are set, enabling cache 2019-12-09T17:08:00.956 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.954+0000 7f2cd5fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T17:08:00.964 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:00.962+0000 7f2d04b21700 0 -- 172.21.15.121:0/1724925339 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x559c99cb1ff0 msgr2=0x559c99cb4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T17:08:01.010 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:01.008+0000 7f2d05b23700 0 -- 172.21.15.121:0/8246301 >> [v2:172.21.15.132:6800/8843,v1:172.21.15.132:6801/8843] conn(0x7f2c480224b0 msgr2=0x7f2c480249a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-09T17:08:02.614 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.612+0000 7f2c47fff700 20 reqs_thread_entry: start 2019-12-09T17:08:02.615 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.613+0000 7f2c45ffb700 20 reqs_thread_entry: start 2019-12-09T17:08:02.615 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.613+0000 7f2d180f8ec0 20 init_complete bucket index max shards: 0 2019-12-09T17:08:02.616 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.614+0000 7f2c33fff700 20 reqs_thread_entry: start 2019-12-09T17:08:02.616 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.614+0000 7f2d180f8ec0 20 get_system_obj_state: rctx=0x7fff38152be8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x559c99d2b6d0 s->prefetch_data=0 2019-12-09T17:08:02.616 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.614+0000 7f2d180f8ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-12-09T17:08:02.635 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.633+0000 7f2d180f8ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-12-09T17:08:02.635 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.633+0000 7f2d180f8ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T17:08:02.635 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.633+0000 7f2d180f8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T17:08:02.635 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.633+0000 7f2d180f8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T17:08:02.636 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.633+0000 7f2d180f8ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-09T17:08:02.636 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.633+0000 7f2d180f8ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:02.645 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.643+0000 7f2d180f8ec0 20 rados_obj.operate() r=0 bl.length=446 2019-12-09T17:08:02.646 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.643+0000 7f2d180f8ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-12-09T17:08:02.646 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.643+0000 7f2d180f8ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T17:08:02.680 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.678+0000 7f2d180f8ec0 10 removing key index: QKOFOAGEXYRPMHZHBJXS 2019-12-09T17:08:02.680 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.678+0000 7f2d180f8ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=170 2019-12-09T17:08:02.695 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.693+0000 7f2ce67fc700 10 RGWWatcher::handle_notify() notify_id 584115552313 cookie 94131083387280 notifier 4655 bl.length()=170 2019-12-09T17:08:02.967 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.965+0000 7f2d180f8ec0 10 removing email index: foo.client.0+test@test.test 2019-12-09T17:08:02.968 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.965+0000 7f2d180f8ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=178 2019-12-09T17:08:02.977 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:02.975+0000 7f2ce67fc700 10 RGWWatcher::handle_notify() notify_id 584115552291 cookie 94131083398352 notifier 4655 bl.length()=178 2019-12-09T17:08:03.225 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:03.223+0000 7f2d180f8ec0 10 removing user buckets index 2019-12-09T17:08:03.225 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:03.223+0000 7f2d180f8ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=169 2019-12-09T17:08:03.242 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:03.240+0000 7f2ce67fc700 10 RGWWatcher::handle_notify() notify_id 584115552416 cookie 94131083385792 notifier 4655 bl.length()=169 2019-12-09T17:08:03.744 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:03.742+0000 7f2d180f8ec0 10 removing user index: foo.client.0 2019-12-09T17:08:03.744 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:03.742+0000 7f2d180f8ec0 10 removing default.rgw.meta+users.uid+foo.client.0 from cache 2019-12-09T17:08:03.744 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:03.742+0000 7f2d180f8ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=161 2019-12-09T17:08:03.762 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:03.761+0000 7f2ce67fc700 10 RGWWatcher::handle_notify() notify_id 584115553169 cookie 94131083383680 notifier 4655 bl.length()=161 2019-12-09T17:08:04.018 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.017+0000 7f2d180f8ec0 20 remove_watcher() i=0 2019-12-09T17:08:04.019 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.017+0000 7f2d180f8ec0 2 removed watcher, disabling cache 2019-12-09T17:08:04.078 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.076+0000 7f2d180f8ec0 20 remove_watcher() i=1 2019-12-09T17:08:04.136 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.135+0000 7f2d180f8ec0 20 remove_watcher() i=2 2019-12-09T17:08:04.190 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.189+0000 7f2d180f8ec0 20 remove_watcher() i=3 2019-12-09T17:08:04.246 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.244+0000 7f2d180f8ec0 20 remove_watcher() i=4 2019-12-09T17:08:04.290 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.288+0000 7f2d180f8ec0 20 remove_watcher() i=5 2019-12-09T17:08:04.338 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.336+0000 7f2d180f8ec0 20 remove_watcher() i=6 2019-12-09T17:08:04.381 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.379+0000 7f2d180f8ec0 20 remove_watcher() i=7 2019-12-09T17:08:04.389 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid 'testx$tenanteduser.client.0' --purge-data --cluster ceph 2019-12-09T17:08:04.510 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.508+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:04.551 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.549+0000 7fed982a4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:04.551 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.549+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:04.561 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.559+0000 7fed982a4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:04.561 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.559+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:04.573 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.571+0000 7fed982a4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:04.573 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.571+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:04.597 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.595+0000 7fed982a4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:04.877 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.875+0000 7fed982a4ec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T17:08:04.877 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.875+0000 7fed982a4ec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T17:08:04.877 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.875+0000 7fed982a4ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T17:08:04.877 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.875+0000 7fed982a4ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T17:08:04.878 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.875+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:04.892 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.890+0000 7fed982a4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:04.892 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.890+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:04.907 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.905+0000 7fed982a4ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:08:04.907 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.905+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:04.922 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.920+0000 7fed982a4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:04.922 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.920+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:04.939 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.937+0000 7fed982a4ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:08:04.939 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.937+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:04.949 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.947+0000 7fed982a4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:04.949 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.947+0000 7fed982a4ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T17:08:04.949 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.947+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:04.962 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.960+0000 7fed982a4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:04.962 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.960+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:04.978 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.976+0000 7fed982a4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:04.978 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.976+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:04.996 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.994+0000 7fed982a4ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:08:04.996 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.994+0000 7fed982a4ec0 20 zonegroup default 2019-12-09T17:08:04.997 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:04.994+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:05.002 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.000+0000 7fed982a4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:05.002 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.000+0000 7fed982a4ec0 10 Cannot find current period zone using local zone 2019-12-09T17:08:05.003 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.000+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:05.012 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.010+0000 7fed982a4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:05.012 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.010+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:05.024 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.022+0000 7fed982a4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:05.024 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.022+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:05.044 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.042+0000 7fed982a4ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:08:05.044 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.042+0000 7fed982a4ec0 20 zone default found 2019-12-09T17:08:05.045 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.042+0000 7fed982a4ec0 20 started sync module instance, tier type = 2019-12-09T17:08:05.045 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.042+0000 7fed982a4ec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T17:08:05.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.459+0000 7fed982a4ec0 20 add_watcher() i=0 2019-12-09T17:08:05.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.459+0000 7fed982a4ec0 20 add_watcher() i=1 2019-12-09T17:08:05.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.459+0000 7fed982a4ec0 20 add_watcher() i=2 2019-12-09T17:08:05.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.459+0000 7fed982a4ec0 20 add_watcher() i=3 2019-12-09T17:08:05.461 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.459+0000 7fed982a4ec0 20 add_watcher() i=4 2019-12-09T17:08:05.462 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.459+0000 7fed982a4ec0 20 add_watcher() i=5 2019-12-09T17:08:05.491 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.489+0000 7fed982a4ec0 20 add_watcher() i=6 2019-12-09T17:08:05.504 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.502+0000 7fed982a4ec0 20 add_watcher() i=7 2019-12-09T17:08:05.504 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.502+0000 7fed982a4ec0 2 all 8 watchers are set, enabling cache 2019-12-09T17:08:05.505 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.502+0000 7fed54fe9700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T17:08:05.509 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.507+0000 7fed7ffff700 0 -- 172.21.15.121:0/2411362645 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x556e6dabb8e0 msgr2=0x556e6dabddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T17:08:05.713 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.711+0000 7fed7ffff700 0 --2- 172.21.15.121:0/2411362645 >> [v2:172.21.15.121:3301/0,v1:172.21.15.121:6790/0] conn(0x556e6dabb8e0 0x556e6dabddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-09T17:08:05.757 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:05.755+0000 7fed7ffff700 0 -- 172.21.15.121:0/1606831690 >> v2:172.21.15.132:3300/0 conn(0x556e6dac30f0 msgr2=0x556e6dac5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T17:08:07.390 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.389+0000 7fecc6ffd700 20 reqs_thread_entry: start 2019-12-09T17:08:07.391 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.389+0000 7fecc4ff9700 20 reqs_thread_entry: start 2019-12-09T17:08:07.391 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.389+0000 7fed982a4ec0 20 init_complete bucket index max shards: 0 2019-12-09T17:08:07.392 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.390+0000 7fecbaffd700 20 reqs_thread_entry: start 2019-12-09T17:08:07.392 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.390+0000 7fed982a4ec0 20 get_system_obj_state: rctx=0x7ffd2b3a6a48 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x556e6db2cfc0 s->prefetch_data=0 2019-12-09T17:08:07.392 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.390+0000 7fed982a4ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-12-09T17:08:07.412 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.410+0000 7fed982a4ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-12-09T17:08:07.412 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.410+0000 7fed982a4ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T17:08:07.412 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.410+0000 7fed982a4ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-09T17:08:07.412 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.410+0000 7fed982a4ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-09T17:08:07.412 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.410+0000 7fed982a4ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-09T17:08:07.412 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.410+0000 7fed982a4ec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:07.432 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.430+0000 7fed982a4ec0 20 rados_obj.operate() r=0 bl.length=505 2019-12-09T17:08:07.432 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.430+0000 7fed982a4ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-12-09T17:08:07.432 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.430+0000 7fed982a4ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-09T17:08:07.441 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.439+0000 7fed982a4ec0 10 removing key index: HQATBITRCXZJZCJNLCSM 2019-12-09T17:08:07.441 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.439+0000 7fed982a4ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=170 2019-12-09T17:08:07.458 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.456+0000 7fed767fc700 10 RGWWatcher::handle_notify() notify_id 584115552417 cookie 93932774656896 notifier 5055 bl.length()=170 2019-12-09T17:08:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.957+0000 7fed982a4ec0 10 removing email index: testx$tenanteduser.client.0+test@test.test 2019-12-09T17:08:07.959 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.957+0000 7fed982a4ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=193 2019-12-09T17:08:07.974 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:07.972+0000 7fed767fc700 10 RGWWatcher::handle_notify() notify_id 584115553170 cookie 93932774658512 notifier 5055 bl.length()=193 2019-12-09T17:08:08.068 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:08.066+0000 7fed982a4ec0 10 removing user buckets index 2019-12-09T17:08:08.068 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:08.066+0000 7fed982a4ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=184 2019-12-09T17:08:08.084 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:08.082+0000 7fed767fc700 10 RGWWatcher::handle_notify() notify_id 584115552292 cookie 93932774654384 notifier 5055 bl.length()=184 2019-12-09T17:08:08.269 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:08.268+0000 7fed982a4ec0 10 removing user index: testx$tenanteduser.client.0 2019-12-09T17:08:08.270 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:08.268+0000 7fed982a4ec0 10 removing default.rgw.meta+users.uid+testx$tenanteduser.client.0 from cache 2019-12-09T17:08:08.270 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:08.268+0000 7fed982a4ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=176 2019-12-09T17:08:08.289 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:08.287+0000 7fed767fc700 10 RGWWatcher::handle_notify() notify_id 584115552418 cookie 93932774656896 notifier 5055 bl.length()=176 2019-12-09T17:08:09.111 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:09.110+0000 7fed982a4ec0 20 remove_watcher() i=0 2019-12-09T17:08:09.112 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:09.110+0000 7fed982a4ec0 2 removed watcher, disabling cache 2019-12-09T17:08:09.161 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:09.159+0000 7fed982a4ec0 20 remove_watcher() i=1 2019-12-09T17:08:09.198 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:09.196+0000 7fed982a4ec0 20 remove_watcher() i=2 2019-12-09T17:08:09.236 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:09.234+0000 7fed982a4ec0 20 remove_watcher() i=3 2019-12-09T17:08:09.275 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:09.274+0000 7fed982a4ec0 20 remove_watcher() i=4 2019-12-09T17:08:09.311 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:09.309+0000 7fed982a4ec0 20 remove_watcher() i=5 2019-12-09T17:08:09.351 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:09.349+0000 7fed982a4ec0 20 remove_watcher() i=6 2019-12-09T17:08:09.388 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:09.386+0000 7fed982a4ec0 20 remove_watcher() i=7 2019-12-09T17:08:09.395 INFO:tasks.s3tests:Removing s3-tests... 2019-12-09T17:08:09.395 INFO:teuthology.orchestra.run.smithi121:> rm -rf /home/ubuntu/cephtest/s3-tests 2019-12-09T17:08:09.519 INFO:teuthology.run_tasks:Running task swift... 2019-12-09T17:08:09.540 INFO:tasks.swift:clients=['client.0'] 2019-12-09T17:08:09.540 INFO:tasks.swift:Downloading swift... 2019-12-09T17:08:09.540 INFO:teuthology.orchestra.run.smithi121:> git clone -b ceph-master git://git.ceph.com/git/swift.git /home/ubuntu/cephtest/swift 2019-12-09T17:08:09.655 INFO:teuthology.orchestra.run.smithi121.stdout:Cloning into '/home/ubuntu/cephtest/swift'... 2019-12-09T17:08:10.068 INFO:tasks.swift:Creating rgw users... 2019-12-09T17:08:10.069 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser foo.client.0:foo --display-name 'Mr. foo.client.0 foo' --secret 22AMF4cvTzxqgt9F3xdSWHMhHRQOe3nhdf9DdwqlrT0GxFJk1f1HLw== --email foo.client.0+test@test.test --key-type swift --access full 2019-12-09T17:08:10.253 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.252+0000 7f75c8ccdec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:10.284 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.282+0000 7f75c8ccdec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:10.284 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.282+0000 7f75c8ccdec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:10.294 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.292+0000 7f75c8ccdec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:10.294 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.292+0000 7f75c8ccdec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:10.301 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.299+0000 7f75c8ccdec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:10.301 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.299+0000 7f75c8ccdec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:10.321 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.319+0000 7f75c8ccdec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:10.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.556+0000 7f75c8ccdec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T17:08:10.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.556+0000 7f75c8ccdec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T17:08:10.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.556+0000 7f75c8ccdec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T17:08:10.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.556+0000 7f75c8ccdec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T17:08:10.558 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.556+0000 7f75c8ccdec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:10.567 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.565+0000 7f75c8ccdec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:10.567 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.565+0000 7f75c8ccdec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:10.576 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.574+0000 7f75c8ccdec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:08:10.576 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.575+0000 7f75c8ccdec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:10.589 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.587+0000 7f75c8ccdec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:10.589 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.587+0000 7f75c8ccdec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:10.603 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.601+0000 7f75c8ccdec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:08:10.603 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.601+0000 7f75c8ccdec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:10.613 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.612+0000 7f75c8ccdec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:10.613 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.612+0000 7f75c8ccdec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T17:08:10.614 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.612+0000 7f75c8ccdec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:10.620 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.618+0000 7f75c8ccdec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:10.620 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.618+0000 7f75c8ccdec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:10.638 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.636+0000 7f75c8ccdec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:10.638 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.636+0000 7f75c8ccdec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:10.652 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.651+0000 7f75c8ccdec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:08:10.652 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.651+0000 7f75c8ccdec0 20 zonegroup default 2019-12-09T17:08:10.653 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.651+0000 7f75c8ccdec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:10.662 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.661+0000 7f75c8ccdec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:10.662 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.661+0000 7f75c8ccdec0 10 Cannot find current period zone using local zone 2019-12-09T17:08:10.662 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.661+0000 7f75c8ccdec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:10.672 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.670+0000 7f75c8ccdec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:10.672 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.670+0000 7f75c8ccdec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:10.693 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.692+0000 7f75c8ccdec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:10.694 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.692+0000 7f75c8ccdec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:10.719 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.715+0000 7f75c8ccdec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:08:10.720 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.715+0000 7f75c8ccdec0 20 zone default found 2019-12-09T17:08:10.720 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.715+0000 7f75c8ccdec0 20 started sync module instance, tier type = 2019-12-09T17:08:10.720 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:10.715+0000 7f75c8ccdec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T17:08:11.093 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:11.091+0000 7f75c8ccdec0 20 add_watcher() i=0 2019-12-09T17:08:11.093 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:11.091+0000 7f75c8ccdec0 20 add_watcher() i=1 2019-12-09T17:08:11.093 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:11.091+0000 7f75c8ccdec0 20 add_watcher() i=2 2019-12-09T17:08:11.093 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:11.091+0000 7f75c8ccdec0 20 add_watcher() i=3 2019-12-09T17:08:11.093 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:11.091+0000 7f75c8ccdec0 20 add_watcher() i=4 2019-12-09T17:08:11.094 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:11.091+0000 7f75c8ccdec0 20 add_watcher() i=5 2019-12-09T17:08:11.094 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:11.091+0000 7f75c8ccdec0 20 add_watcher() i=6 2019-12-09T17:08:11.129 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:11.127+0000 7f75c8ccdec0 20 add_watcher() i=7 2019-12-09T17:08:11.129 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:11.127+0000 7f75c8ccdec0 2 all 8 watchers are set, enabling cache 2019-12-09T17:08:11.129 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:11.127+0000 7f75867dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T17:08:11.144 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:11.142+0000 7f75b56f6700 0 -- >> v2:172.21.15.121:3300/0 conn(0x55949cdb2230 msgr2=0x55949cdb4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T17:08:11.240 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:11.238+0000 7f75b66f8700 0 -- 172.21.15.121:0/879106237 >> [v2:172.21.15.132:6810/10196,v1:172.21.15.132:6811/10196] conn(0x55949cdc0270 msgr2=0x55949cdc2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T17:08:12.757 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.746+0000 7f74fcff9700 20 reqs_thread_entry: start 2019-12-09T17:08:12.763 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.746+0000 7f74f67fc700 20 reqs_thread_entry: start 2019-12-09T17:08:12.763 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.746+0000 7f75c8ccdec0 20 init_complete bucket index max shards: 0 2019-12-09T17:08:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.746+0000 7f74f4ff9700 20 reqs_thread_entry: start 2019-12-09T17:08:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.746+0000 7f75c8ccdec0 20 get_system_obj_state: rctx=0x7ffe7978e418 obj=default.rgw.meta:users.uid:foo.client.0 state=0x55949ce26ad0 s->prefetch_data=0 2019-12-09T17:08:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.746+0000 7f75c8ccdec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-12-09T17:08:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.751+0000 7f75c8ccdec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-12-09T17:08:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.751+0000 7f75c8ccdec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T17:08:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.751+0000 7f75c8ccdec0 20 get_system_obj_state: rctx=0x7ffe7978e428 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x55949ce28860 s->prefetch_data=0 2019-12-09T17:08:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.751+0000 7f75c8ccdec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-12-09T17:08:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.762+0000 7f75c8ccdec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-12-09T17:08:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.762+0000 7f75c8ccdec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-09T17:08:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.762+0000 7f75c8ccdec0 20 get_system_obj_state: rctx=0x7ffe7978e038 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x55949ce28860 s->prefetch_data=0 2019-12-09T17:08:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.762+0000 7f75c8ccdec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : miss 2019-12-09T17:08:12.780 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.775+0000 7f75c8ccdec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-12-09T17:08:12.781 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.775+0000 7f75c8ccdec0 10 adding default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-12-09T17:08:12.781 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.775+0000 7f75c8ccdec0 20 get_system_obj_state: rctx=0x7ffe7978e1b8 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x55949ce28b10 s->prefetch_data=0 2019-12-09T17:08:12.781 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.775+0000 7f75c8ccdec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : type miss (requested=0x6, cached=0x0) 2019-12-09T17:08:12.792 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.787+0000 7f75c8ccdec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-12-09T17:08:12.792 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.787+0000 7f75c8ccdec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-12-09T17:08:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.851+0000 7f75c8ccdec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-09T17:08:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.851+0000 7f75c8ccdec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T17:08:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.851+0000 7f75c8ccdec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=612 2019-12-09T17:08:12.867 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.865+0000 7f7596ffd700 10 RGWWatcher::handle_notify() notify_id 584115553171 cookie 94096775006080 notifier 5073 bl.length()=612 2019-12-09T17:08:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.865+0000 7f7596ffd700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-09T17:08:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:12.865+0000 7f7596ffd700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T17:08:13.038 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.036+0000 7f75c8ccdec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-12-09T17:08:13.039 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.036+0000 7f75c8ccdec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-09T17:08:13.039 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.036+0000 7f75c8ccdec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-12-09T17:08:13.054 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.053+0000 7f7596ffd700 10 RGWWatcher::handle_notify() notify_id 584115552293 cookie 94096775020032 notifier 5073 bl.length()=194 2019-12-09T17:08:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.053+0000 7f7596ffd700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-12-09T17:08:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.053+0000 7f7596ffd700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-09T17:08:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.385+0000 7f75c8ccdec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-12-09T17:08:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.386+0000 7f75c8ccdec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-12-09T17:08:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.386+0000 7f75c8ccdec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=183 2019-12-09T17:08:13.401 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.399+0000 7f7596ffd700 10 RGWWatcher::handle_notify() notify_id 584115552419 cookie 94096775009456 notifier 5073 bl.length()=183 2019-12-09T17:08:13.401 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.399+0000 7f7596ffd700 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-12-09T17:08:13.401 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.399+0000 7f7596ffd700 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-12-09T17:08:13.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.622+0000 7f75c8ccdec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-09T17:08:13.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.622+0000 7f75c8ccdec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T17:08:13.624 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.622+0000 7f75c8ccdec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=636 2019-12-09T17:08:13.644 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.642+0000 7f7596ffd700 10 RGWWatcher::handle_notify() notify_id 584115553172 cookie 94096775006080 notifier 5073 bl.length()=636 2019-12-09T17:08:13.644 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.642+0000 7f7596ffd700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-09T17:08:13.644 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:13.642+0000 7f7596ffd700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-09T17:08:14.152 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2019-12-09T17:08:14.153 INFO:teuthology.orchestra.run.smithi121.stdout: "user_id": "foo.client.0", 2019-12-09T17:08:14.153 INFO:teuthology.orchestra.run.smithi121.stdout: "display_name": "Mr. foo.client.0 foo", 2019-12-09T17:08:14.153 INFO:teuthology.orchestra.run.smithi121.stdout: "email": "foo.client.0+test@test.test", 2019-12-09T17:08:14.153 INFO:teuthology.orchestra.run.smithi121.stdout: "suspended": 0, 2019-12-09T17:08:14.153 INFO:teuthology.orchestra.run.smithi121.stdout: "max_buckets": 1000, 2019-12-09T17:08:14.154 INFO:teuthology.orchestra.run.smithi121.stdout: "subusers": [ 2019-12-09T17:08:14.154 INFO:teuthology.orchestra.run.smithi121.stdout: { 2019-12-09T17:08:14.154 INFO:teuthology.orchestra.run.smithi121.stdout: "id": "foo.client.0:foo", 2019-12-09T17:08:14.154 INFO:teuthology.orchestra.run.smithi121.stdout: "permissions": "full-control" 2019-12-09T17:08:14.154 INFO:teuthology.orchestra.run.smithi121.stdout: } 2019-12-09T17:08:14.154 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2019-12-09T17:08:14.154 INFO:teuthology.orchestra.run.smithi121.stdout: "keys": [], 2019-12-09T17:08:14.155 INFO:teuthology.orchestra.run.smithi121.stdout: "swift_keys": [ 2019-12-09T17:08:14.155 INFO:teuthology.orchestra.run.smithi121.stdout: { 2019-12-09T17:08:14.155 INFO:teuthology.orchestra.run.smithi121.stdout: "user": "foo.client.0:foo", 2019-12-09T17:08:14.155 INFO:teuthology.orchestra.run.smithi121.stdout: "secret_key": "22AMF4cvTzxqgt9F3xdSWHMhHRQOe3nhdf9DdwqlrT0GxFJk1f1HLw==" 2019-12-09T17:08:14.155 INFO:teuthology.orchestra.run.smithi121.stdout: } 2019-12-09T17:08:14.155 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2019-12-09T17:08:14.155 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": [], 2019-12-09T17:08:14.156 INFO:teuthology.orchestra.run.smithi121.stdout: "op_mask": "read, write, delete", 2019-12-09T17:08:14.156 INFO:teuthology.orchestra.run.smithi121.stdout: "default_placement": "", 2019-12-09T17:08:14.156 INFO:teuthology.orchestra.run.smithi121.stdout: "default_storage_class": "", 2019-12-09T17:08:14.156 INFO:teuthology.orchestra.run.smithi121.stdout: "placement_tags": [], 2019-12-09T17:08:14.156 INFO:teuthology.orchestra.run.smithi121.stdout: "bucket_quota": { 2019-12-09T17:08:14.156 INFO:teuthology.orchestra.run.smithi121.stdout: "enabled": false, 2019-12-09T17:08:14.157 INFO:teuthology.orchestra.run.smithi121.stdout: "check_on_raw": false, 2019-12-09T17:08:14.157 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size": -1, 2019-12-09T17:08:14.157 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size_kb": 0, 2019-12-09T17:08:14.157 INFO:teuthology.orchestra.run.smithi121.stdout: "max_objects": -1 2019-12-09T17:08:14.157 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2019-12-09T17:08:14.157 INFO:teuthology.orchestra.run.smithi121.stdout: "user_quota": { 2019-12-09T17:08:14.157 INFO:teuthology.orchestra.run.smithi121.stdout: "enabled": false, 2019-12-09T17:08:14.158 INFO:teuthology.orchestra.run.smithi121.stdout: "check_on_raw": false, 2019-12-09T17:08:14.158 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size": -1, 2019-12-09T17:08:14.158 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size_kb": 0, 2019-12-09T17:08:14.158 INFO:teuthology.orchestra.run.smithi121.stdout: "max_objects": -1 2019-12-09T17:08:14.158 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2019-12-09T17:08:14.158 INFO:teuthology.orchestra.run.smithi121.stdout: "temp_url_keys": [], 2019-12-09T17:08:14.158 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "rgw", 2019-12-09T17:08:14.159 INFO:teuthology.orchestra.run.smithi121.stdout: "mfa_ids": [] 2019-12-09T17:08:14.159 INFO:teuthology.orchestra.run.smithi121.stdout:} 2019-12-09T17:08:14.159 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T17:08:14.199 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.196+0000 7f75c8ccdec0 20 remove_watcher() i=0 2019-12-09T17:08:14.200 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.196+0000 7f75c8ccdec0 2 removed watcher, disabling cache 2019-12-09T17:08:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.261+0000 7f75c8ccdec0 20 remove_watcher() i=1 2019-12-09T17:08:14.309 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.308+0000 7f75c8ccdec0 20 remove_watcher() i=2 2019-12-09T17:08:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.363+0000 7f75c8ccdec0 20 remove_watcher() i=3 2019-12-09T17:08:14.408 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.406+0000 7f75c8ccdec0 20 remove_watcher() i=4 2019-12-09T17:08:14.458 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.456+0000 7f75c8ccdec0 20 remove_watcher() i=5 2019-12-09T17:08:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.497+0000 7f75c8ccdec0 20 remove_watcher() i=6 2019-12-09T17:08:14.535 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.533+0000 7f75c8ccdec0 20 remove_watcher() i=7 2019-12-09T17:08:14.543 INFO:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser bar.client.0:bar --display-name 'Mr. bar.client.0 bar' --secret yjjNnAXs3zMpL/bIBTnu+OIhnEhnLNYokQOz6wi44PHQh1fyrfH8Uw== --email bar.client.0+test@test.test --key-type swift --access full 2019-12-09T17:08:14.673 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.671+0000 7fc068ecfec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:14.704 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.702+0000 7fc068ecfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:14.704 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.702+0000 7fc068ecfec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:14.708 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.707+0000 7fc068ecfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:14.708 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.707+0000 7fc068ecfec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:14.714 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.712+0000 7fc068ecfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:14.714 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.712+0000 7fc068ecfec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:14.725 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.724+0000 7fc068ecfec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:14.880 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.878+0000 7fc068ecfec0 20 RGWRados::pool_iterate: got zone_info.a55fd90f-db62-40cd-9264-5916c91f1695 2019-12-09T17:08:14.880 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.878+0000 7fc068ecfec0 20 RGWRados::pool_iterate: got zonegroup_info.a66dac24-061e-4e88-8f00-9f4780e1c16d 2019-12-09T17:08:14.880 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.878+0000 7fc068ecfec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-09T17:08:14.880 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.878+0000 7fc068ecfec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-09T17:08:14.881 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.878+0000 7fc068ecfec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:14.890 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.888+0000 7fc068ecfec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:14.890 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.888+0000 7fc068ecfec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:14.901 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.900+0000 7fc068ecfec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:08:14.902 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.900+0000 7fc068ecfec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:14.911 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.909+0000 7fc068ecfec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:14.911 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.909+0000 7fc068ecfec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:14.919 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.917+0000 7fc068ecfec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:08:14.919 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.917+0000 7fc068ecfec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:14.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.923+0000 7fc068ecfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:14.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.923+0000 7fc068ecfec0 10 cannot find current period zonegroup using local zonegroup 2019-12-09T17:08:14.925 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.923+0000 7fc068ecfec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:14.931 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.930+0000 7fc068ecfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:14.931 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.930+0000 7fc068ecfec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:14.950 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.948+0000 7fc068ecfec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:14.950 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.948+0000 7fc068ecfec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.959+0000 7fc068ecfec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-09T17:08:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.959+0000 7fc068ecfec0 20 zonegroup default 2019-12-09T17:08:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.959+0000 7fc068ecfec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:14.967 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.965+0000 7fc068ecfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:14.967 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.965+0000 7fc068ecfec0 10 Cannot find current period zone using local zone 2019-12-09T17:08:14.967 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.965+0000 7fc068ecfec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:14.978 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.976+0000 7fc068ecfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-09T17:08:14.978 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.976+0000 7fc068ecfec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:14.988 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.986+0000 7fc068ecfec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-09T17:08:14.988 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:14.986+0000 7fc068ecfec0 20 rados->read ofs=0 len=0 2019-12-09T17:08:15.006 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.004+0000 7fc068ecfec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-09T17:08:15.006 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.004+0000 7fc068ecfec0 20 zone default found 2019-12-09T17:08:15.006 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.004+0000 7fc068ecfec0 20 started sync module instance, tier type = 2019-12-09T17:08:15.007 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.004+0000 7fc068ecfec0 20 started zone id=a55fd90f-db62-40cd-9264-5916c91f1695 (name=default) with tier type = 2019-12-09T17:08:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.337+0000 7fc068ecfec0 20 add_watcher() i=0 2019-12-09T17:08:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.337+0000 7fc068ecfec0 20 add_watcher() i=1 2019-12-09T17:08:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.337+0000 7fc068ecfec0 20 add_watcher() i=2 2019-12-09T17:08:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.337+0000 7fc068ecfec0 20 add_watcher() i=3 2019-12-09T17:08:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.337+0000 7fc068ecfec0 20 add_watcher() i=4 2019-12-09T17:08:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.337+0000 7fc068ecfec0 20 add_watcher() i=5 2019-12-09T17:08:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.337+0000 7fc068ecfec0 20 add_watcher() i=6 2019-12-09T17:08:15.370 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.368+0000 7fc068ecfec0 20 add_watcher() i=7 2019-12-09T17:08:15.370 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.368+0000 7fc068ecfec0 2 all 8 watchers are set, enabling cache 2019-12-09T17:08:15.370 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.368+0000 7fc026fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-09T17:08:15.374 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.373+0000 7fc0560f9700 0 -- 172.21.15.121:0/1326494548 >> v2:172.21.15.121:3300/0 conn(0x560710515550 msgr2=0x56071051bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-09T17:08:15.577 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.575+0000 7fc0560f9700 0 --2- 172.21.15.121:0/1326494548 >> v2:172.21.15.121:3300/0 conn(0x560710515550 0x56071051bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-09T17:08:15.638 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:15.636+0000 7fc0568fa700 0 -- 172.21.15.121:0/1617099133 >> [v2:172.21.15.132:6800/8843,v1:172.21.15.132:6801/8843] conn(0x7fbf98022480 msgr2=0x7fbf98024970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-09T17:08:17.197 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.194+0000 7fbf957fa700 20 reqs_thread_entry: start 2019-12-09T17:08:17.197 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.195+0000 7fbf8effd700 20 reqs_thread_entry: start 2019-12-09T17:08:17.197 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.195+0000 7fc068ecfec0 20 init_complete bucket index max shards: 0 2019-12-09T17:08:17.197 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.195+0000 7fbf8d7fa700 20 reqs_thread_entry: start 2019-12-09T17:08:17.198 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.195+0000 7fc068ecfec0 20 get_system_obj_state: rctx=0x7ffc24fc0b48 obj=default.rgw.meta:users.uid:bar.client.0 state=0x560710596d80 s->prefetch_data=0 2019-12-09T17:08:17.198 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.195+0000 7fc068ecfec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-12-09T17:08:17.204 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.203+0000 7fc068ecfec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-12-09T17:08:17.204 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.203+0000 7fc068ecfec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T17:08:17.205 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.203+0000 7fc068ecfec0 20 get_system_obj_state: rctx=0x7ffc24fc0b58 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x560710598b10 s->prefetch_data=0 2019-12-09T17:08:17.205 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.203+0000 7fc068ecfec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-12-09T17:08:17.213 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.212+0000 7fc068ecfec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-12-09T17:08:17.214 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.212+0000 7fc068ecfec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-09T17:08:17.214 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.212+0000 7fc068ecfec0 20 get_system_obj_state: rctx=0x7ffc24fc0768 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x560710598b10 s->prefetch_data=0 2019-12-09T17:08:17.214 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.212+0000 7fc068ecfec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : miss 2019-12-09T17:08:17.225 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.223+0000 7fc068ecfec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-12-09T17:08:17.225 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.223+0000 7fc068ecfec0 10 adding default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-12-09T17:08:17.225 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.223+0000 7fc068ecfec0 20 get_system_obj_state: rctx=0x7ffc24fc08e8 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x560710598dc0 s->prefetch_data=0 2019-12-09T17:08:17.226 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.223+0000 7fc068ecfec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : type miss (requested=0x6, cached=0x0) 2019-12-09T17:08:17.236 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.234+0000 7fc068ecfec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-12-09T17:08:17.236 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.234+0000 7fc068ecfec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-12-09T17:08:17.296 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.294+0000 7fc068ecfec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-09T17:08:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.294+0000 7fc068ecfec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T17:08:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.294+0000 7fc068ecfec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=612 2019-12-09T17:08:17.312 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.310+0000 7fc0377fe700 10 RGWWatcher::handle_notify() notify_id 584115552420 cookie 94588338460256 notifier 4996 bl.length()=612 2019-12-09T17:08:17.312 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.310+0000 7fc0377fe700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-09T17:08:17.312 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.310+0000 7fc0377fe700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T17:08:17.729 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.727+0000 7fc068ecfec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-12-09T17:08:17.729 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.727+0000 7fc068ecfec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-09T17:08:17.730 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.727+0000 7fc068ecfec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-12-09T17:08:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.741+0000 7fc0377fe700 10 RGWWatcher::handle_notify() notify_id 584115552421 cookie 94588338460256 notifier 4996 bl.length()=194 2019-12-09T17:08:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.741+0000 7fc0377fe700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-12-09T17:08:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:17.741+0000 7fc0377fe700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-09T17:08:18.330 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:18.329+0000 7fc068ecfec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-12-09T17:08:18.331 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:18.329+0000 7fc068ecfec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-12-09T17:08:18.331 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:18.329+0000 7fc068ecfec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=183 2019-12-09T17:08:18.349 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:18.348+0000 7fc0377fe700 10 RGWWatcher::handle_notify() notify_id 584115552422 cookie 94588338469888 notifier 4996 bl.length()=183 2019-12-09T17:08:18.350 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:18.348+0000 7fc0377fe700 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-12-09T17:08:18.350 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:18.348+0000 7fc0377fe700 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-12-09T17:08:18.586 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:18.584+0000 7fc068ecfec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-09T17:08:18.586 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:18.584+0000 7fc068ecfec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T17:08:18.586 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:18.584+0000 7fc068ecfec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=636 2019-12-09T17:08:18.615 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:18.613+0000 7fc0377fe700 10 RGWWatcher::handle_notify() notify_id 584115552423 cookie 94588338460256 notifier 4996 bl.length()=636 2019-12-09T17:08:18.615 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:18.613+0000 7fc0377fe700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-09T17:08:18.616 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:18.613+0000 7fc0377fe700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-09T17:08:19.022 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2019-12-09T17:08:19.022 INFO:teuthology.orchestra.run.smithi121.stdout: "user_id": "bar.client.0", 2019-12-09T17:08:19.023 INFO:teuthology.orchestra.run.smithi121.stdout: "display_name": "Mr. bar.client.0 bar", 2019-12-09T17:08:19.023 INFO:teuthology.orchestra.run.smithi121.stdout: "email": "bar.client.0+test@test.test", 2019-12-09T17:08:19.023 INFO:teuthology.orchestra.run.smithi121.stdout: "suspended": 0, 2019-12-09T17:08:19.023 INFO:teuthology.orchestra.run.smithi121.stdout: "max_buckets": 1000, 2019-12-09T17:08:19.023 INFO:teuthology.orchestra.run.smithi121.stdout: "subusers": [ 2019-12-09T17:08:19.023 INFO:teuthology.orchestra.run.smithi121.stdout: { 2019-12-09T17:08:19.023 INFO:teuthology.orchestra.run.smithi121.stdout: "id": "bar.client.0:bar", 2019-12-09T17:08:19.024 INFO:teuthology.orchestra.run.smithi121.stdout: "permissions": "full-control" 2019-12-09T17:08:19.024 INFO:teuthology.orchestra.run.smithi121.stdout: } 2019-12-09T17:08:19.024 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2019-12-09T17:08:19.024 INFO:teuthology.orchestra.run.smithi121.stdout: "keys": [], 2019-12-09T17:08:19.024 INFO:teuthology.orchestra.run.smithi121.stdout: "swift_keys": [ 2019-12-09T17:08:19.024 INFO:teuthology.orchestra.run.smithi121.stdout: { 2019-12-09T17:08:19.024 INFO:teuthology.orchestra.run.smithi121.stdout: "user": "bar.client.0:bar", 2019-12-09T17:08:19.025 INFO:teuthology.orchestra.run.smithi121.stdout: "secret_key": "yjjNnAXs3zMpL/bIBTnu+OIhnEhnLNYokQOz6wi44PHQh1fyrfH8Uw==" 2019-12-09T17:08:19.025 INFO:teuthology.orchestra.run.smithi121.stdout: } 2019-12-09T17:08:19.025 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2019-12-09T17:08:19.025 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": [], 2019-12-09T17:08:19.025 INFO:teuthology.orchestra.run.smithi121.stdout: "op_mask": "read, write, delete", 2019-12-09T17:08:19.025 INFO:teuthology.orchestra.run.smithi121.stdout: "default_placement": "", 2019-12-09T17:08:19.025 INFO:teuthology.orchestra.run.smithi121.stdout: "default_storage_class": "", 2019-12-09T17:08:19.026 INFO:teuthology.orchestra.run.smithi121.stdout: "placement_tags": [], 2019-12-09T17:08:19.026 INFO:teuthology.orchestra.run.smithi121.stdout: "bucket_quota": { 2019-12-09T17:08:19.026 INFO:teuthology.orchestra.run.smithi121.stdout: "enabled": false, 2019-12-09T17:08:19.026 INFO:teuthology.orchestra.run.smithi121.stdout: "check_on_raw": false, 2019-12-09T17:08:19.026 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size": -1, 2019-12-09T17:08:19.026 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size_kb": 0, 2019-12-09T17:08:19.026 INFO:teuthology.orchestra.run.smithi121.stdout: "max_objects": -1 2019-12-09T17:08:19.027 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2019-12-09T17:08:19.027 INFO:teuthology.orchestra.run.smithi121.stdout: "user_quota": { 2019-12-09T17:08:19.027 INFO:teuthology.orchestra.run.smithi121.stdout: "enabled": false, 2019-12-09T17:08:19.027 INFO:teuthology.orchestra.run.smithi121.stdout: "check_on_raw": false, 2019-12-09T17:08:19.027 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size": -1, 2019-12-09T17:08:19.027 INFO:teuthology.orchestra.run.smithi121.stdout: "max_size_kb": 0, 2019-12-09T17:08:19.027 INFO:teuthology.orchestra.run.smithi121.stdout: "max_objects": -1 2019-12-09T17:08:19.027 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2019-12-09T17:08:19.028 INFO:teuthology.orchestra.run.smithi121.stdout: "temp_url_keys": [], 2019-12-09T17:08:19.028 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "rgw", 2019-12-09T17:08:19.028 INFO:teuthology.orchestra.run.smithi121.stdout: "mfa_ids": [] 2019-12-09T17:08:19.028 INFO:teuthology.orchestra.run.smithi121.stdout:} 2019-12-09T17:08:19.028 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T17:08:19.083 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:19.081+0000 7fc068ecfec0 20 remove_watcher() i=0 2019-12-09T17:08:19.083 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:19.081+0000 7fc068ecfec0 2 removed watcher, disabling cache 2019-12-09T17:08:19.128 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:19.126+0000 7fc068ecfec0 20 remove_watcher() i=1 2019-12-09T17:08:19.172 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:19.170+0000 7fc068ecfec0 20 remove_watcher() i=2 2019-12-09T17:08:19.235 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:19.233+0000 7fc068ecfec0 20 remove_watcher() i=3 2019-12-09T17:08:19.289 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:19.288+0000 7fc068ecfec0 20 remove_watcher() i=4 2019-12-09T17:08:19.347 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:19.345+0000 7fc068ecfec0 20 remove_watcher() i=5 2019-12-09T17:08:19.394 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:19.393+0000 7fc068ecfec0 20 remove_watcher() i=6 2019-12-09T17:08:19.441 INFO:teuthology.orchestra.run.smithi121.stderr:2019-12-09T17:08:19.440+0000 7fc068ecfec0 20 remove_watcher() i=7 2019-12-09T17:08:19.449 INFO:tasks.swift:Configuring testswift... 2019-12-09T17:08:19.449 INFO:teuthology.orchestra.run.smithi121:> cd /home/ubuntu/cephtest/swift && ./bootstrap 2019-12-09T17:08:21.883 INFO:teuthology.orchestra.run.smithi121.stdout:New python executable in /home/ubuntu/cephtest/swift/virtualenv/bin/python 2019-12-09T17:08:23.118 INFO:teuthology.orchestra.run.smithi121.stdout:Installing setuptools, pip, wheel...done. 2019-12-09T17:08:23.448 INFO:teuthology.orchestra.run.smithi121.stderr:Cache entry deserialization failed, entry ignored 2019-12-09T17:08:23.610 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting pip 2019-12-09T17:08:23.730 INFO:teuthology.orchestra.run.smithi121.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-12-09T17:08:23.795 INFO:teuthology.orchestra.run.smithi121.stdout:Installing collected packages: pip 2019-12-09T17:08:23.796 INFO:teuthology.orchestra.run.smithi121.stdout: Found existing installation: pip 9.0.1 2019-12-09T17:08:23.855 INFO:teuthology.orchestra.run.smithi121.stdout: Uninstalling pip-9.0.1: 2019-12-09T17:08:23.898 INFO:teuthology.orchestra.run.smithi121.stdout: Successfully uninstalled pip-9.0.1 2019-12-09T17:08:24.480 INFO:teuthology.orchestra.run.smithi121.stdout:Successfully installed pip-19.3.1 2019-12-09T17:08:24.803 INFO:teuthology.orchestra.run.smithi121.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-09T17:08:25.394 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting setuptools==32.3.1 2019-12-09T17:08:25.397 INFO:teuthology.orchestra.run.smithi121.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-12-09T17:08:25.452 INFO:teuthology.orchestra.run.smithi121.stdout:Installing collected packages: setuptools 2019-12-09T17:08:25.452 INFO:teuthology.orchestra.run.smithi121.stdout: Found existing installation: setuptools 28.8.0 2019-12-09T17:08:25.476 INFO:teuthology.orchestra.run.smithi121.stdout: Uninstalling setuptools-28.8.0: 2019-12-09T17:08:25.490 INFO:teuthology.orchestra.run.smithi121.stdout: Successfully uninstalled setuptools-28.8.0 2019-12-09T17:08:25.665 INFO:teuthology.orchestra.run.smithi121.stdout:Successfully installed setuptools-32.3.1 2019-12-09T17:08:26.094 INFO:teuthology.orchestra.run.smithi121.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-09T17:08:26.297 INFO:teuthology.orchestra.run.smithi121.stdout:Processing /home/ubuntu/.cache/pip/wheels/54/b7/c7/2ada654ee54483c9329871665aaf4a6056c3ce36f29cf66e67/PyYAML-5.2-cp27-cp27mu-linux_x86_64.whl 2019-12-09T17:08:26.360 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting nose>=1.0.0 2019-12-09T17:08:26.362 INFO:teuthology.orchestra.run.smithi121.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-12-09T17:08:26.467 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting boto>=2.0b4 2019-12-09T17:08:26.474 INFO:teuthology.orchestra.run.smithi121.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-12-09T17:08:26.611 INFO:teuthology.orchestra.run.smithi121.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-12-09T17:08:26.901 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting gevent>=0.14 2019-12-09T17:08:26.916 INFO:teuthology.orchestra.run.smithi121.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-09T17:08:27.147 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting isodate>=0.4.4 2019-12-09T17:08:27.149 INFO:teuthology.orchestra.run.smithi121.stdout: Using cached https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl 2019-12-09T17:08:27.216 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting eventlet>=0.9.14 2019-12-09T17:08:27.265 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/ef/01/83454d11bac9015f34e93cf11efcae169390ddf2df97cb73ca86de6465ed/eventlet-0.25.1-py2.py3-none-any.whl (222kB) 2019-12-09T17:08:27.457 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting netifaces>=0.5 2019-12-09T17:08:27.468 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/7e/02/ad1a92a72620cc17d448fe4dbdfbdf8fe1487ee7bfd82bb48308712c2f3c/netifaces-0.10.9-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-09T17:08:27.564 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting xattr<0.7.0,>=0.6 2019-12-09T17:08:27.575 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/c5/80/b25d549ae4bf4f3e9635a331b759ffca2de4dd8a78dc5106d1ca92f5d08d/xattr-0.6.4.tar.gz 2019-12-09T17:08:27.958 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting simplejson>=2.1.3 2019-12-09T17:08:27.968 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/98/87/a7b98aa9256c8843f92878966dc3d8d914c14aad97e2c5ce4798d5743e07/simplejson-3.17.0.tar.gz (83kB) 2019-12-09T17:08:28.325 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting WebOb==1.0 2019-12-09T17:08:28.337 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/bc/eb/91b8dd8f3a8d3c3943bf27a2d322501ad8b227bf29f59e792c2eae092bc9/WebOb-1.0.tar.gz (210kB) 2019-12-09T17:08:28.802 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-12-09T17:08:28.805 INFO:teuthology.orchestra.run.smithi121.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-09T17:08:28.871 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting six 2019-12-09T17:08:28.874 INFO:teuthology.orchestra.run.smithi121.stdout: Using cached https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-12-09T17:08:28.933 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting monotonic>=1.4 2019-12-09T17:08:28.944 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/ac/aa/063eca6a416f397bd99552c534c6d11d57f58f2e94c14780f3bbf818c4cf/monotonic-1.5-py2.py3-none-any.whl 2019-12-09T17:08:29.032 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting dnspython>=1.15.0 2019-12-09T17:08:29.043 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/ec/d3/3aa0e7213ef72b8585747aa0e271a9523e713813b9a20177ebe1e939deb0/dnspython-1.16.0-py2.py3-none-any.whl (188kB) 2019-12-09T17:08:29.180 INFO:teuthology.orchestra.run.smithi121.stdout:Collecting enum34; python_version < "3.4" 2019-12-09T17:08:29.191 INFO:teuthology.orchestra.run.smithi121.stdout: Downloading https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl 2019-12-09T17:08:29.220 INFO:teuthology.orchestra.run.smithi121.stdout:Building wheels for collected packages: xattr, simplejson, WebOb 2019-12-09T17:08:29.220 INFO:teuthology.orchestra.run.smithi121.stdout: Building wheel for xattr (setup.py): started 2019-12-09T17:08:29.790 INFO:teuthology.orchestra.run.smithi121.stdout: Building wheel for xattr (setup.py): finished with status 'done' 2019-12-09T17:08:29.791 INFO:teuthology.orchestra.run.smithi121.stdout: Created wheel for xattr: filename=xattr-0.6.4-cp27-cp27mu-linux_x86_64.whl size=24116 sha256=bdded7d8695eeafe997c5c929f45b467d6f0cea30eca0c30567663390a2bb08f 2019-12-09T17:08:29.791 INFO:teuthology.orchestra.run.smithi121.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/cb/2c/40/ea48345a21b521cdacebf61db13e3bf0c42c77ec664e3fe9e5 2019-12-09T17:08:29.797 INFO:teuthology.orchestra.run.smithi121.stdout: Building wheel for simplejson (setup.py): started 2019-12-09T17:08:30.859 INFO:teuthology.orchestra.run.smithi121.stdout: Building wheel for simplejson (setup.py): finished with status 'done' 2019-12-09T17:08:30.859 INFO:teuthology.orchestra.run.smithi121.stdout: Created wheel for simplejson: filename=simplejson-3.17.0-cp27-cp27mu-linux_x86_64.whl size=113120 sha256=66d2894ec7188e315cf604186c8ea5abf6d5e1e1b6f8624c55c4528c0c1646c1 2019-12-09T17:08:30.860 INFO:teuthology.orchestra.run.smithi121.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/86/c0/83/dcd0339abb2640544bb8e0938aab2d069cef55e5647ce6e097 2019-12-09T17:08:30.875 INFO:teuthology.orchestra.run.smithi121.stdout: Building wheel for WebOb (setup.py): started 2019-12-09T17:08:31.162 INFO:teuthology.orchestra.run.smithi121.stdout: Building wheel for WebOb (setup.py): finished with status 'done' 2019-12-09T17:08:31.163 INFO:teuthology.orchestra.run.smithi121.stdout: Created wheel for WebOb: filename=WebOb-1.0-cp27-none-any.whl size=58478 sha256=6a7d293d4283d866bfcf7c75417dee7540317a3bddd334f61a62a90ff6c6fcec 2019-12-09T17:08:31.163 INFO:teuthology.orchestra.run.smithi121.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/30/41/c0/8ff9e679d72e05f355e6e2ec87d026131538c953a3b12496eb 2019-12-09T17:08:31.181 INFO:teuthology.orchestra.run.smithi121.stdout:Successfully built xattr simplejson WebOb 2019-12-09T17:08:31.262 INFO:teuthology.orchestra.run.smithi121.stdout:Installing collected packages: PyYAML, nose, boto, bunch, greenlet, gevent, six, isodate, monotonic, dnspython, enum34, eventlet, netifaces, xattr, simplejson, WebOb 2019-12-09T17:08:32.756 INFO:teuthology.orchestra.run.smithi121.stdout:Successfully installed PyYAML-5.2 WebOb-1.0 boto-2.49.0 bunch-1.0.1 dnspython-1.16.0 enum34-1.1.6 eventlet-0.25.1 gevent-1.4.0 greenlet-0.4.15 isodate-0.6.0 monotonic-1.5 netifaces-0.10.9 nose-1.3.7 simplejson-3.17.0 six-1.13.0 xattr-0.6.4 2019-12-09T17:08:33.104 INFO:teuthology.orchestra.run.smithi121.stdout:running develop 2019-12-09T17:08:33.149 INFO:teuthology.orchestra.run.smithi121.stdout:running egg_info 2019-12-09T17:08:33.150 INFO:teuthology.orchestra.run.smithi121.stdout:creating swift.egg-info 2019-12-09T17:08:33.150 INFO:teuthology.orchestra.run.smithi121.stdout:writing swift.egg-info/PKG-INFO 2019-12-09T17:08:33.150 INFO:teuthology.orchestra.run.smithi121.stdout:writing top-level names to swift.egg-info/top_level.txt 2019-12-09T17:08:33.150 INFO:teuthology.orchestra.run.smithi121.stdout:writing dependency_links to swift.egg-info/dependency_links.txt 2019-12-09T17:08:33.154 INFO:teuthology.orchestra.run.smithi121.stdout:writing entry points to swift.egg-info/entry_points.txt 2019-12-09T17:08:33.154 INFO:teuthology.orchestra.run.smithi121.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-12-09T17:08:33.157 INFO:teuthology.orchestra.run.smithi121.stdout:reading manifest file 'swift.egg-info/SOURCES.txt' 2019-12-09T17:08:33.158 INFO:teuthology.orchestra.run.smithi121.stdout:reading manifest template 'MANIFEST.in' 2019-12-09T17:08:33.158 INFO:teuthology.orchestra.run.smithi121.stderr:warning: no files found matching 'ChangeLog' 2019-12-09T17:08:33.161 INFO:teuthology.orchestra.run.smithi121.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-12-09T17:08:33.162 INFO:teuthology.orchestra.run.smithi121.stdout:running build_ext 2019-12-09T17:08:33.162 INFO:teuthology.orchestra.run.smithi121.stdout:Creating /home/ubuntu/cephtest/swift/virtualenv/lib/python2.7/site-packages/swift.egg-link (link to .) 2019-12-09T17:08:33.163 INFO:teuthology.orchestra.run.smithi121.stdout:Adding swift 1.4.4 to easy-install.pth file 2019-12-09T17:08:33.178 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.179 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-account-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.182 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-account-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.183 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-account-reaper script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.183 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-account-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.184 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-account-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.185 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-container-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.186 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-container-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.186 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-container-sync script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.187 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-container-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.188 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-container-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.189 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-drive-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.190 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-get-nodes script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.191 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-init script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.192 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-object-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.193 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-object-expirer script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.194 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-object-info script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.195 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-object-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.196 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-object-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.197 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-object-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.197 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-proxy-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.201 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-ring-builder script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.203 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-stats-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.209 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-stats-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.210 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-dispersion-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.212 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-dispersion-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.213 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-bench script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.216 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-recon script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.217 INFO:teuthology.orchestra.run.smithi121.stdout:Installing swift-recon-cron script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-09T17:08:33.217 INFO:teuthology.orchestra.run.smithi121.stdout: 2019-12-09T17:08:33.217 INFO:teuthology.orchestra.run.smithi121.stdout:Installed /home/ubuntu/cephtest/swift 2019-12-09T17:08:33.218 INFO:teuthology.orchestra.run.smithi121.stdout:Processing dependencies for swift==1.4.4 2019-12-09T17:08:33.218 INFO:teuthology.orchestra.run.smithi121.stdout:Finished processing dependencies for swift==1.4.4 2019-12-09T17:08:33.229 INFO:teuthology.orchestra.run.smithi121:> cat > /home/ubuntu/cephtest/archive/testswift.client.0.conf 2019-12-09T17:08:33.298 INFO:teuthology.orchestra.run.smithi121:> SWIFT_TEST_CONFIG_FILE=/home/ubuntu/cephtest/archive/testswift.client.0.conf /home/ubuntu/cephtest/swift/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/swift/test/functional -v -a '!fails_on_rgw' 2019-12-09T17:09:07.625 INFO:teuthology.orchestra.run.smithi121.stderr:testAccountHead (test.functional.tests.TestAccount) ... ok 2019-12-09T17:09:20.005 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerListing (test.functional.tests.TestAccount) ... ok 2019-12-09T17:11:37.765 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:32:35.792 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:37.787 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:32:35.815 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:37.789 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:32:35.816 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:37.818 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:32:35.783 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:37.822 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:32:35.787 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:37.842 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:32:35.869 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:37.920 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:32:35.948 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:37.956 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:32:35.921 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:37.979 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:32:36.007 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:56.507 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:32:54.535 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:56.512 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:32:54.540 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:56.526 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:32:54.553 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:56.531 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:32:54.559 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:56.531 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:32:54.497 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:56.537 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:32:54.503 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:56.561 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:32:54.588 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:56.562 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:32:54.591 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:11:56.584 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:32:54.550 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:13:46.963 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerSerializedInfo (test.functional.tests.TestAccount) ... ok 2019-12-09T17:14:00.107 INFO:teuthology.orchestra.run.smithi121.stderr:testContainersOrderedByName (test.functional.tests.TestAccount) ... ok 2019-12-09T17:14:04.403 INFO:teuthology.orchestra.run.smithi121.stderr:testInvalidAuthToken (test.functional.tests.TestAccount) ... ok 2019-12-09T17:14:22.029 INFO:teuthology.orchestra.run.smithi121.stderr:testLastContainerMarker (test.functional.tests.TestAccount) ... ok 2019-12-09T17:14:45.355 INFO:teuthology.orchestra.run.smithi121.stderr:testListingLimit (test.functional.tests.TestAccount) ... ok 2019-12-09T17:15:49.493 INFO:teuthology.orchestra.run.smithi121.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccount) ... ok 2019-12-09T17:15:49.767 INFO:teuthology.orchestra.run.smithi121.stderr:testPUT (test.functional.tests.TestAccount) ... ok 2019-12-09T17:17:06.710 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:38:04.738 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:17:06.715 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:38:04.743 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:17:06.743 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:38:04.709 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:17:06.749 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:38:04.715 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:17:06.772 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:38:04.800 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:17:06.776 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:38:04.804 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:17:06.912 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:38:04.940 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:17:06.956 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:38:04.983 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:17:07.045 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:38:05.011 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:59.484 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:40:57.512 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:59.525 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:40:57.553 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:59.552 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:40:57.580 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:59.553 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:40:57.581 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:59.569 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:40:57.535 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:59.573 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:40:57.538 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:59.631 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:40:57.659 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:59.642 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:40:57.671 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:19:59.683 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:40:57.649 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:22:18.055 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:43:16.083 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:22:18.065 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:43:16.093 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:22:18.074 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:43:16.102 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:22:18.088 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:43:16.054 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:22:18.090 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:43:16.118 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:22:18.099 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:43:16.065 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:22:18.183 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:43:16.211 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:22:18.189 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:43:16.217 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:22:18.248 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:43:16.210 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:22:42.852 INFO:teuthology.orchestra.run.smithi121.stderr:testGetRequest (test.functional.tests.TestAccountNoContainers) ... ok 2019-12-09T17:22:47.453 INFO:teuthology.orchestra.run.smithi121.stderr:testGetRequest (test.functional.tests.TestAccountNoContainersUTF8) ... ok 2019-12-09T17:23:21.117 INFO:teuthology.orchestra.run.smithi121.stderr:testAccountHead (test.functional.tests.TestAccountUTF8) ... ok 2019-12-09T17:23:36.901 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerListing (test.functional.tests.TestAccountUTF8) ... ok 2019-12-09T17:27:30.966 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:48:28.994 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:27:30.985 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:48:29.006 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:27:30.986 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:48:29.014 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:27:30.990 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:48:29.018 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:27:31.000 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:48:28.965 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:27:31.009 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:48:28.975 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:27:31.165 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:48:29.193 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:27:31.226 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:48:29.254 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:27:31.255 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:48:29.220 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:28:21.178 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:49:19.206 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:28:21.230 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:49:19.258 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:28:21.235 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:49:19.263 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:28:21.246 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:49:19.212 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:28:21.254 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:49:19.219 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:28:21.257 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:49:19.285 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:28:21.289 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:49:19.317 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:28:21.320 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:49:19.285 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:28:21.330 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:49:19.358 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:28:41.302 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerSerializedInfo (test.functional.tests.TestAccountUTF8) ... ok 2019-12-09T17:28:55.087 INFO:teuthology.orchestra.run.smithi121.stderr:testContainersOrderedByName (test.functional.tests.TestAccountUTF8) ... ok 2019-12-09T17:29:00.376 INFO:teuthology.orchestra.run.smithi121.stderr:testInvalidAuthToken (test.functional.tests.TestAccountUTF8) ... ok 2019-12-09T17:29:18.699 INFO:teuthology.orchestra.run.smithi121.stderr:testLastContainerMarker (test.functional.tests.TestAccountUTF8) ... ok 2019-12-09T17:29:42.373 INFO:teuthology.orchestra.run.smithi121.stderr:testListingLimit (test.functional.tests.TestAccountUTF8) ... ok 2019-12-09T17:30:31.808 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:51:29.836 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:31.850 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:51:29.878 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:31.874 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:51:29.902 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:31.875 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:51:29.904 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:31.897 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:51:29.863 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:31.936 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:51:29.964 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:31.940 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:51:29.906 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:31.996 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:51:30.024 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:30:32.134 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:51:30.099 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:31:28.725 INFO:teuthology.orchestra.run.smithi121.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccountUTF8) ... ok 2019-12-09T17:31:29.200 INFO:teuthology.orchestra.run.smithi121.stderr:testPUT (test.functional.tests.TestAccountUTF8) ... ok 2019-12-09T17:32:42.350 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:53:40.379 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:32:42.355 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:53:40.384 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:32:42.377 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:53:40.343 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:32:42.386 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:53:40.349 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:32:42.387 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:53:40.415 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:32:42.391 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:53:40.420 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:32:42.447 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:53:40.475 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:32:42.477 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:53:40.442 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:32:42.490 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:53:40.517 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:36:43.161 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:57:41.189 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:36:43.174 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:57:41.198 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:36:43.198 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:57:41.164 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:36:43.223 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:57:41.188 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:36:43.234 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:57:41.262 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:36:43.236 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:57:41.265 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:36:43.275 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:57:41.303 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:36:43.321 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:57:41.286 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:36:43.379 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:57:41.407 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:37:54.458 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:58:52.486 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:37:54.466 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:58:52.491 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:37:54.475 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:58:52.504 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:37:54.477 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:58:52.443 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:37:54.479 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:58:52.508 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:37:54.483 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:58:52.448 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:37:54.529 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:07:58:52.557 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:37:54.554 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:07:58:52.520 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:37:54.560 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:07:58:52.588 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:39:03.701 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainer) ... ok 2019-12-09T17:39:08.030 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerFileList (test.functional.tests.TestContainer) ... ok 2019-12-09T17:39:10.870 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-12-09T17:39:15.598 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainer) ... ok 2019-12-09T17:39:16.353 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerInfo (test.functional.tests.TestContainer) ... ok 2019-12-09T17:39:16.820 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-12-09T17:39:28.408 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerNameLimit (test.functional.tests.TestContainer) ... ok 2019-12-09T17:39:37.049 INFO:teuthology.orchestra.run.smithi121.stderr:testCreate (test.functional.tests.TestContainer) ... ok 2019-12-09T17:39:48.423 INFO:teuthology.orchestra.run.smithi121.stderr:testDelete (test.functional.tests.TestContainer) ... ok 2019-12-09T17:39:49.621 INFO:teuthology.orchestra.run.smithi121.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-12-09T17:39:57.132 INFO:teuthology.orchestra.run.smithi121.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainer) ... ok 2019-12-09T17:39:57.666 INFO:teuthology.orchestra.run.smithi121.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-12-09T17:41:46.517 INFO:teuthology.orchestra.run.smithi121.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainer) ... ok 2019-12-09T17:41:48.402 INFO:teuthology.orchestra.run.smithi121.stderr:testFileOrder (test.functional.tests.TestContainer) ... ok 2019-12-09T17:42:03.608 INFO:teuthology.orchestra.run.smithi121.stderr:testFileThenContainerDelete (test.functional.tests.TestContainer) ... ok 2019-12-09T17:42:08.689 INFO:teuthology.orchestra.run.smithi121.stderr:testLastFileMarker (test.functional.tests.TestContainer) ... ok 2019-12-09T17:42:45.954 INFO:teuthology.orchestra.run.smithi121.stderr:testMarkerLimitFileList (test.functional.tests.TestContainer) ... ok 2019-12-09T17:42:55.881 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:42:55.872+0000 1694f700 -1 osd.5 136 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:42:15.041003+0000 front 2019-12-09T17:42:11.699800+0000 (oldest deadline 2019-12-09T17:42:55.015875+0000) 2019-12-09T17:42:56.124 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:42:56.113+0000 1694f700 -1 osd.6 136 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:42:10.639050+0000 front 2019-12-09T17:42:10.257104+0000 (oldest deadline 2019-12-09T17:42:55.084607+0000) 2019-12-09T17:42:56.162 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:42:56.136+0000 1694f700 -1 osd.0 136 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:42:14.521860+0000 front 2019-12-09T17:42:14.520883+0000 (oldest deadline 2019-12-09T17:42:55.617201+0000) 2019-12-09T17:42:56.273 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:42:56.262+0000 1694f700 -1 osd.1 136 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:42:13.689850+0000 front 2019-12-09T17:42:13.376270+0000 (oldest deadline 2019-12-09T17:42:55.665069+0000) 2019-12-09T17:42:56.862 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:42:56.849+0000 1694f700 -1 osd.5 136 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:42:15.041003+0000 front 2019-12-09T17:42:11.699800+0000 (oldest deadline 2019-12-09T17:42:55.015875+0000) 2019-12-09T17:42:57.091 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:42:57.086+0000 1694f700 -1 osd.6 136 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:42:10.639050+0000 front 2019-12-09T17:42:10.257104+0000 (oldest deadline 2019-12-09T17:42:55.084607+0000) 2019-12-09T17:42:57.209 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:42:57.204+0000 1694f700 -1 osd.0 136 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:42:14.521860+0000 front 2019-12-09T17:42:14.520883+0000 (oldest deadline 2019-12-09T17:42:55.617201+0000) 2019-12-09T17:42:57.255 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:42:57.251+0000 1694f700 -1 osd.1 136 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:42:13.689850+0000 front 2019-12-09T17:42:13.376270+0000 (oldest deadline 2019-12-09T17:42:55.665069+0000) 2019-12-09T17:42:57.417 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:42:57.405+0000 1694f700 -1 osd.4 136 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:42:11.896640+0000 front 2019-12-09T17:42:11.863979+0000 (oldest deadline 2019-12-09T17:42:56.543613+0000) 2019-12-09T17:42:57.902 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:42:57.898+0000 1694f700 -1 osd.5 136 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:42:15.041003+0000 front 2019-12-09T17:42:11.699800+0000 (oldest deadline 2019-12-09T17:42:55.015875+0000) 2019-12-09T17:42:58.092 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:42:58.088+0000 1694f700 -1 osd.6 136 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:42:10.639050+0000 front 2019-12-09T17:42:10.257104+0000 (oldest deadline 2019-12-09T17:42:55.084607+0000) 2019-12-09T17:42:58.216 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:42:58.212+0000 1694f700 -1 osd.0 136 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:42:14.521860+0000 front 2019-12-09T17:42:14.520883+0000 (oldest deadline 2019-12-09T17:42:55.617201+0000) 2019-12-09T17:42:58.239 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:42:58.237+0000 1694f700 -1 osd.1 136 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:42:13.689850+0000 front 2019-12-09T17:42:13.376270+0000 (oldest deadline 2019-12-09T17:42:55.665069+0000) 2019-12-09T17:43:00.457 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:03:58.485 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:43:00.462 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:03:58.490 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:43:00.483 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:03:58.448 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:43:00.490 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:03:58.455 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:43:00.513 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:03:58.541 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:43:00.519 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:03:58.547 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:43:00.711 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:03:58.676 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:43:00.868 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:03:58.896 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:43:00.903 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:03:58.927 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:43:51.755 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:43:51.750+0000 1694f700 -1 osd.2 143 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e141) 2019-12-09T17:43:52.724 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:43:52.723+0000 1694f700 -1 osd.2 143 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e141) 2019-12-09T17:43:53.764 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:43:53.763+0000 1694f700 -1 osd.2 143 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e141) 2019-12-09T17:43:54.008 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:43:54.004+0000 1694f700 -1 osd.1 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:13.894908+0000 front 2019-12-09T17:43:08.760109+0000 (oldest deadline 2019-12-09T17:43:53.479778+0000) 2019-12-09T17:43:54.155 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:43:54.145+0000 1694f700 -1 osd.7 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:12.365987+0000 front 2019-12-09T17:43:09.287627+0000 (oldest deadline 2019-12-09T17:43:53.863615+0000) 2019-12-09T17:43:54.757 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:43:54.755+0000 1694f700 -1 osd.2 143 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e141) 2019-12-09T17:43:54.982 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:43:54.980+0000 1694f700 -1 osd.1 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:13.894908+0000 front 2019-12-09T17:43:08.760109+0000 (oldest deadline 2019-12-09T17:43:53.479778+0000) 2019-12-09T17:43:55.124 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:43:55.117+0000 1694f700 -1 osd.0 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:14.623543+0000 front 2019-12-09T17:43:09.454581+0000 (oldest deadline 2019-12-09T17:43:54.420805+0000) 2019-12-09T17:43:55.130 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:43:55.120+0000 1694f700 -1 osd.7 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:12.365987+0000 front 2019-12-09T17:43:09.287627+0000 (oldest deadline 2019-12-09T17:43:53.863615+0000) 2019-12-09T17:43:55.745 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:43:55.742+0000 1694f700 -1 osd.2 143 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e141) 2019-12-09T17:43:55.885 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:43:55.874+0000 1694f700 -1 osd.3 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:12.659956+0000 front 2019-12-09T17:43:11.807575+0000 (oldest deadline 2019-12-09T17:43:55.750448+0000) 2019-12-09T17:43:55.967 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:43:55.964+0000 1694f700 -1 osd.1 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:13.894908+0000 front 2019-12-09T17:43:08.760109+0000 (oldest deadline 2019-12-09T17:43:53.479778+0000) 2019-12-09T17:43:56.053 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:43:56.049+0000 1694f700 -1 osd.4 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:13.443057+0000 front 2019-12-09T17:43:12.843857+0000 (oldest deadline 2019-12-09T17:43:55.271858+0000) 2019-12-09T17:43:56.100 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:43:56.098+0000 1694f700 -1 osd.0 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:14.623543+0000 front 2019-12-09T17:43:09.454581+0000 (oldest deadline 2019-12-09T17:43:54.420805+0000) 2019-12-09T17:43:56.153 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:43:56.145+0000 1694f700 -1 osd.7 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:12.365987+0000 front 2019-12-09T17:43:09.287627+0000 (oldest deadline 2019-12-09T17:43:53.863615+0000) 2019-12-09T17:43:56.722 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:43:56.719+0000 1694f700 -1 osd.2 143 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e141) 2019-12-09T17:43:56.853 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:43:56.840+0000 1694f700 -1 osd.3 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:12.659956+0000 front 2019-12-09T17:43:11.807575+0000 (oldest deadline 2019-12-09T17:43:55.750448+0000) 2019-12-09T17:43:57.016 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:43:57.012+0000 1694f700 -1 osd.1 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:13.894908+0000 front 2019-12-09T17:43:08.760109+0000 (oldest deadline 2019-12-09T17:43:53.479778+0000) 2019-12-09T17:43:57.018 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:43:57.014+0000 1694f700 -1 osd.4 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:13.443057+0000 front 2019-12-09T17:43:12.843857+0000 (oldest deadline 2019-12-09T17:43:55.271858+0000) 2019-12-09T17:43:57.123 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:43:57.119+0000 1694f700 -1 osd.0 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:14.623543+0000 front 2019-12-09T17:43:09.454581+0000 (oldest deadline 2019-12-09T17:43:54.420805+0000) 2019-12-09T17:43:57.125 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:43:57.121+0000 1694f700 -1 osd.7 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:12.365987+0000 front 2019-12-09T17:43:09.287627+0000 (oldest deadline 2019-12-09T17:43:53.863615+0000) 2019-12-09T17:43:57.541 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:43:57.537+0000 1694f700 -1 osd.6 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:15.307882+0000 front 2019-12-09T17:43:12.847257+0000 (oldest deadline 2019-12-09T17:43:56.814604+0000) 2019-12-09T17:43:57.702 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:43:57.684+0000 1694f700 -1 osd.2 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:43:16.894576+0000 (oldest deadline 2019-12-09T17:43:56.894576+0000) 2019-12-09T17:43:57.708 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:43:57.700+0000 1694f700 -1 osd.2 143 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e141) 2019-12-09T17:43:57.899 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:43:57.894+0000 1694f700 -1 osd.3 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:12.659956+0000 front 2019-12-09T17:43:11.807575+0000 (oldest deadline 2019-12-09T17:43:55.750448+0000) 2019-12-09T17:43:57.974 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:43:57.971+0000 1694f700 -1 osd.1 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:13.894908+0000 front 2019-12-09T17:43:08.760109+0000 (oldest deadline 2019-12-09T17:43:53.479778+0000) 2019-12-09T17:43:57.976 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:43:57.971+0000 1694f700 -1 osd.4 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:13.443057+0000 front 2019-12-09T17:43:12.843857+0000 (oldest deadline 2019-12-09T17:43:55.271858+0000) 2019-12-09T17:43:58.089 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:43:58.079+0000 1694f700 -1 osd.7 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:12.365987+0000 front 2019-12-09T17:43:09.287627+0000 (oldest deadline 2019-12-09T17:43:53.863615+0000) 2019-12-09T17:43:58.091 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:43:58.087+0000 1694f700 -1 osd.0 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:14.623543+0000 front 2019-12-09T17:43:09.454581+0000 (oldest deadline 2019-12-09T17:43:54.420805+0000) 2019-12-09T17:43:58.581 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:43:58.577+0000 1694f700 -1 osd.6 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:15.307882+0000 front 2019-12-09T17:43:12.847257+0000 (oldest deadline 2019-12-09T17:43:56.814604+0000) 2019-12-09T17:43:58.674 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:43:58.670+0000 1694f700 -1 osd.2 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:43:16.894576+0000 (oldest deadline 2019-12-09T17:43:56.894576+0000) 2019-12-09T17:43:58.676 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:43:58.674+0000 1694f700 -1 osd.2 143 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e141) 2019-12-09T17:43:58.940 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:43:58.936+0000 1694f700 -1 osd.3 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:12.659956+0000 front 2019-12-09T17:43:11.807575+0000 (oldest deadline 2019-12-09T17:43:55.750448+0000) 2019-12-09T17:43:58.973 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:43:58.969+0000 1694f700 -1 osd.4 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:13.443057+0000 front 2019-12-09T17:43:12.843857+0000 (oldest deadline 2019-12-09T17:43:55.271858+0000) 2019-12-09T17:43:59.016 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:43:59.001+0000 1694f700 -1 osd.1 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:13.894908+0000 front 2019-12-09T17:43:08.760109+0000 (oldest deadline 2019-12-09T17:43:53.479778+0000) 2019-12-09T17:43:59.062 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:43:59.058+0000 1694f700 -1 osd.0 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:14.623543+0000 front 2019-12-09T17:43:09.454581+0000 (oldest deadline 2019-12-09T17:43:54.420805+0000) 2019-12-09T17:43:59.065 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:43:59.060+0000 1694f700 -1 osd.7 143 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:43:12.365987+0000 front 2019-12-09T17:43:09.287627+0000 (oldest deadline 2019-12-09T17:43:53.863615+0000) 2019-12-09T17:45:04.790 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:06:02.817 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:04.837 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:06:02.864 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:04.839 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:06:02.866 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:04.842 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:06:02.870 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:04.874 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:06:02.839 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:04.877 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:06:02.842 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:04.978 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:06:03.006 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:04.987 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:06:03.015 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:05.001 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:06:02.966 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:45:41.874 INFO:teuthology.orchestra.run.smithi121.stderr:testPrefixAndLimit (test.functional.tests.TestContainer) ... ok 2019-12-09T17:45:42.440 INFO:teuthology.orchestra.run.smithi121.stderr:testTooLongName (test.functional.tests.TestContainer) ... ok 2019-12-09T17:46:13.953 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:46:13.947+0000 1694f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:45:28.909605+0000 front 2019-12-09T17:45:28.496343+0000 (oldest deadline 2019-12-09T17:46:13.739782+0000) 2019-12-09T17:46:13.998 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:46:13.993+0000 1694f700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:45:31.485543+0000 front 2019-12-09T17:45:31.658371+0000 (oldest deadline 2019-12-09T17:46:13.700729+0000) 2019-12-09T17:46:14.902 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:46:14.900+0000 1694f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:45:28.909605+0000 front 2019-12-09T17:45:28.496343+0000 (oldest deadline 2019-12-09T17:46:13.739782+0000) 2019-12-09T17:46:14.940 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:46:14.937+0000 1694f700 -1 osd.0 149 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:45:31.862599+0000 front 2019-12-09T17:45:31.789796+0000 (oldest deadline 2019-12-09T17:46:14.233548+0000) 2019-12-09T17:46:14.981 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:46:14.963+0000 1694f700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:45:31.485543+0000 front 2019-12-09T17:45:31.658371+0000 (oldest deadline 2019-12-09T17:46:13.700729+0000) 2019-12-09T17:46:15.403 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:46:15.396+0000 1694f700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:45:29.002469+0000 front 2019-12-09T17:45:29.332590+0000 (oldest deadline 2019-12-09T17:46:14.713518+0000) 2019-12-09T17:46:15.923 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:46:15.920+0000 1694f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:45:28.909605+0000 front 2019-12-09T17:45:28.496343+0000 (oldest deadline 2019-12-09T17:46:13.739782+0000) 2019-12-09T17:46:15.987 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:46:15.985+0000 1694f700 -1 osd.0 149 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:45:31.862599+0000 front 2019-12-09T17:45:31.789796+0000 (oldest deadline 2019-12-09T17:46:14.233548+0000) 2019-12-09T17:46:16.023 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:46:16.018+0000 1694f700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:45:31.485543+0000 front 2019-12-09T17:45:31.658371+0000 (oldest deadline 2019-12-09T17:46:13.700729+0000) 2019-12-09T17:46:16.484 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:46:16.481+0000 1694f700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:45:31.641313+0000 front 2019-12-09T17:45:32.040064+0000 (oldest deadline 2019-12-09T17:46:16.311483+0000) 2019-12-09T17:47:04.167 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:08:02.194 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:47:04.183 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:08:02.211 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:47:04.186 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:08:02.213 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:47:04.189 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:08:02.217 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:47:04.195 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:08:02.160 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:47:04.218 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:08:02.183 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:47:04.318 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:08:02.346 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:47:04.324 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:08:02.351 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:47:04.410 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:08:02.375 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:47:27.211 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:47:27.182+0000 37a7b700 -1 osd.2 154 build_incremental_map_msg missing incremental map 154 2019-12-09T17:47:27.395 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:47:27.389+0000 34a75700 -1 osd.2 154 build_incremental_map_msg missing incremental map 154 2019-12-09T17:47:27.474 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:47:27.406+0000 34274700 -1 osd.2 154 build_incremental_map_msg missing incremental map 154 2019-12-09T17:47:27.519 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:47:27.456+0000 39a7f700 -1 osd.2 154 build_incremental_map_msg missing incremental map 154 2019-12-09T17:47:27.585 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:47:27.527+0000 11caf700 -1 osd.2 154 build_incremental_map_msg missing incremental map 154 2019-12-09T17:47:27.803 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:47:27.552+0000 36a79700 -1 osd.2 154 build_incremental_map_msg missing incremental map 154 2019-12-09T17:47:28.086 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:47:27.967+0000 33a73700 -1 osd.2 154 build_incremental_map_msg missing incremental map 154 2019-12-09T17:47:29.518 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:47:29.405+0000 35a77700 -1 osd.2 155 build_incremental_map_msg missing incremental map 154 2019-12-09T17:47:57.477 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:47:57.473+0000 1694f700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:14.300844+0000 front 2019-12-09T17:47:14.576561+0000 (oldest deadline 2019-12-09T17:47:57.268681+0000) 2019-12-09T17:47:58.471 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:47:58.468+0000 1694f700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:14.300844+0000 front 2019-12-09T17:47:14.576561+0000 (oldest deadline 2019-12-09T17:47:57.268681+0000) 2019-12-09T17:47:59.447 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:47:59.444+0000 1694f700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:14.300844+0000 front 2019-12-09T17:47:14.576561+0000 (oldest deadline 2019-12-09T17:47:57.268681+0000) 2019-12-09T17:47:59.591 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:47:59.587+0000 1694f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e153) 2019-12-09T17:48:00.011 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:48:00.006+0000 1694f700 -1 osd.6 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:15.479008+0000 front 2019-12-09T17:47:15.476780+0000 (oldest deadline 2019-12-09T17:47:59.218636+0000) 2019-12-09T17:48:00.428 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:48:00.424+0000 1694f700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:14.300844+0000 front 2019-12-09T17:47:14.576561+0000 (oldest deadline 2019-12-09T17:47:57.268681+0000) 2019-12-09T17:48:00.553 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:48:00.550+0000 1694f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e153) 2019-12-09T17:48:00.594 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:48:00.590+0000 1694f700 -1 osd.1 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:18.222951+0000 front 2019-12-09T17:47:18.217872+0000 (oldest deadline 2019-12-09T17:48:00.126588+0000) 2019-12-09T17:48:01.028 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:48:01.025+0000 1694f700 -1 osd.6 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:15.479008+0000 front 2019-12-09T17:47:15.476780+0000 (oldest deadline 2019-12-09T17:47:59.218636+0000) 2019-12-09T17:48:01.345 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:48:01.341+0000 1694f700 -1 osd.0 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:16.705512+0000 front 2019-12-09T17:47:16.704163+0000 (oldest deadline 2019-12-09T17:48:00.460063+0000) 2019-12-09T17:48:01.397 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:48:01.393+0000 1694f700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:14.300844+0000 front 2019-12-09T17:47:14.576561+0000 (oldest deadline 2019-12-09T17:47:57.268681+0000) 2019-12-09T17:48:01.517 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:48:01.515+0000 1694f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e153) 2019-12-09T17:48:01.560 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:48:01.557+0000 1694f700 -1 osd.1 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:18.222951+0000 front 2019-12-09T17:47:18.217872+0000 (oldest deadline 2019-12-09T17:48:00.126588+0000) 2019-12-09T17:48:02.013 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:48:02.009+0000 1694f700 -1 osd.6 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:15.479008+0000 front 2019-12-09T17:47:15.476780+0000 (oldest deadline 2019-12-09T17:47:59.218636+0000) 2019-12-09T17:48:02.078 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:48:02.073+0000 1694f700 -1 osd.3 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:18.479261+0000 front 2019-12-09T17:47:16.688229+0000 (oldest deadline 2019-12-09T17:48:01.671257+0000) 2019-12-09T17:48:02.339 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:48:02.335+0000 1694f700 -1 osd.0 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:16.705512+0000 front 2019-12-09T17:47:16.704163+0000 (oldest deadline 2019-12-09T17:48:00.460063+0000) 2019-12-09T17:48:02.424 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:48:02.420+0000 1694f700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:14.300844+0000 front 2019-12-09T17:47:14.576561+0000 (oldest deadline 2019-12-09T17:47:57.268681+0000) 2019-12-09T17:48:02.520 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:48:02.516+0000 1694f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e153) 2019-12-09T17:48:02.541 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:48:02.536+0000 1694f700 -1 osd.1 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:18.222951+0000 front 2019-12-09T17:47:18.217872+0000 (oldest deadline 2019-12-09T17:48:00.126588+0000) 2019-12-09T17:48:03.039 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:48:03.033+0000 1694f700 -1 osd.3 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:18.479261+0000 front 2019-12-09T17:47:16.688229+0000 (oldest deadline 2019-12-09T17:48:01.671257+0000) 2019-12-09T17:48:03.069 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:48:03.056+0000 1694f700 -1 osd.6 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:15.479008+0000 front 2019-12-09T17:47:15.476780+0000 (oldest deadline 2019-12-09T17:47:59.218636+0000) 2019-12-09T17:48:03.341 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:48:03.337+0000 1694f700 -1 osd.0 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:16.705512+0000 front 2019-12-09T17:47:16.704163+0000 (oldest deadline 2019-12-09T17:48:00.460063+0000) 2019-12-09T17:48:03.463 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:48:03.460+0000 1694f700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:14.300844+0000 front 2019-12-09T17:47:14.576561+0000 (oldest deadline 2019-12-09T17:47:57.268681+0000) 2019-12-09T17:48:03.500 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:48:03.497+0000 1694f700 -1 osd.4 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:17.810971+0000 front 2019-12-09T17:47:17.957640+0000 (oldest deadline 2019-12-09T17:48:03.063653+0000) 2019-12-09T17:48:03.529 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:48:03.525+0000 1694f700 -1 osd.1 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:18.222951+0000 front 2019-12-09T17:47:18.217872+0000 (oldest deadline 2019-12-09T17:48:00.126588+0000) 2019-12-09T17:48:03.550 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:48:03.547+0000 1694f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e153) 2019-12-09T17:48:04.025 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:48:04.020+0000 1694f700 -1 osd.3 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:18.479261+0000 front 2019-12-09T17:47:16.688229+0000 (oldest deadline 2019-12-09T17:48:01.671257+0000) 2019-12-09T17:48:04.060 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:48:04.057+0000 1694f700 -1 osd.6 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:15.479008+0000 front 2019-12-09T17:47:15.476780+0000 (oldest deadline 2019-12-09T17:47:59.218636+0000) 2019-12-09T17:48:04.317 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:48:04.313+0000 1694f700 -1 osd.0 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:16.705512+0000 front 2019-12-09T17:47:16.704163+0000 (oldest deadline 2019-12-09T17:48:00.460063+0000) 2019-12-09T17:48:04.460 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:48:04.456+0000 1694f700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:14.300844+0000 front 2019-12-09T17:47:14.576561+0000 (oldest deadline 2019-12-09T17:47:57.268681+0000) 2019-12-09T17:48:04.489 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:48:04.485+0000 1694f700 -1 osd.4 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:17.810971+0000 front 2019-12-09T17:47:17.957640+0000 (oldest deadline 2019-12-09T17:48:03.063653+0000) 2019-12-09T17:48:04.519 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:48:04.515+0000 1694f700 -1 osd.1 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:18.222951+0000 front 2019-12-09T17:47:18.217872+0000 (oldest deadline 2019-12-09T17:48:00.126588+0000) 2019-12-09T17:48:04.604 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:48:04.600+0000 1694f700 -1 osd.2 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:47:24.026495+0000 (oldest deadline 2019-12-09T17:48:04.026495+0000) 2019-12-09T17:48:04.605 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:48:04.601+0000 1694f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e153) 2019-12-09T17:48:05.065 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:48:05.061+0000 1694f700 -1 osd.3 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:18.479261+0000 front 2019-12-09T17:47:16.688229+0000 (oldest deadline 2019-12-09T17:48:01.671257+0000) 2019-12-09T17:48:05.091 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:48:05.087+0000 1694f700 -1 osd.6 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:15.479008+0000 front 2019-12-09T17:47:15.476780+0000 (oldest deadline 2019-12-09T17:47:59.218636+0000) 2019-12-09T17:48:05.295 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:48:05.291+0000 1694f700 -1 osd.0 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:16.705512+0000 front 2019-12-09T17:47:16.704163+0000 (oldest deadline 2019-12-09T17:48:00.460063+0000) 2019-12-09T17:48:05.446 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:48:05.442+0000 1694f700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:14.300844+0000 front 2019-12-09T17:47:14.576561+0000 (oldest deadline 2019-12-09T17:47:57.268681+0000) 2019-12-09T17:48:05.458 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:48:05.454+0000 1694f700 -1 osd.4 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:17.810971+0000 front 2019-12-09T17:47:17.957640+0000 (oldest deadline 2019-12-09T17:48:03.063653+0000) 2019-12-09T17:48:05.540 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:48:05.537+0000 1694f700 -1 osd.1 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:47:18.222951+0000 front 2019-12-09T17:47:18.217872+0000 (oldest deadline 2019-12-09T17:48:00.126588+0000) 2019-12-09T17:48:05.634 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:48:05.629+0000 1694f700 -1 osd.2 155 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:47:24.026495+0000 (oldest deadline 2019-12-09T17:48:04.026495+0000) 2019-12-09T17:48:05.634 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:48:05.631+0000 1694f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e153) 2019-12-09T17:48:32.900 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:48:32.885+0000 3aa81700 -1 osd.5 160 build_incremental_map_msg missing incremental map 160 2019-12-09T17:48:33.093 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:48:33.070+0000 34a75700 -1 osd.5 160 build_incremental_map_msg missing incremental map 160 2019-12-09T17:48:33.112 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:48:33.071+0000 11caf700 -1 osd.5 160 build_incremental_map_msg missing incremental map 160 2019-12-09T17:48:33.152 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:48:33.095+0000 34a75700 -1 osd.5 160 build_incremental_map_msg missing incremental map 160 2019-12-09T17:48:33.154 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:48:33.103+0000 38a7d700 -1 osd.5 160 build_incremental_map_msg missing incremental map 160 2019-12-09T17:48:33.160 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:48:33.110+0000 3a280700 -1 osd.5 160 build_incremental_map_msg missing incremental map 160 2019-12-09T17:48:33.211 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:48:33.156+0000 3aa81700 -1 osd.5 160 build_incremental_map_msg missing incremental map 160 2019-12-09T17:48:33.370 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:48:33.332+0000 34a75700 -1 osd.5 160 build_incremental_map_msg missing incremental map 160 2019-12-09T17:48:37.960 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:48:37.953+0000 35a77700 -1 osd.5 160 build_incremental_map_msg missing incremental map 160 2019-12-09T17:49:02.801 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:49:02.798+0000 1694f700 -1 osd.2 160 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected e159) 2019-12-09T17:49:04.237 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:49:04.130+0000 1694f700 -1 osd.2 160 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected e159) 2019-12-09T17:49:54.462 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:49:54.457+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:49:55.031 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:49:55.028+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:14.165891+0000 front 2019-12-09T17:49:12.341427+0000 (oldest deadline 2019-12-09T17:49:54.028750+0000) 2019-12-09T17:49:55.464 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:49:55.459+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:12.429978+0000 front 2019-12-09T17:49:12.290529+0000 (oldest deadline 2019-12-09T17:49:55.232630+0000) 2019-12-09T17:49:55.472 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:49:55.468+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:49:55.771 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:49:55.766+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.371068+0000 front 2019-12-09T17:49:13.376307+0000 (oldest deadline 2019-12-09T17:49:55.023185+0000) 2019-12-09T17:49:56.055 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:49:56.051+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:14.165891+0000 front 2019-12-09T17:49:12.341427+0000 (oldest deadline 2019-12-09T17:49:54.028750+0000) 2019-12-09T17:49:56.455 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:49:56.452+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:12.429978+0000 front 2019-12-09T17:49:12.290529+0000 (oldest deadline 2019-12-09T17:49:55.232630+0000) 2019-12-09T17:49:56.507 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:49:56.502+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:49:56.799 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:49:56.795+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.371068+0000 front 2019-12-09T17:49:13.376307+0000 (oldest deadline 2019-12-09T17:49:55.023185+0000) 2019-12-09T17:49:57.048 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:49:57.042+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:10.706212+0000 front 2019-12-09T17:49:10.734387+0000 (oldest deadline 2019-12-09T17:49:56.579854+0000) 2019-12-09T17:49:57.104 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:49:57.098+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:14.165891+0000 front 2019-12-09T17:49:12.341427+0000 (oldest deadline 2019-12-09T17:49:54.028750+0000) 2019-12-09T17:49:57.471 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:49:57.468+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:12.429978+0000 front 2019-12-09T17:49:12.290529+0000 (oldest deadline 2019-12-09T17:49:55.232630+0000) 2019-12-09T17:49:57.555 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:49:57.549+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:49:57.783 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:49:57.779+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.371068+0000 front 2019-12-09T17:49:13.376307+0000 (oldest deadline 2019-12-09T17:49:55.023185+0000) 2019-12-09T17:49:58.033 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:49:58.028+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:10.706212+0000 front 2019-12-09T17:49:10.734387+0000 (oldest deadline 2019-12-09T17:49:56.579854+0000) 2019-12-09T17:49:58.122 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:49:58.119+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:14.165891+0000 front 2019-12-09T17:49:12.341427+0000 (oldest deadline 2019-12-09T17:49:54.028750+0000) 2019-12-09T17:49:58.392 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:49:58.387+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.939419+0000 front 2019-12-09T17:49:13.949549+0000 (oldest deadline 2019-12-09T17:49:57.411535+0000) 2019-12-09T17:49:58.469 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:49:58.465+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:12.429978+0000 front 2019-12-09T17:49:12.290529+0000 (oldest deadline 2019-12-09T17:49:55.232630+0000) 2019-12-09T17:49:58.525 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:49:58.519+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:49:58.814 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:49:58.808+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.371068+0000 front 2019-12-09T17:49:13.376307+0000 (oldest deadline 2019-12-09T17:49:55.023185+0000) 2019-12-09T17:49:59.022 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:49:59.017+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:10.706212+0000 front 2019-12-09T17:49:10.734387+0000 (oldest deadline 2019-12-09T17:49:56.579854+0000) 2019-12-09T17:49:59.138 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:49:59.133+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:14.165891+0000 front 2019-12-09T17:49:12.341427+0000 (oldest deadline 2019-12-09T17:49:54.028750+0000) 2019-12-09T17:49:59.210 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:49:59.205+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.352161+0000 front 2019-12-09T17:49:13.387695+0000 (oldest deadline 2019-12-09T17:49:59.160820+0000) 2019-12-09T17:49:59.403 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:49:59.399+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.939419+0000 front 2019-12-09T17:49:13.949549+0000 (oldest deadline 2019-12-09T17:49:57.411535+0000) 2019-12-09T17:49:59.468 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:49:59.464+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:12.429978+0000 front 2019-12-09T17:49:12.290529+0000 (oldest deadline 2019-12-09T17:49:55.232630+0000) 2019-12-09T17:49:59.552 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:49:59.547+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:49:59.859 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:49:59.854+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.371068+0000 front 2019-12-09T17:49:13.376307+0000 (oldest deadline 2019-12-09T17:49:55.023185+0000) 2019-12-09T17:50:00.054 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:50:00.048+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:10.706212+0000 front 2019-12-09T17:49:10.734387+0000 (oldest deadline 2019-12-09T17:49:56.579854+0000) 2019-12-09T17:50:00.105 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:50:00.101+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:14.165891+0000 front 2019-12-09T17:49:12.341427+0000 (oldest deadline 2019-12-09T17:49:54.028750+0000) 2019-12-09T17:50:00.228 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:50:00.223+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.352161+0000 front 2019-12-09T17:49:13.387695+0000 (oldest deadline 2019-12-09T17:49:59.160820+0000) 2019-12-09T17:50:00.439 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:50:00.435+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:12.429978+0000 front 2019-12-09T17:49:12.290529+0000 (oldest deadline 2019-12-09T17:49:55.232630+0000) 2019-12-09T17:50:00.447 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:50:00.440+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.939419+0000 front 2019-12-09T17:49:13.949549+0000 (oldest deadline 2019-12-09T17:49:57.411535+0000) 2019-12-09T17:50:00.527 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:50:00.522+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:50:00.827 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:50:00.820+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.371068+0000 front 2019-12-09T17:49:13.376307+0000 (oldest deadline 2019-12-09T17:49:55.023185+0000) 2019-12-09T17:50:01.043 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:50:01.037+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:10.706212+0000 front 2019-12-09T17:49:10.734387+0000 (oldest deadline 2019-12-09T17:49:56.579854+0000) 2019-12-09T17:50:01.138 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:50:01.133+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:14.165891+0000 front 2019-12-09T17:49:12.341427+0000 (oldest deadline 2019-12-09T17:49:54.028750+0000) 2019-12-09T17:50:01.250 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:50:01.246+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.352161+0000 front 2019-12-09T17:49:13.387695+0000 (oldest deadline 2019-12-09T17:49:59.160820+0000) 2019-12-09T17:50:01.407 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:50:01.401+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.939419+0000 front 2019-12-09T17:49:13.949549+0000 (oldest deadline 2019-12-09T17:49:57.411535+0000) 2019-12-09T17:50:01.437 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:50:01.432+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:12.429978+0000 front 2019-12-09T17:49:12.290529+0000 (oldest deadline 2019-12-09T17:49:55.232630+0000) 2019-12-09T17:50:01.542 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:50:01.537+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:50:01.881 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:50:01.876+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.371068+0000 front 2019-12-09T17:49:13.376307+0000 (oldest deadline 2019-12-09T17:49:55.023185+0000) 2019-12-09T17:50:02.011 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:50:02.006+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:10.706212+0000 front 2019-12-09T17:49:10.734387+0000 (oldest deadline 2019-12-09T17:49:56.579854+0000) 2019-12-09T17:50:02.131 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:50:02.125+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:14.165891+0000 front 2019-12-09T17:49:12.341427+0000 (oldest deadline 2019-12-09T17:49:54.028750+0000) 2019-12-09T17:50:02.241 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:50:02.237+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.352161+0000 front 2019-12-09T17:49:13.387695+0000 (oldest deadline 2019-12-09T17:49:59.160820+0000) 2019-12-09T17:50:02.406 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:50:02.400+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.939419+0000 front 2019-12-09T17:49:13.949549+0000 (oldest deadline 2019-12-09T17:49:57.411535+0000) 2019-12-09T17:50:02.437 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:50:02.431+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:12.429978+0000 front 2019-12-09T17:49:12.290529+0000 (oldest deadline 2019-12-09T17:49:55.232630+0000) 2019-12-09T17:50:02.595 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:50:02.590+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:50:02.893 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:50:02.887+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.371068+0000 front 2019-12-09T17:49:13.376307+0000 (oldest deadline 2019-12-09T17:49:55.023185+0000) 2019-12-09T17:50:03.015 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:50:02.981+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:10.706212+0000 front 2019-12-09T17:49:10.734387+0000 (oldest deadline 2019-12-09T17:49:56.579854+0000) 2019-12-09T17:50:03.099 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:50:03.094+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:14.165891+0000 front 2019-12-09T17:49:12.341427+0000 (oldest deadline 2019-12-09T17:49:54.028750+0000) 2019-12-09T17:50:03.270 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:50:03.263+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.352161+0000 front 2019-12-09T17:49:13.387695+0000 (oldest deadline 2019-12-09T17:49:59.160820+0000) 2019-12-09T17:50:03.398 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:50:03.393+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:12.429978+0000 front 2019-12-09T17:49:12.290529+0000 (oldest deadline 2019-12-09T17:49:55.232630+0000) 2019-12-09T17:50:03.415 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:50:03.410+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.939419+0000 front 2019-12-09T17:49:13.949549+0000 (oldest deadline 2019-12-09T17:49:57.411535+0000) 2019-12-09T17:50:03.594 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:50:03.589+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:50:03.858 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:50:03.852+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.371068+0000 front 2019-12-09T17:49:13.376307+0000 (oldest deadline 2019-12-09T17:49:55.023185+0000) 2019-12-09T17:50:04.033 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:50:04.018+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:10.706212+0000 front 2019-12-09T17:49:10.734387+0000 (oldest deadline 2019-12-09T17:49:56.579854+0000) 2019-12-09T17:50:04.119 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:50:04.115+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:14.165891+0000 front 2019-12-09T17:49:12.341427+0000 (oldest deadline 2019-12-09T17:49:54.028750+0000) 2019-12-09T17:50:04.300 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:50:04.297+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.352161+0000 front 2019-12-09T17:49:13.387695+0000 (oldest deadline 2019-12-09T17:49:59.160820+0000) 2019-12-09T17:50:04.364 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:50:04.360+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:12.429978+0000 front 2019-12-09T17:49:12.290529+0000 (oldest deadline 2019-12-09T17:49:55.232630+0000) 2019-12-09T17:50:04.417 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:50:04.411+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.939419+0000 front 2019-12-09T17:49:13.949549+0000 (oldest deadline 2019-12-09T17:49:57.411535+0000) 2019-12-09T17:50:04.592 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:50:04.586+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:50:04.840 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:50:04.835+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.371068+0000 front 2019-12-09T17:49:13.376307+0000 (oldest deadline 2019-12-09T17:49:55.023185+0000) 2019-12-09T17:50:05.061 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:50:05.054+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:10.706212+0000 front 2019-12-09T17:49:10.734387+0000 (oldest deadline 2019-12-09T17:49:56.579854+0000) 2019-12-09T17:50:05.136 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:50:05.132+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:14.165891+0000 front 2019-12-09T17:49:12.341427+0000 (oldest deadline 2019-12-09T17:49:54.028750+0000) 2019-12-09T17:50:05.337 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:50:05.332+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.352161+0000 front 2019-12-09T17:49:13.387695+0000 (oldest deadline 2019-12-09T17:49:59.160820+0000) 2019-12-09T17:50:05.353 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:50:05.348+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:12.429978+0000 front 2019-12-09T17:49:12.290529+0000 (oldest deadline 2019-12-09T17:49:55.232630+0000) 2019-12-09T17:50:05.404 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:50:05.398+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.939419+0000 front 2019-12-09T17:49:13.949549+0000 (oldest deadline 2019-12-09T17:49:57.411535+0000) 2019-12-09T17:50:05.592 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:50:05.586+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:50:05.853 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:50:05.847+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.371068+0000 front 2019-12-09T17:49:13.376307+0000 (oldest deadline 2019-12-09T17:49:55.023185+0000) 2019-12-09T17:50:06.082 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:50:06.077+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:10.706212+0000 front 2019-12-09T17:49:10.734387+0000 (oldest deadline 2019-12-09T17:49:56.579854+0000) 2019-12-09T17:50:06.131 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:50:06.126+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:14.165891+0000 front 2019-12-09T17:49:12.341427+0000 (oldest deadline 2019-12-09T17:49:54.028750+0000) 2019-12-09T17:50:06.360 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:50:06.347+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.352161+0000 front 2019-12-09T17:49:13.387695+0000 (oldest deadline 2019-12-09T17:49:59.160820+0000) 2019-12-09T17:50:06.395 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:50:06.391+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:12.429978+0000 front 2019-12-09T17:49:12.290529+0000 (oldest deadline 2019-12-09T17:49:55.232630+0000) 2019-12-09T17:50:06.409 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:50:06.404+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.939419+0000 front 2019-12-09T17:49:13.949549+0000 (oldest deadline 2019-12-09T17:49:57.411535+0000) 2019-12-09T17:50:06.595 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:50:06.586+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:50:06.834 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:50:06.828+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.371068+0000 front 2019-12-09T17:49:13.376307+0000 (oldest deadline 2019-12-09T17:49:55.023185+0000) 2019-12-09T17:50:07.084 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:50:07.076+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:10.706212+0000 front 2019-12-09T17:49:10.734387+0000 (oldest deadline 2019-12-09T17:49:56.579854+0000) 2019-12-09T17:50:07.134 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:50:07.126+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:14.165891+0000 front 2019-12-09T17:49:12.341427+0000 (oldest deadline 2019-12-09T17:49:54.028750+0000) 2019-12-09T17:50:07.357 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:50:07.352+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:12.429978+0000 front 2019-12-09T17:49:12.290529+0000 (oldest deadline 2019-12-09T17:49:55.232630+0000) 2019-12-09T17:50:07.363 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:50:07.358+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.352161+0000 front 2019-12-09T17:49:13.387695+0000 (oldest deadline 2019-12-09T17:49:59.160820+0000) 2019-12-09T17:50:07.437 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:50:07.426+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.939419+0000 front 2019-12-09T17:49:13.949549+0000 (oldest deadline 2019-12-09T17:49:57.411535+0000) 2019-12-09T17:50:07.573 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:50:07.567+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:50:07.878 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:50:07.873+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.371068+0000 front 2019-12-09T17:49:13.376307+0000 (oldest deadline 2019-12-09T17:49:55.023185+0000) 2019-12-09T17:50:08.063 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:50:08.058+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:10.706212+0000 front 2019-12-09T17:49:10.734387+0000 (oldest deadline 2019-12-09T17:49:56.579854+0000) 2019-12-09T17:50:08.104 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:50:08.101+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:14.165891+0000 front 2019-12-09T17:49:12.341427+0000 (oldest deadline 2019-12-09T17:49:54.028750+0000) 2019-12-09T17:50:08.322 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:50:08.318+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.352161+0000 front 2019-12-09T17:49:13.387695+0000 (oldest deadline 2019-12-09T17:49:59.160820+0000) 2019-12-09T17:50:08.391 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:50:08.385+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:12.429978+0000 front 2019-12-09T17:49:12.290529+0000 (oldest deadline 2019-12-09T17:49:55.232630+0000) 2019-12-09T17:50:08.467 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:50:08.460+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.939419+0000 front 2019-12-09T17:49:13.949549+0000 (oldest deadline 2019-12-09T17:49:57.411535+0000) 2019-12-09T17:50:08.614 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:50:08.609+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:50:08.847 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:50:08.843+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.371068+0000 front 2019-12-09T17:49:13.376307+0000 (oldest deadline 2019-12-09T17:49:55.023185+0000) 2019-12-09T17:50:09.066 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:50:09.059+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:10.706212+0000 front 2019-12-09T17:49:10.734387+0000 (oldest deadline 2019-12-09T17:49:56.579854+0000) 2019-12-09T17:50:09.145 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:50:09.140+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:14.165891+0000 front 2019-12-09T17:49:12.341427+0000 (oldest deadline 2019-12-09T17:49:54.028750+0000) 2019-12-09T17:50:09.374 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:50:09.369+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.352161+0000 front 2019-12-09T17:49:13.387695+0000 (oldest deadline 2019-12-09T17:49:59.160820+0000) 2019-12-09T17:50:09.426 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:50:09.422+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:12.429978+0000 front 2019-12-09T17:49:12.290529+0000 (oldest deadline 2019-12-09T17:49:55.232630+0000) 2019-12-09T17:50:09.479 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:50:09.473+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.939419+0000 front 2019-12-09T17:49:13.949549+0000 (oldest deadline 2019-12-09T17:49:57.411535+0000) 2019-12-09T17:50:09.626 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:50:09.621+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:50:09.878 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:50:09.873+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.371068+0000 front 2019-12-09T17:49:13.376307+0000 (oldest deadline 2019-12-09T17:49:55.023185+0000) 2019-12-09T17:50:10.118 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:50:10.112+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:10.706212+0000 front 2019-12-09T17:49:10.734387+0000 (oldest deadline 2019-12-09T17:49:56.579854+0000) 2019-12-09T17:50:10.169 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:50:10.164+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:14.165891+0000 front 2019-12-09T17:49:12.341427+0000 (oldest deadline 2019-12-09T17:49:54.028750+0000) 2019-12-09T17:50:10.372 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:50:10.368+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.352161+0000 front 2019-12-09T17:49:13.387695+0000 (oldest deadline 2019-12-09T17:49:59.160820+0000) 2019-12-09T17:50:10.392 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:50:10.388+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:12.429978+0000 front 2019-12-09T17:49:12.290529+0000 (oldest deadline 2019-12-09T17:49:55.232630+0000) 2019-12-09T17:50:10.502 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:50:10.496+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.939419+0000 front 2019-12-09T17:49:13.949549+0000 (oldest deadline 2019-12-09T17:49:57.411535+0000) 2019-12-09T17:50:10.596 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:50:10.591+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:11.389997+0000 front 2019-12-09T17:49:11.364020+0000 (oldest deadline 2019-12-09T17:49:54.249437+0000) 2019-12-09T17:50:10.837 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:50:10.831+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:49:13.371068+0000 front 2019-12-09T17:49:13.376307+0000 (oldest deadline 2019-12-09T17:49:55.023185+0000) 2019-12-09T17:50:41.530 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:50:41.526+0000 1694f700 -1 osd.1 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:131734 7.1 7:8f661e56:lc::lc.12:head [call rgw.lc_get_head in=14b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e161) 2019-12-09T17:51:06.260 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:12:04.288 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:06.270 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:12:04.294 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:06.278 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:12:04.305 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:06.282 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:12:04.309 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:06.287 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:12:04.252 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:06.293 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:12:04.257 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:06.553 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:12:04.518 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:06.573 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:12:04.597 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:06.573 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:12:04.601 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:51:09.429 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:09.426+0000 39a7f700 -1 osd.2 165 build_incremental_map_msg missing incremental map 154 2019-12-09T17:51:38.203 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:38.201+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:39.207 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:39.201+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:40.202 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:40.199+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:41.239 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:41.235+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:42.262 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:42.259+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:43.280 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:43.276+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:44.334 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:44.329+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:45.363 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:45.355+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:46.367 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:46.364+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:47.379 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:47.376+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:48.356 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:48.353+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:49.328 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:49.324+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:50.309 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:50.306+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:51.297 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:51.294+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:52.267 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:52.263+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:52.913 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:51:52.908+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:51:53.250 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:53.247+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:53.900 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:51:53.896+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:51:53.945 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:51:53.939+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:51:54.257 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:54.254+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:54.926 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:51:54.922+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:51:54.995 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:51:54.990+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:51:55.307 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:55.304+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:55.959 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:51:55.955+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:51:56.005 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:51:56.001+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:51:56.298 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:56.295+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:56.704 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:51:56.701+0000 1694f700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.300213+0000 front 2019-12-09T17:51:12.329366+0000 (oldest deadline 2019-12-09T17:51:55.833040+0000) 2019-12-09T17:51:56.961 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:51:56.957+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:51:57.054 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:51:57.049+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:51:57.094 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:51:57.089+0000 1694f700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.378175+0000 front 2019-12-09T17:51:14.099318+0000 (oldest deadline 2019-12-09T17:51:57.045531+0000) 2019-12-09T17:51:57.346 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:57.342+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:57.749 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:51:57.744+0000 1694f700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.300213+0000 front 2019-12-09T17:51:12.329366+0000 (oldest deadline 2019-12-09T17:51:55.833040+0000) 2019-12-09T17:51:58.001 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:51:57.996+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:51:58.081 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:51:58.075+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:51:58.151 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:51:58.146+0000 1694f700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.378175+0000 front 2019-12-09T17:51:14.099318+0000 (oldest deadline 2019-12-09T17:51:57.045531+0000) 2019-12-09T17:51:58.318 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:58.309+0000 1694f700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.710400+0000 front 2019-12-09T17:51:12.197267+0000 (oldest deadline 2019-12-09T17:51:57.359424+0000) 2019-12-09T17:51:58.319 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:58.315+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:58.329 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:51:58.323+0000 1694f700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.188171+0000 front 2019-12-09T17:51:12.916734+0000 (oldest deadline 2019-12-09T17:51:57.842050+0000) 2019-12-09T17:51:58.481 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:51:58.477+0000 1694f700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.421434+0000 front 2019-12-09T17:51:14.310109+0000 (oldest deadline 2019-12-09T17:51:57.966491+0000) 2019-12-09T17:51:58.798 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:51:58.793+0000 1694f700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.300213+0000 front 2019-12-09T17:51:12.329366+0000 (oldest deadline 2019-12-09T17:51:55.833040+0000) 2019-12-09T17:51:58.985 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:51:58.980+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:51:59.101 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:51:59.092+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:51:59.186 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:51:59.182+0000 1694f700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.378175+0000 front 2019-12-09T17:51:14.099318+0000 (oldest deadline 2019-12-09T17:51:57.045531+0000) 2019-12-09T17:51:59.286 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:51:59.281+0000 1694f700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.188171+0000 front 2019-12-09T17:51:12.916734+0000 (oldest deadline 2019-12-09T17:51:57.842050+0000) 2019-12-09T17:51:59.347 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:59.341+0000 1694f700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.710400+0000 front 2019-12-09T17:51:12.197267+0000 (oldest deadline 2019-12-09T17:51:57.359424+0000) 2019-12-09T17:51:59.349 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:51:59.344+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:51:59.448 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:51:59.445+0000 1694f700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.421434+0000 front 2019-12-09T17:51:14.310109+0000 (oldest deadline 2019-12-09T17:51:57.966491+0000) 2019-12-09T17:51:59.789 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:51:59.785+0000 1694f700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.300213+0000 front 2019-12-09T17:51:12.329366+0000 (oldest deadline 2019-12-09T17:51:55.833040+0000) 2019-12-09T17:52:00.038 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:52:00.034+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:52:00.120 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:52:00.115+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:52:00.225 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:52:00.221+0000 1694f700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.378175+0000 front 2019-12-09T17:51:14.099318+0000 (oldest deadline 2019-12-09T17:51:57.045531+0000) 2019-12-09T17:52:00.269 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:52:00.265+0000 1694f700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.188171+0000 front 2019-12-09T17:51:12.916734+0000 (oldest deadline 2019-12-09T17:51:57.842050+0000) 2019-12-09T17:52:00.354 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:00.349+0000 1694f700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.710400+0000 front 2019-12-09T17:51:12.197267+0000 (oldest deadline 2019-12-09T17:51:57.359424+0000) 2019-12-09T17:52:00.376 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:00.351+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:52:00.427 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:52:00.421+0000 1694f700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.421434+0000 front 2019-12-09T17:51:14.310109+0000 (oldest deadline 2019-12-09T17:51:57.966491+0000) 2019-12-09T17:52:00.830 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:52:00.825+0000 1694f700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.300213+0000 front 2019-12-09T17:51:12.329366+0000 (oldest deadline 2019-12-09T17:51:55.833040+0000) 2019-12-09T17:52:01.025 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:52:01.021+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:52:01.156 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:52:01.151+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:52:01.240 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:52:01.235+0000 1694f700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.188171+0000 front 2019-12-09T17:51:12.916734+0000 (oldest deadline 2019-12-09T17:51:57.842050+0000) 2019-12-09T17:52:01.273 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:52:01.268+0000 1694f700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.378175+0000 front 2019-12-09T17:51:14.099318+0000 (oldest deadline 2019-12-09T17:51:57.045531+0000) 2019-12-09T17:52:01.313 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:01.308+0000 1694f700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.710400+0000 front 2019-12-09T17:51:12.197267+0000 (oldest deadline 2019-12-09T17:51:57.359424+0000) 2019-12-09T17:52:01.313 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:01.310+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:52:01.442 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:52:01.438+0000 1694f700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.421434+0000 front 2019-12-09T17:51:14.310109+0000 (oldest deadline 2019-12-09T17:51:57.966491+0000) 2019-12-09T17:52:01.838 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:52:01.834+0000 1694f700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.300213+0000 front 2019-12-09T17:51:12.329366+0000 (oldest deadline 2019-12-09T17:51:55.833040+0000) 2019-12-09T17:52:02.018 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:52:02.014+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:52:02.133 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:52:02.128+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:52:02.243 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:52:02.238+0000 1694f700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.188171+0000 front 2019-12-09T17:51:12.916734+0000 (oldest deadline 2019-12-09T17:51:57.842050+0000) 2019-12-09T17:52:02.302 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:52:02.298+0000 1694f700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.378175+0000 front 2019-12-09T17:51:14.099318+0000 (oldest deadline 2019-12-09T17:51:57.045531+0000) 2019-12-09T17:52:02.329 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:02.325+0000 1694f700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.710400+0000 front 2019-12-09T17:51:12.197267+0000 (oldest deadline 2019-12-09T17:51:57.359424+0000) 2019-12-09T17:52:02.332 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:02.329+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:52:02.496 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:52:02.491+0000 1694f700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.421434+0000 front 2019-12-09T17:51:14.310109+0000 (oldest deadline 2019-12-09T17:51:57.966491+0000) 2019-12-09T17:52:02.852 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:52:02.847+0000 1694f700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.300213+0000 front 2019-12-09T17:51:12.329366+0000 (oldest deadline 2019-12-09T17:51:55.833040+0000) 2019-12-09T17:52:03.022 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:52:03.018+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:52:03.121 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:52:03.115+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:52:03.275 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:52:03.270+0000 1694f700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.188171+0000 front 2019-12-09T17:51:12.916734+0000 (oldest deadline 2019-12-09T17:51:57.842050+0000) 2019-12-09T17:52:03.303 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:52:03.298+0000 1694f700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.378175+0000 front 2019-12-09T17:51:14.099318+0000 (oldest deadline 2019-12-09T17:51:57.045531+0000) 2019-12-09T17:52:03.305 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:03.300+0000 1694f700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.710400+0000 front 2019-12-09T17:51:12.197267+0000 (oldest deadline 2019-12-09T17:51:57.359424+0000) 2019-12-09T17:52:03.306 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:03.302+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:52:03.478 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:52:03.473+0000 1694f700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.421434+0000 front 2019-12-09T17:51:14.310109+0000 (oldest deadline 2019-12-09T17:51:57.966491+0000) 2019-12-09T17:52:03.809 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:52:03.804+0000 1694f700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.300213+0000 front 2019-12-09T17:51:12.329366+0000 (oldest deadline 2019-12-09T17:51:55.833040+0000) 2019-12-09T17:52:04.067 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:52:04.063+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:52:04.097 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:52:04.092+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:52:04.286 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:52:04.281+0000 1694f700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.378175+0000 front 2019-12-09T17:51:14.099318+0000 (oldest deadline 2019-12-09T17:51:57.045531+0000) 2019-12-09T17:52:04.288 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:52:04.283+0000 1694f700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.188171+0000 front 2019-12-09T17:51:12.916734+0000 (oldest deadline 2019-12-09T17:51:57.842050+0000) 2019-12-09T17:52:04.323 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:04.320+0000 1694f700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.710400+0000 front 2019-12-09T17:51:12.197267+0000 (oldest deadline 2019-12-09T17:51:57.359424+0000) 2019-12-09T17:52:04.325 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:04.322+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:52:04.494 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:52:04.489+0000 1694f700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.421434+0000 front 2019-12-09T17:51:14.310109+0000 (oldest deadline 2019-12-09T17:51:57.966491+0000) 2019-12-09T17:52:04.821 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:52:04.816+0000 1694f700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.300213+0000 front 2019-12-09T17:51:12.329366+0000 (oldest deadline 2019-12-09T17:51:55.833040+0000) 2019-12-09T17:52:05.092 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:52:05.087+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:52:05.145 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:52:05.141+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:52:05.292 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:52:05.287+0000 1694f700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.188171+0000 front 2019-12-09T17:51:12.916734+0000 (oldest deadline 2019-12-09T17:51:57.842050+0000) 2019-12-09T17:52:05.322 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:52:05.317+0000 1694f700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.378175+0000 front 2019-12-09T17:51:14.099318+0000 (oldest deadline 2019-12-09T17:51:57.045531+0000) 2019-12-09T17:52:05.365 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:05.362+0000 1694f700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.710400+0000 front 2019-12-09T17:51:12.197267+0000 (oldest deadline 2019-12-09T17:51:57.359424+0000) 2019-12-09T17:52:05.368 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:05.365+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:52:05.513 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:52:05.509+0000 1694f700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.421434+0000 front 2019-12-09T17:51:14.310109+0000 (oldest deadline 2019-12-09T17:51:57.966491+0000) 2019-12-09T17:52:05.817 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:52:05.812+0000 1694f700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.300213+0000 front 2019-12-09T17:51:12.329366+0000 (oldest deadline 2019-12-09T17:51:55.833040+0000) 2019-12-09T17:52:06.112 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:52:06.109+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:52:06.160 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:52:06.155+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:52:06.278 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:52:06.274+0000 1694f700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.188171+0000 front 2019-12-09T17:51:12.916734+0000 (oldest deadline 2019-12-09T17:51:57.842050+0000) 2019-12-09T17:52:06.296 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:52:06.292+0000 1694f700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.378175+0000 front 2019-12-09T17:51:14.099318+0000 (oldest deadline 2019-12-09T17:51:57.045531+0000) 2019-12-09T17:52:06.324 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:06.319+0000 1694f700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.710400+0000 front 2019-12-09T17:51:12.197267+0000 (oldest deadline 2019-12-09T17:51:57.359424+0000) 2019-12-09T17:52:06.324 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:06.320+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:52:06.558 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:52:06.554+0000 1694f700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.421434+0000 front 2019-12-09T17:51:14.310109+0000 (oldest deadline 2019-12-09T17:51:57.966491+0000) 2019-12-09T17:52:06.865 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:52:06.861+0000 1694f700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.300213+0000 front 2019-12-09T17:51:12.329366+0000 (oldest deadline 2019-12-09T17:51:55.833040+0000) 2019-12-09T17:52:07.127 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:52:07.122+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:52:07.208 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:52:07.203+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:52:07.288 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:07.284+0000 1694f700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.710400+0000 front 2019-12-09T17:51:12.197267+0000 (oldest deadline 2019-12-09T17:51:57.359424+0000) 2019-12-09T17:52:07.289 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:07.285+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:52:07.317 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:52:07.312+0000 1694f700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.188171+0000 front 2019-12-09T17:51:12.916734+0000 (oldest deadline 2019-12-09T17:51:57.842050+0000) 2019-12-09T17:52:07.341 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:52:07.337+0000 1694f700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.378175+0000 front 2019-12-09T17:51:14.099318+0000 (oldest deadline 2019-12-09T17:51:57.045531+0000) 2019-12-09T17:52:07.571 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:52:07.561+0000 1694f700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.421434+0000 front 2019-12-09T17:51:14.310109+0000 (oldest deadline 2019-12-09T17:51:57.966491+0000) 2019-12-09T17:52:07.872 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:52:07.867+0000 1694f700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.300213+0000 front 2019-12-09T17:51:12.329366+0000 (oldest deadline 2019-12-09T17:51:55.833040+0000) 2019-12-09T17:52:08.111 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:52:08.106+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:52:08.201 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:52:08.196+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:52:08.289 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:08.284+0000 1694f700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.710400+0000 front 2019-12-09T17:51:12.197267+0000 (oldest deadline 2019-12-09T17:51:57.359424+0000) 2019-12-09T17:52:08.290 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:08.286+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:52:08.299 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:52:08.294+0000 1694f700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.378175+0000 front 2019-12-09T17:51:14.099318+0000 (oldest deadline 2019-12-09T17:51:57.045531+0000) 2019-12-09T17:52:08.339 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:52:08.335+0000 1694f700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.188171+0000 front 2019-12-09T17:51:12.916734+0000 (oldest deadline 2019-12-09T17:51:57.842050+0000) 2019-12-09T17:52:08.526 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:52:08.522+0000 1694f700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.421434+0000 front 2019-12-09T17:51:14.310109+0000 (oldest deadline 2019-12-09T17:51:57.966491+0000) 2019-12-09T17:52:08.859 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:52:08.856+0000 1694f700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.300213+0000 front 2019-12-09T17:51:12.329366+0000 (oldest deadline 2019-12-09T17:51:55.833040+0000) 2019-12-09T17:52:09.094 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:52:09.090+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:52:09.229 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:52:09.224+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:52:09.267 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:09.261+0000 1694f700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.710400+0000 front 2019-12-09T17:51:12.197267+0000 (oldest deadline 2019-12-09T17:51:57.359424+0000) 2019-12-09T17:52:09.267 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:09.263+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:52:09.352 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:52:09.347+0000 1694f700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.378175+0000 front 2019-12-09T17:51:14.099318+0000 (oldest deadline 2019-12-09T17:51:57.045531+0000) 2019-12-09T17:52:09.357 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:52:09.351+0000 1694f700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.188171+0000 front 2019-12-09T17:51:12.916734+0000 (oldest deadline 2019-12-09T17:51:57.842050+0000) 2019-12-09T17:52:09.560 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:52:09.555+0000 1694f700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.421434+0000 front 2019-12-09T17:51:14.310109+0000 (oldest deadline 2019-12-09T17:51:57.966491+0000) 2019-12-09T17:52:09.826 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:52:09.821+0000 1694f700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.300213+0000 front 2019-12-09T17:51:12.329366+0000 (oldest deadline 2019-12-09T17:51:55.833040+0000) 2019-12-09T17:52:10.075 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:52:10.071+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:52:10.218 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:52:10.213+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:52:10.317 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:10.312+0000 1694f700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.710400+0000 front 2019-12-09T17:51:12.197267+0000 (oldest deadline 2019-12-09T17:51:57.359424+0000) 2019-12-09T17:52:10.319 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:10.314+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:52:10.377 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:52:10.371+0000 1694f700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.188171+0000 front 2019-12-09T17:51:12.916734+0000 (oldest deadline 2019-12-09T17:51:57.842050+0000) 2019-12-09T17:52:10.378 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:52:10.374+0000 1694f700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.378175+0000 front 2019-12-09T17:51:14.099318+0000 (oldest deadline 2019-12-09T17:51:57.045531+0000) 2019-12-09T17:52:10.569 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:52:10.558+0000 1694f700 -1 osd.0 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.421434+0000 front 2019-12-09T17:51:14.310109+0000 (oldest deadline 2019-12-09T17:51:57.966491+0000) 2019-12-09T17:52:10.793 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:52:10.789+0000 1694f700 -1 osd.3 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.300213+0000 front 2019-12-09T17:51:12.329366+0000 (oldest deadline 2019-12-09T17:51:55.833040+0000) 2019-12-09T17:52:11.102 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:52:11.098+0000 1694f700 -1 osd.1 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:08.898563+0000 front 2019-12-09T17:51:08.500991+0000 (oldest deadline 2019-12-09T17:51:53.793708+0000) 2019-12-09T17:52:11.203 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:52:11.199+0000 1694f700 -1 osd.7 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:10.521311+0000 front 2019-12-09T17:51:10.768298+0000 (oldest deadline 2019-12-09T17:51:52.888905+0000) 2019-12-09T17:52:11.299 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:11.294+0000 1694f700 -1 osd.2 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.710400+0000 front 2019-12-09T17:51:12.197267+0000 (oldest deadline 2019-12-09T17:51:57.359424+0000) 2019-12-09T17:52:11.324 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:52:11.296+0000 1694f700 -1 osd.2 165 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e165) 2019-12-09T17:52:11.347 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:52:11.342+0000 1694f700 -1 osd.4 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:14.188171+0000 front 2019-12-09T17:51:12.916734+0000 (oldest deadline 2019-12-09T17:51:57.842050+0000) 2019-12-09T17:52:11.352 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:52:11.348+0000 1694f700 -1 osd.6 165 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:51:12.378175+0000 front 2019-12-09T17:51:14.099318+0000 (oldest deadline 2019-12-09T17:51:57.045531+0000) 2019-12-09T17:52:20.078 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:52:20.012+0000 1694f700 -1 osd.5 165 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:131761 7.3 7.2b4165c3 (undecoded) ondisk+write+known_if_redirected e165) 2019-12-09T17:52:26.385 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:52:26.365+0000 3827c700 -1 osd.5 170 build_incremental_map_msg missing incremental map 170 2019-12-09T17:52:29.439 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:52:29.435+0000 35276700 -1 osd.5 170 build_incremental_map_msg missing incremental map 170 2019-12-09T17:52:29.754 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:52:29.748+0000 3b282700 -1 osd.5 170 build_incremental_map_msg missing incremental map 170 2019-12-09T17:52:31.780 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:13:29.808 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:52:31.792 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:13:29.820 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:52:31.892 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:13:29.919 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:52:31.894 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:13:29.921 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:52:31.902 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:13:29.867 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:52:31.914 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:13:29.878 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:52:31.991 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:13:30.018 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:52:32.015 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:13:30.043 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:52:32.155 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:13:30.120 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:53:09.168 INFO:teuthology.orchestra.run.smithi121.stderr:testUnorderedList (test.functional.tests.TestContainer) ... ok 2019-12-09T17:53:27.029 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:14:25.056 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:53:27.097 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:14:25.125 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:53:27.160 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:14:25.187 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:53:27.163 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:14:25.190 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:53:27.176 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:14:25.203 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:53:27.197 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:14:25.161 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:53:27.200 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:14:25.164 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:53:27.265 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:14:25.292 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:53:27.346 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:14:25.311 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:53:47.668 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:53:47.663+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:53:48.036 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:53:48.032+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:53:48.306 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:53:48.301+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:53:48.513 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:53:48.508+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:53:48.647 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:53:48.643+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:53:49.020 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:53:49.016+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:53:49.167 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:53:49.161+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:53:49.309 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:53:49.303+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:53:49.338 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:53:49.334+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:53:49.564 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:53:49.554+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:53:49.611 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:53:49.606+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:53:50.054 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:53:50.048+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:53:50.175 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:53:50.169+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:53:50.344 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:53:50.337+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:53:50.364 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:53:50.359+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:53:50.534 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:53:50.529+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:53:50.574 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:53:50.568+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:53:50.615 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:53:50.612+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:53:51.092 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:53:51.088+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:53:51.216 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:53:51.209+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:53:51.325 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:53:51.318+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:53:51.392 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:53:51.386+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:53:51.494 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:53:51.487+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:53:51.563 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:53:51.557+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:53:51.621 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:53:51.617+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:53:52.118 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:53:52.114+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:53:52.261 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:53:52.254+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:53:52.281 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:53:52.275+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:53:52.416 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:53:52.410+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:53:52.453 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:53:52.447+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:53:52.530 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:53:52.522+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:53:52.632 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:53:52.628+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:53:53.161 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:53:53.156+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:53:53.272 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:53:53.266+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:53:53.320 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:53:53.314+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:53:53.420 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:53:53.414+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:53:53.462 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:53:53.457+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:53:53.570 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:53:53.564+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:53:53.624 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:53:53.619+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:53:54.123 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:53:54.117+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:53:54.233 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:53:54.226+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:53:54.314 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:53:54.308+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:53:54.458 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:53:54.454+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:53:54.459 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:53:54.453+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:53:54.593 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:53:54.587+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:53:54.621 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:53:54.617+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:53:55.128 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:53:55.123+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:53:55.285 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:53:55.279+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:53:55.348 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:53:55.341+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:53:55.456 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:53:55.449+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:53:55.511 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:53:55.505+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:53:55.611 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:53:55.605+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:53:55.615 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:53:55.610+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:53:56.145 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:53:56.140+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:53:56.335 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:53:56.330+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:53:56.347 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:53:56.341+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:53:56.466 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:53:56.442+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:53:56.563 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:53:56.557+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:53:56.580 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:53:56.575+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:53:56.637 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:53:56.632+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:53:57.158 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:53:57.146+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:53:57.339 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:53:57.334+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:53:57.388 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:53:57.381+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:53:57.471 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:53:57.467+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:53:57.603 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:53:57.597+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:53:57.606 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:53:57.600+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:53:57.650 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:53:57.644+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:53:58.106 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:53:58.101+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:53:58.319 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:53:58.313+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:53:58.439 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:53:58.434+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:53:58.471 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:53:58.467+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:53:58.582 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:53:58.576+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:53:58.631 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:53:58.626+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:53:58.650 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:53:58.644+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:53:59.122 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:53:59.117+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:53:59.302 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:53:59.294+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:53:59.443 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:53:59.437+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:53:59.484 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:53:59.480+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:53:59.631 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:53:59.624+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:53:59.662 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:53:59.652+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:53:59.663 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:53:59.659+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:54:00.153 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:54:00.150+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:54:00.283 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:54:00.278+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:54:00.465 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:54:00.461+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:54:00.477 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:54:00.471+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:54:00.632 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:54:00.628+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:54:00.678 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:54:00.670+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:54:00.682 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:54:00.675+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:54:01.121 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:54:01.117+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:54:01.321 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:54:01.316+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:54:01.449 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:54:01.445+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:54:01.522 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:54:01.518+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:54:01.659 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:54:01.654+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:54:01.663 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:54:01.658+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:54:01.695 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:54:01.691+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:54:02.080 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:54:02.076+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:54:02.322 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:54:02.318+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:54:02.503 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:54:02.498+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:54:02.555 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:54:02.540+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:54:02.693 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:54:02.684+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:54:02.697 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:54:02.693+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:54:02.712 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:54:02.708+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:54:03.041 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:54:03.038+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:54:03.369 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:54:03.364+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:54:03.492 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:54:03.487+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:54:03.531 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:54:03.526+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:54:03.669 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:54:03.665+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:54:03.738 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:54:03.734+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:54:03.753 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:54:03.748+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:54:04.001 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:54:03.997+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:54:04.375 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:54:04.370+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:54:04.496 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:54:04.492+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:54:04.497 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:54:04.493+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:54:04.699 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:54:04.694+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:54:04.724 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:54:04.719+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:54:04.734 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:54:04.730+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:54:04.974 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:54:04.969+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:54:05.376 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:54:05.372+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:54:05.525 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:54:05.520+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:54:05.545 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:54:05.541+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:54:05.716 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:54:05.711+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:54:05.753 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:54:05.748+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:54:05.767 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:54:05.762+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:54:05.945 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:54:05.938+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:54:06.431 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:54:06.426+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:54:06.571 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:54:06.567+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:54:06.601 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:54:06.595+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:54:06.726 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:54:06.722+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:54:06.735 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:54:06.730+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:54:06.807 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:54:06.802+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:54:06.962 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:54:06.955+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:54:07.480 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:54:07.470+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:54:07.571 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:54:07.564+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:54:07.598 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:54:07.593+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:54:07.741 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:54:07.737+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:54:07.746 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:54:07.741+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:54:07.803 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:54:07.798+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:54:08.012 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:54:08.007+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:54:08.444 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:54:08.440+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:54:08.585 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:54:08.581+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:54:08.615 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:54:08.610+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:54:08.714 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:54:08.709+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:54:08.768 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:54:08.764+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:54:08.822 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:54:08.817+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:54:09.069 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:54:09.057+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:54:09.404 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:54:09.400+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:54:09.571 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:54:09.566+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:54:09.659 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:54:09.655+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:54:09.729 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:54:09.725+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:54:09.747 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:54:09.742+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:54:09.819 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:54:09.815+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:54:10.098 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:54:10.094+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:54:10.376 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:54:10.371+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:54:10.609 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:54:10.604+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:54:10.672 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:54:10.667+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:54:10.697 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:54:10.693+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:54:10.758 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:54:10.753+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:54:10.844 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:54:10.839+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:54:11.136 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:54:11.132+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:54:11.378 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:54:11.373+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:54:11.587 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:54:11.580+0000 1694f700 -1 osd.5 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:04.621323+0000 front 2019-12-09T17:53:05.139085+0000 (oldest deadline 2019-12-09T17:53:48.083412+0000) 2019-12-09T17:54:11.701 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:54:11.697+0000 1694f700 -1 osd.3 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.025424+0000 front 2019-12-09T17:53:03.054411+0000 (oldest deadline 2019-12-09T17:53:48.783185+0000) 2019-12-09T17:54:11.729 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:54:11.721+0000 1694f700 -1 osd.6 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.791427+0000 front 2019-12-09T17:53:03.810128+0000 (oldest deadline 2019-12-09T17:53:48.477179+0000) 2019-12-09T17:54:11.746 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:54:11.737+0000 1694f700 -1 osd.4 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.931023+0000 front 2019-12-09T17:53:05.556990+0000 (oldest deadline 2019-12-09T17:53:49.993881+0000) 2019-12-09T17:54:11.872 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:54:11.865+0000 1694f700 -1 osd.0 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:01.933123+0000 front 2019-12-09T17:53:01.932779+0000 (oldest deadline 2019-12-09T17:53:47.215774+0000) 2019-12-09T17:54:12.121 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:54:12.116+0000 1694f700 -1 osd.1 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:05.024506+0000 front 2019-12-09T17:53:05.034672+0000 (oldest deadline 2019-12-09T17:53:47.369306+0000) 2019-12-09T17:54:12.357 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:54:12.353+0000 1694f700 -1 osd.7 170 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:53:03.887147+0000 front 2019-12-09T17:53:03.874974+0000 (oldest deadline 2019-12-09T17:53:48.543757+0000) 2019-12-09T17:55:06.419 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:06.413+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:07.383 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:07.379+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:07.708 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:16:05.735 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:55:07.714 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:16:05.741 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:55:07.723 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:16:05.750 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:55:07.727 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:16:05.754 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:55:07.728 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:16:05.692 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:55:07.738 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:16:05.702 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:55:07.832 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:16:05.858 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:55:07.848 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:16:05.875 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:55:07.870 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:16:05.834 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:55:08.371 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:08.368+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:08.570 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:55:08.565+0000 1694f700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:31.684326+0000 front 2019-12-09T17:54:27.442320+0000 (oldest deadline 2019-12-09T17:55:08.486257+0000) 2019-12-09T17:55:09.201 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:55:09.196+0000 1694f700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.454306+0000 front 2019-12-09T17:54:28.572976+0000 (oldest deadline 2019-12-09T17:55:08.222032+0000) 2019-12-09T17:55:09.346 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:09.341+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:09.627 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:55:09.622+0000 1694f700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:31.684326+0000 front 2019-12-09T17:54:27.442320+0000 (oldest deadline 2019-12-09T17:55:08.486257+0000) 2019-12-09T17:55:10.176 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:55:10.167+0000 1694f700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.454306+0000 front 2019-12-09T17:54:28.572976+0000 (oldest deadline 2019-12-09T17:55:08.222032+0000) 2019-12-09T17:55:10.357 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:10.353+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:10.555 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:55:10.550+0000 1694f700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.812648+0000 front 2019-12-09T17:54:28.821446+0000 (oldest deadline 2019-12-09T17:55:10.385241+0000) 2019-12-09T17:55:10.635 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:55:10.630+0000 1694f700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:31.684326+0000 front 2019-12-09T17:54:27.442320+0000 (oldest deadline 2019-12-09T17:55:08.486257+0000) 2019-12-09T17:55:11.187 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:55:11.183+0000 1694f700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.454306+0000 front 2019-12-09T17:54:28.572976+0000 (oldest deadline 2019-12-09T17:55:08.222032+0000) 2019-12-09T17:55:11.359 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:11.352+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:11.517 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:55:11.514+0000 1694f700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.812648+0000 front 2019-12-09T17:54:28.821446+0000 (oldest deadline 2019-12-09T17:55:10.385241+0000) 2019-12-09T17:55:11.604 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:55:11.600+0000 1694f700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:31.684326+0000 front 2019-12-09T17:54:27.442320+0000 (oldest deadline 2019-12-09T17:55:08.486257+0000) 2019-12-09T17:55:11.630 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:55:11.624+0000 1694f700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:29.343823+0000 front 2019-12-09T17:54:29.353806+0000 (oldest deadline 2019-12-09T17:55:11.017635+0000) 2019-12-09T17:55:12.189 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:55:12.179+0000 1694f700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.454306+0000 front 2019-12-09T17:54:28.572976+0000 (oldest deadline 2019-12-09T17:55:08.222032+0000) 2019-12-09T17:55:12.337 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:12.332+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:12.483 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:55:12.479+0000 1694f700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.812648+0000 front 2019-12-09T17:54:28.821446+0000 (oldest deadline 2019-12-09T17:55:10.385241+0000) 2019-12-09T17:55:12.620 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:55:12.615+0000 1694f700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:31.684326+0000 front 2019-12-09T17:54:27.442320+0000 (oldest deadline 2019-12-09T17:55:08.486257+0000) 2019-12-09T17:55:12.666 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:55:12.663+0000 1694f700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:29.343823+0000 front 2019-12-09T17:54:29.353806+0000 (oldest deadline 2019-12-09T17:55:11.017635+0000) 2019-12-09T17:55:13.237 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:55:13.221+0000 1694f700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.454306+0000 front 2019-12-09T17:54:28.572976+0000 (oldest deadline 2019-12-09T17:55:08.222032+0000) 2019-12-09T17:55:13.333 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:13.329+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:13.498 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:55:13.495+0000 1694f700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.812648+0000 front 2019-12-09T17:54:28.821446+0000 (oldest deadline 2019-12-09T17:55:10.385241+0000) 2019-12-09T17:55:13.631 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:55:13.626+0000 1694f700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:29.343823+0000 front 2019-12-09T17:54:29.353806+0000 (oldest deadline 2019-12-09T17:55:11.017635+0000) 2019-12-09T17:55:13.659 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:55:13.653+0000 1694f700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:31.684326+0000 front 2019-12-09T17:54:27.442320+0000 (oldest deadline 2019-12-09T17:55:08.486257+0000) 2019-12-09T17:55:14.195 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:55:14.190+0000 1694f700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.454306+0000 front 2019-12-09T17:54:28.572976+0000 (oldest deadline 2019-12-09T17:55:08.222032+0000) 2019-12-09T17:55:14.377 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:14.373+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:14.456 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:55:14.450+0000 1694f700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.812648+0000 front 2019-12-09T17:54:28.821446+0000 (oldest deadline 2019-12-09T17:55:10.385241+0000) 2019-12-09T17:55:14.666 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:55:14.661+0000 1694f700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:31.684326+0000 front 2019-12-09T17:54:27.442320+0000 (oldest deadline 2019-12-09T17:55:08.486257+0000) 2019-12-09T17:55:14.668 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:55:14.663+0000 1694f700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:29.343823+0000 front 2019-12-09T17:54:29.353806+0000 (oldest deadline 2019-12-09T17:55:11.017635+0000) 2019-12-09T17:55:15.240 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:55:15.235+0000 1694f700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.454306+0000 front 2019-12-09T17:54:28.572976+0000 (oldest deadline 2019-12-09T17:55:08.222032+0000) 2019-12-09T17:55:15.399 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:15.395+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:15.414 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:55:15.410+0000 1694f700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.812648+0000 front 2019-12-09T17:54:28.821446+0000 (oldest deadline 2019-12-09T17:55:10.385241+0000) 2019-12-09T17:55:15.673 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:55:15.669+0000 1694f700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:29.343823+0000 front 2019-12-09T17:54:29.353806+0000 (oldest deadline 2019-12-09T17:55:11.017635+0000) 2019-12-09T17:55:15.713 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:55:15.710+0000 1694f700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.845771+0000 front 2019-12-09T17:54:28.842528+0000 (oldest deadline 2019-12-09T17:55:14.759071+0000) 2019-12-09T17:55:15.721 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:55:15.718+0000 1694f700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:31.684326+0000 front 2019-12-09T17:54:27.442320+0000 (oldest deadline 2019-12-09T17:55:08.486257+0000) 2019-12-09T17:55:16.200 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:55:16.197+0000 1694f700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.454306+0000 front 2019-12-09T17:54:28.572976+0000 (oldest deadline 2019-12-09T17:55:08.222032+0000) 2019-12-09T17:55:16.370 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:55:16.366+0000 1694f700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.812648+0000 front 2019-12-09T17:54:28.821446+0000 (oldest deadline 2019-12-09T17:55:10.385241+0000) 2019-12-09T17:55:16.386 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:16.382+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:16.684 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:55:16.680+0000 1694f700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:31.684326+0000 front 2019-12-09T17:54:27.442320+0000 (oldest deadline 2019-12-09T17:55:08.486257+0000) 2019-12-09T17:55:16.702 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:55:16.698+0000 1694f700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:29.343823+0000 front 2019-12-09T17:54:29.353806+0000 (oldest deadline 2019-12-09T17:55:11.017635+0000) 2019-12-09T17:55:16.704 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:55:16.701+0000 1694f700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.845771+0000 front 2019-12-09T17:54:28.842528+0000 (oldest deadline 2019-12-09T17:55:14.759071+0000) 2019-12-09T17:55:17.169 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:55:17.164+0000 1694f700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.454306+0000 front 2019-12-09T17:54:28.572976+0000 (oldest deadline 2019-12-09T17:55:08.222032+0000) 2019-12-09T17:55:17.330 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:55:17.326+0000 1694f700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.812648+0000 front 2019-12-09T17:54:28.821446+0000 (oldest deadline 2019-12-09T17:55:10.385241+0000) 2019-12-09T17:55:17.416 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:17.411+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:17.682 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:55:17.678+0000 1694f700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:29.343823+0000 front 2019-12-09T17:54:29.353806+0000 (oldest deadline 2019-12-09T17:55:11.017635+0000) 2019-12-09T17:55:17.703 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:55:17.700+0000 1694f700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:31.684326+0000 front 2019-12-09T17:54:27.442320+0000 (oldest deadline 2019-12-09T17:55:08.486257+0000) 2019-12-09T17:55:17.749 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:55:17.745+0000 1694f700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.845771+0000 front 2019-12-09T17:54:28.842528+0000 (oldest deadline 2019-12-09T17:55:14.759071+0000) 2019-12-09T17:55:18.144 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:55:18.139+0000 1694f700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.454306+0000 front 2019-12-09T17:54:28.572976+0000 (oldest deadline 2019-12-09T17:55:08.222032+0000) 2019-12-09T17:55:18.342 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:55:18.338+0000 1694f700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.812648+0000 front 2019-12-09T17:54:28.821446+0000 (oldest deadline 2019-12-09T17:55:10.385241+0000) 2019-12-09T17:55:18.449 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:18.442+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:18.694 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:55:18.689+0000 1694f700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:29.343823+0000 front 2019-12-09T17:54:29.353806+0000 (oldest deadline 2019-12-09T17:55:11.017635+0000) 2019-12-09T17:55:18.714 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:55:18.709+0000 1694f700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.845771+0000 front 2019-12-09T17:54:28.842528+0000 (oldest deadline 2019-12-09T17:55:14.759071+0000) 2019-12-09T17:55:18.727 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:55:18.724+0000 1694f700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:31.684326+0000 front 2019-12-09T17:54:27.442320+0000 (oldest deadline 2019-12-09T17:55:08.486257+0000) 2019-12-09T17:55:19.124 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:55:19.120+0000 1694f700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.454306+0000 front 2019-12-09T17:54:28.572976+0000 (oldest deadline 2019-12-09T17:55:08.222032+0000) 2019-12-09T17:55:19.301 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:55:19.296+0000 1694f700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.812648+0000 front 2019-12-09T17:54:28.821446+0000 (oldest deadline 2019-12-09T17:55:10.385241+0000) 2019-12-09T17:55:19.496 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:19.491+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:19.690 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:55:19.687+0000 1694f700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:31.684326+0000 front 2019-12-09T17:54:27.442320+0000 (oldest deadline 2019-12-09T17:55:08.486257+0000) 2019-12-09T17:55:19.707 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:55:19.703+0000 1694f700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.845771+0000 front 2019-12-09T17:54:28.842528+0000 (oldest deadline 2019-12-09T17:55:14.759071+0000) 2019-12-09T17:55:19.728 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:55:19.723+0000 1694f700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:29.343823+0000 front 2019-12-09T17:54:29.353806+0000 (oldest deadline 2019-12-09T17:55:11.017635+0000) 2019-12-09T17:55:20.114 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:55:20.110+0000 1694f700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.454306+0000 front 2019-12-09T17:54:28.572976+0000 (oldest deadline 2019-12-09T17:55:08.222032+0000) 2019-12-09T17:55:20.280 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:55:20.275+0000 1694f700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.812648+0000 front 2019-12-09T17:54:28.821446+0000 (oldest deadline 2019-12-09T17:55:10.385241+0000) 2019-12-09T17:55:20.508 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:20.504+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:20.708 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:55:20.703+0000 1694f700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.845771+0000 front 2019-12-09T17:54:28.842528+0000 (oldest deadline 2019-12-09T17:55:14.759071+0000) 2019-12-09T17:55:20.723 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:55:20.719+0000 1694f700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:31.684326+0000 front 2019-12-09T17:54:27.442320+0000 (oldest deadline 2019-12-09T17:55:08.486257+0000) 2019-12-09T17:55:20.778 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:55:20.773+0000 1694f700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:29.343823+0000 front 2019-12-09T17:54:29.353806+0000 (oldest deadline 2019-12-09T17:55:11.017635+0000) 2019-12-09T17:55:21.076 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:55:21.072+0000 1694f700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.454306+0000 front 2019-12-09T17:54:28.572976+0000 (oldest deadline 2019-12-09T17:55:08.222032+0000) 2019-12-09T17:55:21.263 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:55:21.259+0000 1694f700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.812648+0000 front 2019-12-09T17:54:28.821446+0000 (oldest deadline 2019-12-09T17:55:10.385241+0000) 2019-12-09T17:55:21.517 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:21.510+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:21.720 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:55:21.715+0000 1694f700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:31.684326+0000 front 2019-12-09T17:54:27.442320+0000 (oldest deadline 2019-12-09T17:55:08.486257+0000) 2019-12-09T17:55:21.745 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:55:21.742+0000 1694f700 -1 osd.6 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.845771+0000 front 2019-12-09T17:54:28.842528+0000 (oldest deadline 2019-12-09T17:55:14.759071+0000) 2019-12-09T17:55:21.775 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:55:21.771+0000 1694f700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:29.343823+0000 front 2019-12-09T17:54:29.353806+0000 (oldest deadline 2019-12-09T17:55:11.017635+0000) 2019-12-09T17:55:22.060 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:55:22.056+0000 1694f700 -1 osd.4 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.454306+0000 front 2019-12-09T17:54:28.572976+0000 (oldest deadline 2019-12-09T17:55:08.222032+0000) 2019-12-09T17:55:22.260 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:55:22.255+0000 1694f700 -1 osd.1 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:28.812648+0000 front 2019-12-09T17:54:28.821446+0000 (oldest deadline 2019-12-09T17:55:10.385241+0000) 2019-12-09T17:55:22.550 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:55:22.546+0000 1694f700 -1 osd.0 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:22.217424+0000 front 2019-12-09T17:54:22.318890+0000 (oldest deadline 2019-12-09T17:55:06.292959+0000) 2019-12-09T17:55:22.677 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:55:22.673+0000 1694f700 -1 osd.7 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:31.684326+0000 front 2019-12-09T17:54:27.442320+0000 (oldest deadline 2019-12-09T17:55:08.486257+0000) 2019-12-09T17:55:22.758 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:55:22.754+0000 1694f700 -1 osd.3 175 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:54:29.343823+0000 front 2019-12-09T17:54:29.353806+0000 (oldest deadline 2019-12-09T17:55:11.017635+0000) 2019-12-09T17:56:54.153 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:56:54.133+0000 1694f700 -1 osd.2 180 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=13 ondisk+retry+read+known_if_redirected e179) 2019-12-09T17:56:55.284 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:56:55.196+0000 1694f700 -1 osd.2 180 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=13 ondisk+retry+read+known_if_redirected e179) 2019-12-09T17:57:46.665 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:57:46.659+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:57:47.440 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:57:47.433+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:57:47.716 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:57:47.712+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:57:48.457 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:57:48.452+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:57:48.472 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:57:48.467+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:57:48.684 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:57:48.680+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:57:49.397 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:57:49.392+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:57:49.429 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:57:49.424+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:57:49.489 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:57:49.484+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:57:49.500 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:57:49.496+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:57:49.716 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:57:49.711+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:57:50.377 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:57:50.373+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:57:50.416 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:57:50.411+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:57:50.443 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:57:50.439+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:57:50.487 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:57:50.476+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:57:50.512 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:57:50.507+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:57:50.711 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:57:50.706+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:57:51.313 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:57:51.308+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:57:51.394 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:57:51.387+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:57:51.404 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:57:51.399+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:57:51.460 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:57:51.453+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:57:51.494 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:57:51.490+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:57:51.523 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:57:51.519+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:57:51.767 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:57:51.761+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:57:52.316 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:57:52.311+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:57:52.377 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:57:52.372+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:57:52.415 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:57:52.410+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:57:52.433 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:57:52.427+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:57:52.487 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:57:52.481+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:57:52.493 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:57:52.489+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:57:52.745 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:57:52.739+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:57:53.307 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:57:53.303+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:57:53.418 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:57:53.413+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:57:53.462 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:57:53.457+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:57:53.463 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:57:53.458+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:57:53.470 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:57:53.464+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:57:53.547 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:57:53.542+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:57:53.712 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:57:53.707+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:57:54.299 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:57:54.293+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:57:54.462 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:57:54.457+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:57:54.477 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:57:54.472+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:57:54.483 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:57:54.479+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:57:54.495 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:57:54.491+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:57:54.508 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:57:54.503+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:57:54.694 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:57:54.691+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:57:55.335 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:57:55.330+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:57:55.428 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:57:55.419+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:57:55.460 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:57:55.455+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:57:55.502 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:57:55.497+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:57:55.524 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:57:55.520+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:57:55.542 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:57:55.538+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:57:55.712 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:57:55.706+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:57:56.386 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:57:56.381+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:57:56.442 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:57:56.438+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:57:56.468 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:57:56.463+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:57:56.492 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:57:56.486+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:57:56.514 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:57:56.509+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:57:56.549 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:57:56.544+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:57:56.675 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:57:56.671+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:57:57.439 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:57:57.434+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:57:57.441 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:57:57.436+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:57:57.447 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:57:57.442+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:57:57.506 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:57:57.502+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:57:57.548 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:57:57.544+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:57:57.554 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:57:57.549+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:57:57.702 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:57:57.697+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:57:58.394 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:57:58.390+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:57:58.440 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:57:58.436+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:57:58.490 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:57:58.485+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:57:58.496 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:57:58.489+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:57:58.583 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:57:58.578+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:57:58.585 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:57:58.580+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:57:58.680 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:57:58.676+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:57:59.360 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:57:59.355+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:57:59.412 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:57:59.407+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:57:59.468 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:57:59.462+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:57:59.482 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:57:59.476+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:57:59.608 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:57:59.602+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:57:59.638 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:57:59.633+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:57:59.651 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:57:59.645+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:00.358 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:00.354+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:00.375 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:00.371+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:00.437 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:00.434+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:00.509 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:00.505+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:00.631 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:00.626+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:00.673 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:00.668+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:00.685 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:00.679+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:01.335 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:01.331+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:01.410 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:01.405+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:01.453 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:01.447+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:01.517 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:01.509+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:01.662 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:01.656+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:01.670 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:01.664+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:01.714 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:01.708+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:02.351 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:02.345+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:02.435 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:02.428+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:02.444 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:02.439+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:02.525 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:02.519+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:02.638 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:02.632+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:02.646 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:02.641+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:02.735 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:02.730+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:03.307 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:03.304+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:03.471 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:03.468+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:03.474 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:03.468+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:03.561 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:03.554+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:03.593 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:03.587+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:03.696 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:03.675+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:03.748 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:03.743+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:04.280 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:04.275+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:04.453 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:04.449+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:04.528 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:04.522+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:04.573 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:04.567+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:04.606 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:04.600+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:04.694 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:04.689+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:04.744 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:04.738+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:05.247 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:05.241+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:05.424 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:05.420+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:05.566 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:05.559+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:05.569 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:05.564+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:05.589 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:05.583+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:05.682 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:05.677+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:05.758 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:05.754+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:06.256 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:06.251+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:06.424 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:06.421+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:06.579 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:06.565+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:06.580 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:06.575+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:06.629 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:06.622+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:06.726 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:06.720+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:06.750 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:06.744+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:07.264 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:07.260+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:07.426 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:07.421+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:07.542 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:07.537+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:07.613 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:07.608+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:07.672 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:07.666+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:07.711 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:07.706+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:07.723 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:07.718+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:08.290 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:08.286+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:08.398 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:08.392+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:08.540 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:08.535+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:08.661 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:08.654+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:08.681 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:08.674+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:08.718 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:08.713+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:08.737 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:08.731+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:09.260 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:09.256+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:09.453 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:09.445+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:09.502 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:09.496+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:09.658 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:09.652+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:09.680 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:09.675+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:09.700 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:09.693+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:09.739 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:09.733+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:10.257 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:10.252+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:10.468 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:10.464+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:10.484 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:10.477+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:10.646 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:10.641+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:10.662 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:10.656+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:10.738 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:10.732+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:10.743 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:10.738+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:11.250 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:11.246+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:11.502 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:11.498+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:11.518 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:11.512+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:11.632 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:11.627+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:11.659 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:11.653+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:11.704 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:11.698+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:11.793 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:11.786+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:12.293 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:12.288+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:12.492 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:12.487+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:12.497 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:12.491+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:12.673 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:12.666+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:12.674 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:12.668+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:12.760 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:12.753+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:12.847 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:12.841+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:13.253 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:13.249+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:13.471 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:13.464+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:13.525 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:13.520+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:13.682 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:13.675+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:13.707 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:13.703+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:13.741 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:13.735+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:13.874 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:13.867+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:14.284 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:14.279+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:14.433 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:14.427+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:14.551 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:14.547+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:14.702 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:14.695+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:14.722 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:14.717+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:14.739 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:14.733+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:14.882 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:14.876+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:15.264 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:15.258+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:15.456 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:15.450+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:15.519 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:15.514+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:15.693 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:15.684+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:15.744 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:15.740+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:15.774 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:15.769+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:15.917 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:15.912+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:16.256 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:16.252+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:16.424 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:16.419+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:16.506 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:16.503+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:16.715 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:16.709+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:16.720 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:16.716+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:16.774 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:16.769+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:16.921 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:16.915+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:17.275 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:17.269+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:17.395 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:17.387+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:17.479 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:17.475+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:58:17.714 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:58:17.709+0000 1694f700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:07.006335+0000 front 2019-12-09T17:57:02.180637+0000 (oldest deadline 2019-12-09T17:57:46.621914+0000) 2019-12-09T17:58:17.749 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:58:17.743+0000 1694f700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:05.552892+0000 front 2019-12-09T17:57:06.113581+0000 (oldest deadline 2019-12-09T17:57:48.935345+0000) 2019-12-09T17:58:17.770 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:58:17.765+0000 1694f700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.424434+0000 front 2019-12-09T17:57:02.439322+0000 (oldest deadline 2019-12-09T17:57:47.259260+0000) 2019-12-09T17:58:17.977 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:58:17.971+0000 1694f700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:02.491258+0000 front 2019-12-09T17:57:02.492489+0000 (oldest deadline 2019-12-09T17:57:47.754776+0000) 2019-12-09T17:58:18.246 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:58:18.241+0000 1694f700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.891876+0000 front 2019-12-09T17:57:06.125806+0000 (oldest deadline 2019-12-09T17:57:49.493134+0000) 2019-12-09T17:58:18.289 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T17:58:18.270+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 45sec e180 v180) 2019-12-09T17:58:18.421 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T17:58:18.415+0000 1694f700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:04.333513+0000 front 2019-12-09T17:57:02.826191+0000 (oldest deadline 2019-12-09T17:57:48.484136+0000) 2019-12-09T17:58:18.485 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:58:18.483+0000 1694f700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T17:57:06.881452+0000 front 2019-12-09T17:57:06.125420+0000 (oldest deadline 2019-12-09T17:57:50.545687+0000) 2019-12-09T17:59:08.903 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:20:06.930 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:59:08.911 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:20:06.938 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:59:08.923 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:20:06.950 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:59:08.924 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:20:06.888 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:59:08.927 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:20:06.954 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:59:08.931 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:20:06.895 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:59:09.187 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:20:07.150 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T17:59:09.236 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:20:07.263 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T17:59:09.264 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:20:07.291 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T17:59:15.486 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:15.482+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:16.469 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:16.465+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:17.186 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:17.181+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:17.500 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:17.495+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:17.601 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:17.593+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:18.190 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:18.186+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:18.523 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:18.519+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:18.572 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:18.568+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:18.922 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:59:18.917+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.825883+0000 front 2019-12-09T17:58:34.271787+0000 (oldest deadline 2019-12-09T17:59:18.167639+0000) 2019-12-09T17:59:19.090 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:19.085+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:19.225 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:19.220+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:19.491 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:19.485+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:19.599 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:19.594+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:19.634 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:19.629+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:19.917 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:59:19.912+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.825883+0000 front 2019-12-09T17:58:34.271787+0000 (oldest deadline 2019-12-09T17:59:18.167639+0000) 2019-12-09T17:59:20.064 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:20.059+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:20.254 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:20.249+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:20.502 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:20.496+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:20.626 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:20.620+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:20.629 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:20.625+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:20.965 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:59:20.959+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.825883+0000 front 2019-12-09T17:58:34.271787+0000 (oldest deadline 2019-12-09T17:59:18.167639+0000) 2019-12-09T17:59:21.075 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:21.070+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:21.280 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:21.275+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:21.468 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:21.463+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:21.607 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:21.601+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:21.682 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:21.677+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:21.943 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:59:21.938+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.825883+0000 front 2019-12-09T17:58:34.271787+0000 (oldest deadline 2019-12-09T17:59:18.167639+0000) 2019-12-09T17:59:22.130 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:22.125+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:22.306 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:22.301+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:22.497 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:22.493+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:22.571 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:22.565+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:22.709 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:22.704+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:22.933 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:59:22.928+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.825883+0000 front 2019-12-09T17:58:34.271787+0000 (oldest deadline 2019-12-09T17:59:18.167639+0000) 2019-12-09T17:59:23.112 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:23.107+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:23.302 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:23.298+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:23.474 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:23.470+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:23.625 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:23.619+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:23.737 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:23.732+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:23.955 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:59:23.950+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.825883+0000 front 2019-12-09T17:58:34.271787+0000 (oldest deadline 2019-12-09T17:59:18.167639+0000) 2019-12-09T17:59:24.086 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:24.082+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:24.328 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:24.324+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:24.522 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:24.518+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:24.639 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:24.635+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:24.734 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:24.730+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:24.997 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:59:24.991+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.825883+0000 front 2019-12-09T17:58:34.271787+0000 (oldest deadline 2019-12-09T17:59:18.167639+0000) 2019-12-09T17:59:25.076 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:25.070+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:25.350 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:25.346+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:25.535 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:25.531+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:25.659 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:25.653+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:25.723 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:25.719+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:25.990 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:59:25.984+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.825883+0000 front 2019-12-09T17:58:34.271787+0000 (oldest deadline 2019-12-09T17:59:18.167639+0000) 2019-12-09T17:59:26.058 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:26.053+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:26.330 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:26.327+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:26.332 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:26.328+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:26.575 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:26.572+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:26.651 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:26.646+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:26.701 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:26.697+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:26.958 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:59:26.953+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.825883+0000 front 2019-12-09T17:58:34.271787+0000 (oldest deadline 2019-12-09T17:59:18.167639+0000) 2019-12-09T17:59:27.065 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:27.060+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:27.346 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:27.343+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:27.364 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:27.361+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:27.552 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:27.548+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:27.684 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:27.678+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:27.695 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:27.691+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:28.002 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:59:27.997+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.825883+0000 front 2019-12-09T17:58:34.271787+0000 (oldest deadline 2019-12-09T17:59:18.167639+0000) 2019-12-09T17:59:28.046 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:28.041+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:28.320 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:28.317+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:28.387 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:28.384+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:28.532 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:28.528+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:28.698 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:28.693+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:28.712 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:28.710+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:29.005 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:59:28.999+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.825883+0000 front 2019-12-09T17:58:34.271787+0000 (oldest deadline 2019-12-09T17:59:18.167639+0000) 2019-12-09T17:59:29.056 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:29.051+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:29.370 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:29.366+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:29.432 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:29.429+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:29.573 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:29.570+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:29.676 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:29.672+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:29.704 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:29.701+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:30.045 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T17:59:30.040+0000 1694f700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.825883+0000 front 2019-12-09T17:58:34.271787+0000 (oldest deadline 2019-12-09T17:59:18.167639+0000) 2019-12-09T17:59:30.078 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:30.073+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:30.415 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:30.411+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:30.469 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:30.466+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:30.629 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:30.625+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:30.681 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:30.675+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:30.711 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:30.709+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:31.103 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:31.098+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:31.422 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:31.418+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:31.452 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:31.448+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:31.657 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:31.653+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:31.686 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:31.681+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:31.717 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:31.713+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:32.114 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:32.108+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:32.421 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:32.417+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:32.422 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:32.420+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:32.660 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:32.656+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:32.735 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:32.731+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:32.756 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:32.753+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:33.084 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:33.078+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:33.397 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:33.393+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:33.400 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:33.396+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:33.401 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:33.396+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:33.638 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:33.634+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:33.742 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:33.737+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:33.760 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:33.755+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:34.065 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:34.060+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:34.404 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:34.398+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:34.413 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:34.409+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:34.415 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:34.412+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:34.662 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:34.657+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:34.709 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:34.704+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:34.755 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:34.750+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:35.072 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:35.067+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:35.393 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:35.388+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:35.406 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:35.401+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:35.408 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:35.405+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:35.638 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:35.633+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:35.763 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:35.758+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:35.787 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:35.782+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:36.030 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:36.024+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:36.366 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:36.362+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:36.370 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:36.365+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:36.372 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:36.367+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:36.677 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:36.672+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:36.749 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:36.745+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:36.808 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:36.804+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:37.057 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:37.052+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:37.413 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:37.407+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:37.413 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:37.407+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:37.414 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:37.409+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:37.636 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:37.631+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:37.737 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:37.728+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:37.777 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:37.772+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:38.096 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:38.089+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:38.394 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:38.390+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:38.424 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:38.419+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:38.424 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:38.420+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:38.647 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:38.642+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:38.699 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:38.694+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:38.820 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:38.816+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:39.147 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:39.143+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:39.439 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:39.434+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:39.451 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:39.446+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:39.454 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:39.450+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:39.640 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:39.636+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:39.740 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:39.735+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:39.777 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:39.772+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:40.158 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:40.154+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:40.407 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:40.402+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:40.488 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:40.484+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:40.489 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:40.485+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:40.666 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:40.659+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:40.757 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:40.753+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:40.777 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:40.773+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:41.186 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:41.181+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:41.414 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:41.408+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:41.451 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:41.447+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:41.453 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:41.450+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:41.645 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:41.640+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:41.750 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:41.746+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:41.797 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:41.793+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:42.201 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:42.196+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:42.396 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:42.385+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:42.499 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:42.495+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:42.500 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:42.496+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:42.678 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:42.674+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:42.734 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:42.726+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:42.792 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:42.787+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:43.207 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:43.204+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:43.439 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:43.433+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:43.529 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:43.524+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:43.530 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:43.526+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:43.699 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:43.695+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:43.714 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:43.710+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:43.774 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:43.770+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:44.196 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:44.191+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:44.408 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:44.403+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:44.581 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:44.575+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:44.665 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:44.579+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:44.704 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:44.699+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:44.706 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:44.701+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:44.816 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:44.812+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:45.223 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:45.218+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:45.412 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:45.407+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:45.559 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:45.554+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:45.573 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:45.559+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:45.708 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:45.703+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:45.733 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:45.727+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:45.816 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:45.811+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:46.183 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:46.179+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:46.409 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:46.404+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:46.533 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:46.529+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:46.534 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:46.530+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:46.715 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:46.710+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:46.726 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:46.721+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:46.807 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:46.803+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:47.234 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:47.230+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:47.449 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:47.444+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:47.586 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:47.580+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:47.586 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:47.582+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:47.697 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:47.693+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:47.763 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:47.758+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:47.780 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:47.776+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:48.289 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:48.285+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:48.420 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:48.416+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:48.586 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:48.581+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:48.587 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:48.583+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:48.621 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T17:59:48.611+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e185 v185) 2019-12-09T17:59:48.711 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:48.707+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:48.735 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:48.731+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:48.786 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:48.778+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:49.339 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:49.335+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:49.427 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:49.423+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:49.542 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:49.537+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:49.542 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:49.539+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:49.684 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:49.679+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:49.718 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:49.713+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:49.828 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:49.823+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:50.373 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:50.369+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:50.469 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:50.464+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:50.533 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:50.529+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:50.533 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:50.530+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:50.728 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:50.723+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:50.756 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:50.751+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:50.852 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:50.847+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:51.329 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:51.325+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:51.482 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:51.477+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:51.571 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:51.566+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:51.572 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:51.567+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:51.724 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:51.716+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:51.808 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:51.802+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:51.873 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:51.868+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:52.369 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:52.366+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:52.500 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:52.495+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:52.589 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:52.585+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:52.589 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:52.586+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:52.716 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:52.712+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:52.765 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:52.759+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:52.919 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:52.914+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:53.341 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:53.336+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:53.500 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:53.495+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:53.629 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:53.624+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:53.631 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:53.628+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:53.637 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T17:59:53.633+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e185 v185) 2019-12-09T17:59:53.733 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:53.727+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:53.744 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:53.740+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:53.967 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:53.962+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:54.343 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:54.338+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:54.474 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:54.463+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:54.683 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:54.678+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:54.683 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:54.679+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:54.723 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:54.719+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:54.743 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:54.738+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:54.929 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:54.925+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:55.329 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:55.323+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:55.436 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:55.432+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:55.660 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:55.655+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:55.660 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:55.656+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:55.748 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:55.744+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:55.789 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:55.784+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:55.952 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:55.947+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:56.383 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:56.378+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:56.412 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:56.407+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:56.678 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:56.674+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:56.680 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:56.677+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:56.779 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:56.775+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:56.842 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:56.836+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:56.936 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:56.930+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:57.400 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:57.394+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:57.450 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:57.445+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:57.643 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:57.638+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:57.645 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:57.642+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:57.798 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:57.794+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:57.878 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:57.873+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:57.962 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:57.952+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:58.419 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:58.415+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:58.419 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:58.413+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:58.621 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:58.617+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:58.622 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:58.618+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:58.656 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T17:59:58.650+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e185 v185) 2019-12-09T17:59:58.811 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:58.806+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:58.845 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:58.838+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:58.935 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:58.932+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T17:59:59.382 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T17:59:59.377+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T17:59:59.384 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T17:59:59.380+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T17:59:59.607 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:59.603+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T17:59:59.610 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T17:59:59.607+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T17:59:59.812 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T17:59:59.808+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T17:59:59.843 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T17:59:59.838+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T17:59:59.956 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T17:59:59.949+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T18:00:00.396 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:00:00.392+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T18:00:00.432 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:00:00.426+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T18:00:00.650 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:00:00.644+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T18:00:00.651 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:00:00.647+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T18:00:00.828 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:00:00.823+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T18:00:00.866 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:00:00.862+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T18:00:00.920 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:00:00.915+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T18:00:01.429 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:00:01.424+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T18:00:01.458 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:00:01.452+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T18:00:01.669 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:00:01.665+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T18:00:01.670 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:00:01.666+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T18:00:01.792 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:00:01.788+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T18:00:01.855 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:00:01.851+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T18:00:01.969 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:00:01.965+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T18:00:02.385 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:00:02.379+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T18:00:02.421 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:00:02.415+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T18:00:02.629 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:00:02.624+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T18:00:02.629 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:00:02.625+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T18:00:02.760 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:00:02.754+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T18:00:02.856 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:00:02.852+0000 1694f700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.359925+0000 front 2019-12-09T17:58:34.139943+0000 (oldest deadline 2019-12-09T17:59:15.356779+0000) 2019-12-09T18:00:03.008 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:00:03.003+0000 1694f700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:32.590244+0000 front 2019-12-09T17:58:33.999783+0000 (oldest deadline 2019-12-09T17:59:17.157122+0000) 2019-12-09T18:00:03.352 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:00:03.347+0000 1694f700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:31.923027+0000 front 2019-12-09T17:58:32.234963+0000 (oldest deadline 2019-12-09T17:59:16.429422+0000) 2019-12-09T18:00:03.465 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:00:03.460+0000 1694f700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:33.576889+0000 front 2019-12-09T17:58:36.309527+0000 (oldest deadline 2019-12-09T17:59:18.246547+0000) 2019-12-09T18:00:03.653 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:00:03.648+0000 1694f700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T17:58:52.472087+0000 (oldest deadline 2019-12-09T17:59:32.472087+0000) 2019-12-09T18:00:03.655 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:00:03.652+0000 1694f700 -1 osd.2 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e184) 2019-12-09T18:00:03.726 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:00:03.713+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e185 v185) 2019-12-09T18:00:03.753 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:00:03.748+0000 1694f700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T17:58:34.368952+0000 front 2019-12-09T17:58:34.303131+0000 (oldest deadline 2019-12-09T17:59:18.861160+0000) 2019-12-09T18:00:24.952 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:00:24.949+0000 1694f700 -1 osd.5 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:132511 7.9 7.123646f9 (undecoded) ondisk+retry+write+known_if_redirected e185) 2019-12-09T18:01:49.226 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:22:47.253 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:49.238 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:22:47.265 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:49.271 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:22:47.298 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:49.280 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:22:47.306 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:49.312 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:22:47.276 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:49.316 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:22:47.280 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:49.385 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:22:47.412 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:49.417 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:22:47.443 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:49.473 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:22:47.436 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:01:52.657 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:01:52.647+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:09.467421+0000 front 2019-12-09T18:01:09.321364+0000 (oldest deadline 2019-12-09T18:01:52.190718+0000) 2019-12-09T18:01:53.300 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:01:53.294+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:01:53.620 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:01:53.615+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:09.467421+0000 front 2019-12-09T18:01:09.321364+0000 (oldest deadline 2019-12-09T18:01:52.190718+0000) 2019-12-09T18:01:53.670 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:01:53.667+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:01:54.268 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:01:54.262+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:01:54.466 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:01:54.462+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:01:54.636 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:01:54.628+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:09.467421+0000 front 2019-12-09T18:01:09.321364+0000 (oldest deadline 2019-12-09T18:01:52.190718+0000) 2019-12-09T18:01:54.715 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:01:54.712+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:01:55.257 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:01:55.251+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:01:55.376 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:01:55.372+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:01:55.470 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:01:55.466+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:01:55.722 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:01:55.719+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:01:56.135 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:01:56.129+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:01:56.220 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:01:56.213+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:01:56.394 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:01:56.389+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:01:56.523 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:01:56.518+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:01:56.748 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:01:56.743+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:01:57.156 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:01:57.150+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:01:57.216 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:01:57.210+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:01:57.386 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:01:57.379+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:01:57.487 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:01:57.480+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:01:57.502 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:01:57.497+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:01:57.751 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:01:57.745+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:01:58.166 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:01:58.160+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:01:58.245 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:01:58.238+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:01:58.367 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:01:58.362+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:01:58.530 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:01:58.523+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:01:58.531 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:01:58.526+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:01:58.800 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:01:58.795+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:01:59.149 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:01:59.143+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:01:59.258 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:01:59.252+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:01:59.331 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:01:59.326+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:01:59.515 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:01:59.508+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:01:59.566 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:01:59.559+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:01:59.762 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:01:59.757+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:00.183 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:00.175+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:00.244 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:00.237+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:00.313 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:00.306+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:00.507 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:00.501+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:00.583 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:00.576+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:00.747 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:00.743+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:01.169 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:01.162+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:01.213 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:01.207+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:01.299 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:01.292+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:01.531 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:01.526+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:01.557 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:01.549+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:01.757 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:01.752+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:02.141 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:02.131+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:02.187 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:02.181+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:02.258 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:02.253+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:02.536 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:02.529+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:02.550 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:02.544+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:02.766 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:02.760+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:03.190 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:03.185+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:03.212 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:03.206+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:03.253 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:03.249+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:03.500 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:03.491+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:03.545 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:03.540+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:03.781 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:03.777+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:04.159 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:04.148+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:04.248 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:04.241+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:04.257 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:04.252+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:04.534 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:04.528+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:04.588 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:04.583+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:04.822 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:04.818+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:05.152 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:05.145+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:05.289 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:05.283+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:05.296 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:05.290+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:05.578 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:05.573+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:05.588 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:05.583+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:05.877 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:05.868+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:06.142 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:06.137+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:06.274 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:06.269+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:06.299 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:06.294+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:06.558 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:06.553+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:06.600 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:06.595+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:06.852 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:06.847+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:07.125 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:07.120+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:07.245 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:07.240+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:07.287 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:07.282+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:07.543 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:07.534+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:07.592 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:07.587+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:07.863 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:07.859+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:08.113 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:08.107+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:08.262 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:08.257+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:08.274 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:08.269+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:08.494 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:08.490+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:08.566 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:08.561+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:08.893 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:08.890+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:09.137 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:09.130+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:09.222 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:09.216+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:09.316 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:09.311+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:09.526 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:09.521+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:09.549 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:09.543+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:09.894 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:09.889+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:10.115 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:10.109+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:10.207 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:10.201+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:10.346 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:10.341+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:10.530 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:10.526+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:10.568 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:10.563+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:10.911 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:10.906+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:11.118 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:11.113+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:11.197 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:11.192+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:11.386 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:11.380+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:11.553 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:11.548+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:11.598 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:11.593+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:11.923 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:11.919+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:12.146 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:12.140+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:12.249 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:12.243+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:12.378 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:12.372+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:12.545 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:12.536+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:12.600 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:12.595+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:12.902 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:12.897+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:13.108 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:13.103+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:13.273 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:13.268+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:13.428 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:13.422+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:13.576 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:13.571+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:13.624 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:13.618+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:13.895 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:13.891+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:14.151 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:14.146+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:14.289 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:14.283+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:14.470 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:14.466+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:14.603 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:14.599+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:14.641 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:14.636+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:14.884 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:14.879+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:15.168 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:15.163+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:15.249 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:15.244+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:15.440 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:15.435+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:15.607 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:15.601+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:15.655 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:15.651+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:15.865 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:15.862+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:16.160 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:16.153+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:16.234 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:16.228+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:16.427 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:16.422+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:16.611 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:16.606+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:16.647 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:16.642+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:16.911 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:16.906+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:17.153 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:17.147+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:17.193 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:17.187+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:17.462 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:17.457+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:17.622 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:17.616+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:17.651 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:17.645+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:17.953 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:17.948+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:18.143 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:18.136+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:18.186 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:18.181+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:18.429 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:18.424+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:18.582 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:18.577+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:18.674 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:18.669+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:18.939 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:18.934+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:19.148 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:19.143+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:19.156 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:19.151+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:19.472 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:19.467+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:19.594 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:19.588+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:19.704 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:19.698+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:19.927 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:19.922+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:20.105 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:20.100+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:20.198 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:20.193+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:20.508 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:20.504+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:20.564 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:20.560+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:20.692 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:20.687+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:20.902 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:20.897+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:21.117 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:21.112+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:21.179 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:21.174+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:21.476 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:21.471+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:21.617 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:21.612+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:21.647 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:21.642+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:21.885 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:21.880+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:22.083 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:22.078+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:22.147 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:22.142+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:22.467 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:22.462+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:22.634 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:22.628+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:22.665 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:22.661+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:22.857 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:22.852+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:23.097 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:23.091+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:23.165 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:23.159+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:23.500 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:23.495+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:23.628 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:23.622+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:23.677 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:23.673+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:23.872 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:23.867+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:24.072 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:24.066+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:24.220 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:24.214+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:24.285 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:02:24.279+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 43sec e190 v190) 2019-12-09T18:02:24.519 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:24.515+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:24.634 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:24.629+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:24.654 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:24.648+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:24.843 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:24.838+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:25.042 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:25.036+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:25.210 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:25.204+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:25.497 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:25.493+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:25.612 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:25.607+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:25.634 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:25.627+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:25.891 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:25.886+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:26.066 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:26.060+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:26.210 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:26.203+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:26.465 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:26.460+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:26.593 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:26.587+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:26.613 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:26.608+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:26.886 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:26.881+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:27.081 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:27.075+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:27.256 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:27.250+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:27.508 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:27.504+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:27.602 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:27.596+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:27.615 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:27.608+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:27.880 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:27.875+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:28.051 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:28.045+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:28.285 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:28.278+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:28.529 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:02:28.523+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.042390+0000 front 2019-12-09T18:01:11.184524+0000 (oldest deadline 2019-12-09T18:01:54.933486+0000) 2019-12-09T18:02:28.586 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:02:28.581+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.213047+0000 front 2019-12-09T18:01:11.226471+0000 (oldest deadline 2019-12-09T18:01:53.489642+0000) 2019-12-09T18:02:28.624 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:02:28.619+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:11.857200+0000 front 2019-12-09T18:01:12.022254+0000 (oldest deadline 2019-12-09T18:01:56.526136+0000) 2019-12-09T18:02:28.842 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:02:28.838+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:07.669513+0000 front 2019-12-09T18:01:07.635643+0000 (oldest deadline 2019-12-09T18:01:52.900337+0000) 2019-12-09T18:02:29.094 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:02:29.088+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:08.705781+0000 front 2019-12-09T18:01:08.708725+0000 (oldest deadline 2019-12-09T18:01:52.923709+0000) 2019-12-09T18:02:29.325 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:02:29.319+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:01:10.082584+0000 front 2019-12-09T18:01:10.346474+0000 (oldest deadline 2019-12-09T18:01:55.342497+0000) 2019-12-09T18:02:29.344 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:02:29.336+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 43sec e190 v190) 2019-12-09T18:03:10.258 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:24:08.284 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:03:10.262 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:24:08.289 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:03:10.266 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:24:08.229 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:03:10.269 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:24:08.233 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:03:10.271 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:24:08.297 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:03:10.278 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:24:08.305 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:03:10.389 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:24:08.352 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:03:10.442 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:24:08.469 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:03:10.478 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:24:08.505 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:03:24.220 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:24.215+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:24.384 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:24.380+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:25.084 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:25.079+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:25.273 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:25.264+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:25.377 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:25.373+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:26.130 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:26.125+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:26.252 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:26.246+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:26.399 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:26.395+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:26.503 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:26.499+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:27.033 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:27.027+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:27.173 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:27.169+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:27.285 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:27.280+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:27.439 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:27.435+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:27.468 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:27.462+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:27.760 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:27.755+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:28.024 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:28.020+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:28.162 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:28.158+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:28.258 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:28.252+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:28.441 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:28.436+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:28.493 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:28.488+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:28.725 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:28.721+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:28.996 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:28.992+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:29.191 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:29.185+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:29.303 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:29.298+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:29.424 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:29.421+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:29.507 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:29.502+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:29.778 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:29.773+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:29.991 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:29.985+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:30.158 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:30.154+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:30.339 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:30.333+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:30.457 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:30.452+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:30.555 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:30.550+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:30.831 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:30.827+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:31.016 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:31.012+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:31.149 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:31.145+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:31.316 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:31.312+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:31.484 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:31.480+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:31.546 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:31.542+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:31.810 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:31.805+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:32.031 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:32.026+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:32.124 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:32.119+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:32.297 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:32.291+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:32.527 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:32.522+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:32.531 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:32.527+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:32.775 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:32.771+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:33.021 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:33.016+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:33.080 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:33.075+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:33.285 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:33.279+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:33.505 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:33.500+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:33.539 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:33.534+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:33.791 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:33.784+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:33.981 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:33.976+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:34.128 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:34.122+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:34.311 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:34.306+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:34.483 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:34.478+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:34.564 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:34.560+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:34.792 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:34.788+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:35.030 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:35.025+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:35.085 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:35.081+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:35.326 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:35.321+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:35.452 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:35.447+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:35.584 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:35.580+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:35.791 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:35.787+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:35.986 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:35.981+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:36.065 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:36.059+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:36.299 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:36.293+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:36.497 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:36.492+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:36.543 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:36.539+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:36.842 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:36.834+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:36.994 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:36.990+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:37.068 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:37.063+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:37.319 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:37.315+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:37.526 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:37.521+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:37.532 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:37.527+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:37.879 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:37.869+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:38.035 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:38.029+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:38.085 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:38.080+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:38.351 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:38.346+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:38.488 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:38.484+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:38.531 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:38.525+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:38.901 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:38.895+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:39.082 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:39.076+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:39.114 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:39.110+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:39.311 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:39.307+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:39.537 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:39.532+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:39.554 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:39.548+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:39.640 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:39.633+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:39.921 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:39.915+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:40.116 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:40.109+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:40.162 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:40.157+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:40.288 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:40.283+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:40.540 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:40.536+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:40.568 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:40.564+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:40.677 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:40.674+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:40.973 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:40.968+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:41.122 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:41.116+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:41.135 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:41.129+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:41.290 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:41.285+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:41.544 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:41.537+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:41.592 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:41.588+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:41.702 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:41.695+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:41.975 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:41.968+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:42.091 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:42.086+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:42.170 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:42.165+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:42.254 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:42.249+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:42.565 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:42.560+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:42.584 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:42.578+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:42.714 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:42.709+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:42.980 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:42.974+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:43.085 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:43.080+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:43.225 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:43.219+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:43.270 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:43.265+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:43.576 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:43.572+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:43.637 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:43.629+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:43.690 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:43.684+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:43.948 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:43.937+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:44.073 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:44.068+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:44.201 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:44.191+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:44.264 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:44.258+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:44.636 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:44.627+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:44.641 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:44.636+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:44.709 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:44.705+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:44.997 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:44.991+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:45.097 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:45.092+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:45.162 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:45.156+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:45.259 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:45.253+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:45.602 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:45.597+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:45.667 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:45.662+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:45.753 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:45.748+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:46.050 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:46.045+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:46.101 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:46.095+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:46.185 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:46.180+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:46.246 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:46.240+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:46.617 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:46.611+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:46.661 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:46.657+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:46.763 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:46.755+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:03:46.772 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:46.759+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:47.061 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:47.056+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:47.078 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:47.072+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:47.195 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:47.187+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:47.243 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:47.239+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:47.618 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:47.612+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:47.620 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:47.615+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:47.738 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:47.731+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:03:47.743 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:47.734+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:48.050 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:48.042+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:48.055 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:48.050+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:48.229 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:48.223+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:48.299 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:48.294+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:48.620 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:48.614+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:48.650 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:48.644+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:48.704 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:48.695+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:03:48.708 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:48.701+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:49.015 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:49.011+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:49.038 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:49.033+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:49.185 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:49.179+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:49.307 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:49.302+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:49.655 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:49.650+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:49.674 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:49.670+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:49.701 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:49.694+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:03:49.704 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:49.698+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:50.041 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:50.036+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:50.079 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:50.074+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:50.238 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:50.232+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:50.355 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:50.350+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:50.674 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:50.669+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:50.702 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:50.697+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:50.742 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:50.734+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:03:50.745 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:50.739+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:51.080 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:51.075+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:51.105 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:51.100+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:51.224 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:51.219+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:51.364 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:51.360+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:51.630 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:51.625+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:51.674 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:51.669+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:51.792 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:51.787+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:03:51.799 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:51.793+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:52.092 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:52.086+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:52.134 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:52.128+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:52.192 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:52.187+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:52.363 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:52.358+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:52.645 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:52.641+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:52.699 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:52.694+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:52.793 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:52.785+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:03:52.796 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:52.790+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:53.112 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:53.107+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:53.157 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:53.152+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:53.243 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:53.239+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:53.378 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:53.372+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:53.662 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:53.657+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:53.753 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:53.747+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:53.759 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:53.751+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:03:53.762 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:53.756+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:54.149 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:54.141+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:54.149 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:54.138+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:54.243 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:54.237+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:54.411 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:54.406+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:54.636 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:54.632+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:54.738 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:54.732+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:54.787 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:54.783+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:03:54.792 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:54.787+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:55.184 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:55.179+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:55.197 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:55.191+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:55.283 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:55.277+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:55.410 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:55.404+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:55.665 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:55.660+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:55.769 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:55.763+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:55.828 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:55.820+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:03:55.829 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:55.824+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:56.138 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:56.133+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:56.209 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:56.204+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:56.290 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:56.284+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:56.384 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:56.379+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:56.660 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:56.656+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:56.790 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:56.785+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:56.852 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:56.846+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:03:56.853 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:56.849+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:57.178 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:57.173+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:57.241 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:57.236+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:57.267 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:57.262+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:57.367 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:57.363+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:57.680 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:57.674+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:57.779 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:57.775+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:57.882 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:57.878+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:03:57.886 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:57.882+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:58.220 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:58.215+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:58.226 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:58.222+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:58.229 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:58.225+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:58.325 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:58.321+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:58.645 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:58.635+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:58.740 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:58.735+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:58.879 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:58.874+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:03:58.889 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:58.882+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:03:59.187 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:03:59.182+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:03:59.191 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:03:59.186+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:03:59.238 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:03:59.233+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:03:59.283 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:03:59.279+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:03:59.621 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:03:59.613+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:03:59.722 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:03:59.717+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:03:59.733 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:03:59.724+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 46sec e196 v196) 2019-12-09T18:03:59.911 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:59.907+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:03:59.916 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:03:59.911+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:00.155 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:00.148+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:00.164 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:00.160+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:00.273 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:00.269+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:00.323 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:00.319+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:00.629 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:00.624+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:00.749 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:00.744+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:00.956 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:00.952+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:00.964 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:00.958+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:01.130 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:01.125+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:01.145 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:01.140+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:01.319 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:01.313+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:01.320 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:01.315+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:01.622 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:01.618+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:01.777 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:01.772+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:01.969 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:01.961+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:01.972 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:01.965+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:02.126 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:02.122+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:02.194 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:02.189+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:02.296 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:02.291+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:02.303 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:02.298+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:02.613 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:02.608+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:02.810 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:02.805+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:02.955 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:02.947+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:02.958 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:02.952+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:03.107 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:03.103+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:03.222 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:03.218+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:03.265 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:03.260+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:03.340 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:03.335+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:03.616 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:03.610+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:03.855 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:03.851+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:03.952 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:03.944+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:03.955 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:03.949+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:04.140 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:04.136+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:04.223 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:04.219+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:04.307 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:04.302+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:04.361 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:04.356+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:04.585 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:04.580+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:04.753 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:04:04.747+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 46sec e196 v196) 2019-12-09T18:04:04.825 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:04.820+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:04.929 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:04.924+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:04.931 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:04.926+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:05.112 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:05.107+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:05.223 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:05.218+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:05.323 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:05.317+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:05.347 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:05.342+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:05.565 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:05.560+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:05.868 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:05.864+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:05.887 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:05.882+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:05.897 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:05.891+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:06.144 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:06.139+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:06.270 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:06.264+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:06.309 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:06.304+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:06.353 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:06.348+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:06.596 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:06.591+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:06.826 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:06.822+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:06.877 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:06.869+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:06.878 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:06.874+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:07.145 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:07.140+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:07.299 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:07.292+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:07.305 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:07.302+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:07.354 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:07.350+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:07.603 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:07.598+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:07.826 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:07.822+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:07.899 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:07.895+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:07.913 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:07.908+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 54 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:08.182 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:08.177+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:08.335 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:08.330+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:08.343 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:08.339+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:08.349 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:08.344+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:08.618 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:08.612+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:08.852 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:08.847+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:08.901 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:08.893+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:08.905 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:08.897+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 54 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:09.162 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:09.157+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:09.308 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:09.303+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:09.317 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:09.311+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:09.387 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:09.381+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:09.669 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:09.664+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:09.775 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:04:09.767+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 46sec e196 v196) 2019-12-09T18:04:09.821 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:09.816+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:09.862 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:09.854+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:09.866 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:09.859+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 54 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:10.129 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:10.124+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:10.264 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:10.258+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:10.276 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:10.270+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:10.426 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:10.421+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:10.643 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:10.638+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:10.823 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:10.818+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:10.850 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:10.840+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:10.854 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:10.846+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 54 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:11.184 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:11.179+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:11.282 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:11.277+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:11.291 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:11.286+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:11.409 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:11.405+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:11.691 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:11.687+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:11.846 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:11.841+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:11.896 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:11.886+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:11.899 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:11.892+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 54 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:12.204 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:12.199+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:12.259 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:12.254+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:12.285 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:12.281+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:12.366 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:12.361+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:12.718 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:12.713+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:12.816 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:12.812+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:12.912 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:12.906+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:12.914 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:12.909+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 54 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:13.204 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:13.200+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:13.266 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:13.260+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:13.288 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:13.283+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:13.395 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:13.389+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:13.726 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:13.721+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:13.826 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:13.822+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:13.884 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:13.879+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:13.890 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:13.886+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 54 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:14.163 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:14.159+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:14.252 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:14.244+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:14.283 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:14.279+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:14.369 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:14.364+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:14.774 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:14.771+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:14.785 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:04:14.783+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 46sec e196 v196) 2019-12-09T18:04:14.826 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:14.821+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:14.864 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:14.861+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:14.869 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:14.865+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 54 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:15.148 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:15.143+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:15.262 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:15.256+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:15.333 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:15.330+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:15.346 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:15.343+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:15.755 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:15.752+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:15.852 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:15.846+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:15.908 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:15.904+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:15.920 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:15.913+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 54 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:16.182 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:16.176+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:16.237 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:16.231+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:16.295 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:16.291+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:16.388 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:16.384+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:16.755 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:16.752+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:16.889 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:16.883+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:16.960 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:16.951+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:16.965 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:16.958+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 54 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:17.171 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:17.166+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:17.269 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:17.263+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:17.338 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:17.334+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:17.424 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:17.421+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:17.766 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:17.760+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:17.923 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:17.915+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:17.929 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:17.920+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 54 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:17.935 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:17.930+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:18.197 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:18.191+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:18.291 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:18.286+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:18.383 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:18.379+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:18.412 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:18.408+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:18.719 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:18.716+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:18.919 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:18.913+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:03:06.204738+0000 (oldest deadline 2019-12-09T18:03:46.204738+0000) 2019-12-09T18:04:18.921 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:18.917+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 54 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:18.979 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:18.974+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:19.158 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:04:19.152+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.634233+0000 front 2019-12-09T18:02:42.688437+0000 (oldest deadline 2019-12-09T18:03:26.391414+0000) 2019-12-09T18:04:19.339 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:04:19.334+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.689678+0000 front 2019-12-09T18:02:42.706818+0000 (oldest deadline 2019-12-09T18:03:27.589431+0000) 2019-12-09T18:04:19.405 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:04:19.401+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.446864+0000 front 2019-12-09T18:02:43.445918+0000 (oldest deadline 2019-12-09T18:03:24.713507+0000) 2019-12-09T18:04:19.428 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:04:19.423+0000 1694f700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:41.108271+0000 front 2019-12-09T18:02:40.825817+0000 (oldest deadline 2019-12-09T18:03:24.103214+0000) 2019-12-09T18:04:19.755 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:04:19.751+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:43.435861+0000 front 2019-12-09T18:02:43.437373+0000 (oldest deadline 2019-12-09T18:03:25.890043+0000) 2019-12-09T18:04:19.860 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:04:19.857+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 46sec e196 v196) 2019-12-09T18:04:19.954 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:04:19.947+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:02:46.470706+0000 front 2019-12-09T18:02:40.336646+0000 (oldest deadline 2019-12-09T18:03:23.634851+0000) 2019-12-09T18:04:20.118 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:04:20.081+0000 1694f700 -1 osd.2 197 get_health_metrics reporting 54 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-09T18:04:41.657 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:04:41.623+0000 1694f700 -1 osd.5 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4530.0:120391 6.f 6.9830408f (undecoded) ondisk+read+known_if_redirected e196) 2019-12-09T18:04:42.855 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:04:42.741+0000 1694f700 -1 osd.5 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4530.0:120391 6.f 6.9830408f (undecoded) ondisk+read+known_if_redirected e196) 2019-12-09T18:04:48.095 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:04:48.080+0000 3727a700 -1 osd.5 201 build_incremental_map_msg missing incremental map 201 2019-12-09T18:04:48.269 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:04:48.214+0000 36278700 -1 osd.5 201 build_incremental_map_msg missing incremental map 201 2019-12-09T18:04:48.490 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:04:48.411+0000 3727a700 -1 osd.5 201 build_incremental_map_msg missing incremental map 201 2019-12-09T18:04:48.558 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:04:48.498+0000 33a73700 -1 osd.5 201 build_incremental_map_msg missing incremental map 201 2019-12-09T18:04:48.605 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:04:48.575+0000 3927e700 -1 osd.5 201 build_incremental_map_msg missing incremental map 201 2019-12-09T18:04:48.609 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:04:48.591+0000 34274700 -1 osd.5 201 build_incremental_map_msg missing incremental map 201 2019-12-09T18:04:48.687 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:04:48.606+0000 35a77700 -1 osd.5 201 build_incremental_map_msg missing incremental map 201 2019-12-09T18:04:48.760 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:04:48.728+0000 3aa81700 -1 osd.5 201 build_incremental_map_msg missing incremental map 201 2019-12-09T18:04:48.974 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:04:48.872+0000 3a280700 -1 osd.5 201 build_incremental_map_msg missing incremental map 201 2019-12-09T18:04:49.073 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:04:48.897+0000 3727a700 -1 osd.5 201 build_incremental_map_msg missing incremental map 201 2019-12-09T18:04:49.143 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:04:48.952+0000 3827c700 -1 osd.5 201 build_incremental_map_msg missing incremental map 201 2019-12-09T18:04:51.817 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:04:51.778+0000 35276700 -1 osd.5 201 build_incremental_map_msg missing incremental map 201 2019-12-09T18:04:51.837 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:04:51.814+0000 3827c700 -1 osd.5 201 build_incremental_map_msg missing incremental map 201 2019-12-09T18:06:10.834 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:10.821+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:11.809 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:11.802+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:11.870 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:11.864+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:11.999 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:11.994+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:12.349 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:12.343+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:12.763 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:12.757+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:12.870 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:12.864+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:12.970 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:12.963+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:13.025 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:13.020+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:13.284 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:13.278+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:13.321 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:13.315+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:13.378 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:13.372+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:13.786 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:13.779+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:13.881 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:13.876+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:13.998 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:13.991+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:14.027 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:14.020+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:14.310 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:14.302+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:14.370 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:14.365+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:14.392 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:14.385+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:14.755 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:14.749+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:14.917 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:14.912+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:14.998 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:14.992+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:15.062 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:15.057+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:15.351 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:15.345+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:15.364 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:15.359+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:15.365 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:15.359+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:15.774 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:15.767+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:15.883 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:15.878+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:15.977 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:15.970+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:16.087 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:16.082+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:16.385 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:16.379+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:16.410 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:16.404+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:16.414 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:16.407+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:16.822 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:16.815+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:16.849 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:16.845+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:17.030 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:17.023+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:17.052 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:17.046+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:17.393 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:17.382+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:17.459 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:17.453+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:17.460 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:17.456+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:17.830 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:17.824+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:17.839 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:17.833+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:17.997 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:17.991+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:18.080 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:18.074+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:18.429 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:18.422+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:18.505 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:18.499+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:18.510 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:18.505+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:18.821 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:18.814+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:18.846 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:18.841+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:19.004 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:18.997+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:19.134 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:19.128+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:19.474 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:19.468+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:19.493 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:19.485+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:19.519 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:19.514+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:19.783 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:19.776+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:19.845 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:19.840+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:20.029 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:20.021+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:20.141 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:20.137+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:20.448 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:20.442+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:20.461 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:20.451+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:20.481 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:20.476+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:20.808 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:20.802+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:20.814 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:20.809+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:21.032 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:21.026+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:21.106 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:21.102+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:21.424 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:21.417+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:21.452 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:21.445+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:21.519 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:21.514+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:21.789 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:21.785+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:21.806 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:21.800+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:22.049 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:22.043+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:22.094 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:22.090+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:22.422 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:22.416+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:22.431 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:22.424+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:22.508 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:22.503+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:22.804 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:22.798+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:22.825 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:22.819+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:23.059 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:23.052+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:23.088 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:23.083+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:23.415 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:23.408+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:23.443 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:23.436+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:23.479 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:23.475+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:23.826 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:23.820+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:23.856 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:23.849+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:24.033 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:24.028+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:24.079 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:24.075+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:24.447 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:24.442+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:24.455 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:24.449+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:24.490 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:24.484+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:24.851 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:24.845+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:24.883 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:24.876+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:25.057 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:25.051+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:25.057 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:25.051+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:25.429 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:25.422+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:25.454 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:25.448+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:25.483 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:25.479+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:25.863 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:25.858+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:25.870 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:25.863+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:26.062 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:26.056+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:26.096 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:26.089+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:26.402 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:26.395+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:26.482 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:26.476+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:26.508 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:26.503+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:26.828 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:26.824+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:26.923 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:26.916+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:27.099 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:27.094+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:27.103 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:27.096+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:27.417 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:27.411+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:27.448 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:27.442+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:27.553 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:27.547+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:27.864 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:27.859+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:27.948 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:27.943+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:28.093 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:28.086+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:28.114 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:28.109+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:28.406 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:28.401+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:28.469 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:28.464+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:28.609 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:28.602+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:28.839 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:28.834+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:28.931 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:28.926+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:29.085 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:29.080+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:29.154 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:29.148+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:29.406 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:29.401+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:29.484 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:29.479+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:29.664 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:29.658+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:29.812 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:29.807+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:29.888 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:29.882+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:30.079 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:30.072+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:30.201 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:30.196+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:30.398 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:30.393+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:30.531 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:30.525+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:30.699 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:30.693+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:30.865 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:30.860+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:30.869 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:30.863+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:31.100 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:31.095+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:31.241 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:31.234+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:31.403 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:31.399+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:31.578 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:31.572+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:31.719 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:31.714+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:31.889 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:31.883+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:31.893 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:31.888+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:32.068 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:32.062+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:32.256 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:32.251+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:32.452 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:32.447+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:32.583 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:32.577+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:32.745 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:32.740+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:32.858 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:32.853+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:32.882 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:32.877+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:33.081 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:33.075+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:33.311 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:33.306+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:33.490 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:33.484+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:33.636 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:33.630+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:33.791 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:33.786+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:33.869 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:33.863+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:33.898 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:33.894+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:34.083 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:34.079+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:34.289 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:34.282+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:34.479 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:34.473+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:34.675 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:34.669+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:34.836 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:34.832+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:34.867 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:34.862+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:34.892 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:34.885+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:35.052 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:35.045+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:35.297 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:35.292+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:35.489 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:35.483+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:35.642 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:35.636+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:35.825 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:35.820+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:35.845 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:35.841+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:35.914 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:35.907+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:36.064 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:36.059+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:36.273 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:36.267+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:36.465 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:36.460+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:36.692 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:36.687+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:36.845 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:36.839+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:36.896 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:36.889+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:36.927 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:36.922+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:37.030 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:37.024+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:37.271 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:37.265+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:37.507 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:37.502+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:37.675 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:37.671+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:37.820 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:37.816+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:37.846 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:37.842+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:37.968 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:37.964+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:38.054 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:38.048+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:38.266 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:38.260+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:38.469 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:38.463+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:38.700 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:38.690+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:38.848 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:38.842+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:38.860 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:38.857+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:38.932 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:38.929+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:39.013 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:39.010+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:39.295 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:39.290+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:39.489 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:39.484+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:39.697 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:39.692+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:39.824 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:39.813+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:39.834 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:39.830+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:39.914 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:39.909+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:40.002 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:39.999+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:40.330 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:40.324+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:40.509 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:40.503+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:40.748 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:40.743+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:40.849 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:40.843+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:40.850 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:40.846+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:40.943 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:40.939+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:41.053 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:41.049+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:41.356 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:41.349+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:41.497 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:41.491+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:41.747 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:41.742+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:41.853 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:41.849+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:41.862 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:41.856+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:41.938 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:41.933+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:42.014 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:42.010+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:42.408 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:42.403+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:42.474 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:42.454+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:42.770 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:42.764+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:42.855 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:42.852+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:42.908 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:42.903+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:42.947 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:42.942+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:43.065 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:43.062+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:43.398 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:43.392+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:43.476 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:43.471+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:43.776 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:43.770+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:43.866 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:43.862+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:43.898 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:43.892+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:43.963 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:43.960+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:44.092 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:44.087+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:44.406 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:44.400+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:06:44.442 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:06:44.435+0000 1694f700 -1 osd.4 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.341091+0000 front 2019-12-09T18:05:27.507865+0000 (oldest deadline 2019-12-09T18:06:12.551229+0000) 2019-12-09T18:06:44.833 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:06:44.822+0000 1694f700 -1 osd.7 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.579173+0000 front 2019-12-09T18:05:27.577089+0000 (oldest deadline 2019-12-09T18:06:12.323600+0000) 2019-12-09T18:06:44.834 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:06:44.830+0000 1694f700 -1 osd.3 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:27.955751+0000 front 2019-12-09T18:05:28.432197+0000 (oldest deadline 2019-12-09T18:06:12.030416+0000) 2019-12-09T18:06:44.856 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:06:44.849+0000 1694f700 -1 osd.5 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:25.062572+0000 front 2019-12-09T18:05:24.740237+0000 (oldest deadline 2019-12-09T18:06:10.501610+0000) 2019-12-09T18:06:44.995 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:06:44.991+0000 1694f700 -1 osd.0 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:26.304907+0000 front 2019-12-09T18:05:26.420786+0000 (oldest deadline 2019-12-09T18:06:10.983650+0000) 2019-12-09T18:06:45.058 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:06:45.055+0000 1694f700 -1 osd.1 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.771507+0000 front 2019-12-09T18:05:28.751376+0000 (oldest deadline 2019-12-09T18:06:11.612112+0000) 2019-12-09T18:06:45.368 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:06:45.353+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 46sec e201 v201) 2019-12-09T18:06:45.437 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:06:45.429+0000 1694f700 -1 osd.6 201 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:05:28.305007+0000 front 2019-12-09T18:05:27.977442+0000 (oldest deadline 2019-12-09T18:06:12.002638+0000) 2019-12-09T18:07:17.823 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:28:15.850 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:17.831 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:28:15.858 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:17.844 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:28:15.805 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:17.844 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:28:15.863 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:17.845 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:28:15.871 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:17.849 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:28:15.813 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:18.067 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:28:16.093 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:18.138 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:28:16.101 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:18.163 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:28:16.189 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:20.653 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:07:20.645+0000 124b0700 -1 osd.2 206 build_incremental_map_msg missing incremental map 206 2019-12-09T18:07:20.771 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:28:18.798 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:20.789 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:28:18.814 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:20.838 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:28:18.801 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:20.841 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:28:18.804 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:20.845 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:28:18.872 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:20.847 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:28:18.874 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:20.862 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:28:18.889 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:20.880 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:28:18.907 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:20.885 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:28:18.848 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:07:21.114 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:07:20.901+0000 39a7f700 -1 osd.2 206 build_incremental_map_msg missing incremental map 206 2019-12-09T18:07:21.292 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:07:21.152+0000 39a7f700 -1 osd.2 206 build_incremental_map_msg missing incremental map 206 2019-12-09T18:07:22.615 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:07:22.594+0000 39a7f700 -1 osd.2 207 build_incremental_map_msg missing incremental map 206 2019-12-09T18:07:42.892 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:42.888+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:43.905 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:43.900+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:44.894 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:44.888+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:45.075 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:07:45.070+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:07:45.885 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:07:45.881+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:07:45.944 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:45.939+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:45.952 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:07:45.948+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:07:46.035 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:07:46.030+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:07:46.886 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:07:46.881+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:07:46.921 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:07:46.912+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:07:46.958 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:07:46.953+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:07:46.973 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:46.968+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:47.045 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:07:47.040+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:07:47.776 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:07:47.771+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:07:47.844 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:07:47.839+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:07:47.888 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:07:47.883+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:07:47.940 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:07:47.934+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:07:47.999 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:47.994+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:48.093 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:07:48.089+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:07:48.762 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:07:48.757+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:07:48.824 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:07:48.817+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:07:48.844 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:07:48.839+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:07:48.919 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:07:48.914+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:07:49.036 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:49.030+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:49.099 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:07:49.095+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:07:49.773 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:07:49.768+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:07:49.808 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:07:49.802+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:07:49.859 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:07:49.853+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:07:49.972 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:07:49.967+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:07:50.007 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:50.002+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:50.075 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:07:50.069+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:07:50.803 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:07:50.799+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:07:50.815 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:07:50.812+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:07:50.907 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:07:50.903+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:07:50.950 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:07:50.945+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:07:50.985 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:50.981+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:51.102 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:07:51.098+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:07:51.717 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:07:51.711+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:07:51.824 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:07:51.820+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:07:51.848 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:07:51.845+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:07:51.901 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:07:51.897+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:07:51.922 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:07:51.918+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:07:51.991 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:51.987+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:52.097 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:07:52.092+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:07:52.731 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:07:52.724+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:07:52.822 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:07:52.817+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:07:52.886 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:07:52.882+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:07:52.891 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:07:52.886+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:07:52.894 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:07:52.890+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:07:53.018 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:53.014+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:53.133 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:07:53.129+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:07:53.733 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:07:53.729+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:07:53.851 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:07:53.839+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:07:53.852 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:07:53.848+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:07:53.857 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:07:53.854+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:07:53.895 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:07:53.891+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:07:53.984 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:53.980+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:54.162 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:07:54.157+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:07:54.719 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:07:54.715+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:07:54.847 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:07:54.843+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:07:54.865 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:07:54.859+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:07:54.885 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:07:54.881+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:07:54.887 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:07:54.884+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:07:55.016 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:55.012+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:55.195 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:07:55.190+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:07:55.709 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:07:55.704+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:07:55.845 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:07:55.842+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:07:55.846 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:07:55.843+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:07:55.859 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:07:55.856+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:07:55.884 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:07:55.877+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:07:55.995 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:55.990+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:56.181 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:07:56.177+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:07:56.745 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:07:56.740+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:07:56.826 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:07:56.820+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:07:56.868 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:07:56.865+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:07:56.881 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:07:56.878+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:07:56.912 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:07:56.906+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:07:56.992 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:56.988+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:57.193 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:07:57.183+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:07:57.738 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:07:57.730+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:07:57.741 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:07:57.735+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:07:57.820 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:07:57.815+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:07:57.874 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:07:57.870+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:07:57.875 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:07:57.871+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:07:57.879 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:07:57.875+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:07:58.001 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:57.997+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:58.201 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:07:58.196+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:07:58.749 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:07:58.745+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:07:58.755 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:07:58.750+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:07:58.852 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:07:58.846+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:07:58.870 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:07:58.865+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:07:58.878 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:07:58.873+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:07:58.926 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:07:58.920+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:07:59.026 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:59.020+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:07:59.204 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:07:59.199+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:07:59.716 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:07:59.711+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:07:59.726 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:07:59.720+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:07:59.827 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:07:59.822+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:07:59.884 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:07:59.880+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:07:59.886 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:07:59.881+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:07:59.928 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:07:59.923+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:07:59.982 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:07:59.976+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:00.214 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:00.209+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:00.735 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:00.730+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:00.741 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:00.736+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:00.872 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:00.868+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:00.887 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:00.883+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:00.916 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:00.908+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:00.944 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:00.940+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:00.994 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:00.989+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:01.218 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:01.213+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:01.728 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:01.719+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:01.731 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:01.724+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:01.882 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:01.876+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:01.917 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:01.912+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:01.931 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:01.923+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:01.937 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:01.933+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:01.964 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:01.959+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:02.269 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:02.263+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:02.774 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:02.766+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:02.777 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:02.771+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:02.866 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:02.860+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:02.918 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:02.912+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:02.958 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:02.954+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:02.963 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:02.958+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:02.963 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:02.959+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:03.255 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:03.249+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:03.766 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:03.761+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:03.772 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:03.767+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:03.867 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:03.861+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:03.960 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:03.955+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:03.971 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:03.966+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:04.002 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:03.997+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:04.007 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:04.003+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:04.245 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:04.239+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:04.821 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:04.812+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:04.823 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:04.817+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:04.841 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:04.837+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:04.922 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:04.916+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:04.983 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:04.979+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:05.006 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:05.002+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:05.015 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:05.009+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:05.255 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:05.249+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:05.798 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:05.793+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:05.810 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:05.800+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:05.832 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:05.826+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:05.969 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:05.965+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:05.974 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:05.968+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:06.025 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:06.020+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:06.068 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:06.061+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:06.269 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:06.263+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:06.764 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:06.757+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:06.767 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:06.764+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:06.785 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:06.781+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:06.960 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:06.955+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:06.984 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:06.979+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:07.029 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:07.024+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:07.042 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:07.036+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:07.243 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:07.238+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:07.753 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:07.748+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:07.816 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:07.811+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:07.824 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:07.818+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:07.967 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:07.962+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:07.968 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:07.962+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:08.018 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:08.014+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:08.019 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:08.014+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:08.201 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:08.195+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:08.714 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:08.709+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:08.795 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:08.790+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:08.803 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:08.796+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:08.934 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:08.929+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:08.992 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:08.987+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:09.048 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:09.044+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:09.065 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:09.060+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:09.215 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:09.208+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:09.677 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:09.673+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:09.824 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:09.815+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:09.827 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:09.820+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:09.888 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:09.884+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:10.006 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:10.000+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:10.037 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:10.031+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:10.054 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:10.049+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:10.208 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:10.203+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:10.711 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:10.706+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:10.782 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:10.774+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:10.785 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:10.778+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:10.933 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:10.929+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:11.026 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:11.021+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:11.072 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:11.068+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:11.078 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:11.073+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:11.225 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:11.220+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:11.721 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:11.716+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:11.802 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:11.794+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:11.806 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:11.798+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:11.913 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:11.909+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:11.987 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:11.980+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:12.053 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:12.047+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:12.083 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:12.077+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:12.275 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:12.269+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:12.696 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:12.692+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:12.791 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:12.783+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:12.794 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:12.787+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:12.964 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:12.959+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:12.984 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:12.975+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:13.010 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:13.006+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:13.118 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:13.113+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:13.235 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:13.230+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:13.707 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:13.702+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:13.819 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:13.813+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:13.821 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:13.816+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:13.964 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:13.959+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:13.970 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:13.964+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:13.976 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:13.971+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:14.074 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:14.069+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:14.265 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:14.259+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:14.696 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:14.691+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:14.844 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:14.837+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:14.847 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:14.841+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:14.963 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:14.958+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:14.976 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:14.972+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:14.981 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:14.974+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:15.097 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:15.091+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:15.222 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:15.215+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:15.657 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:15.653+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:15.856 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:15.849+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:15.858 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:15.853+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:15.911 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:08:15.906+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e207 v207) 2019-12-09T18:08:15.924 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:15.921+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:15.992 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:15.987+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:16.038 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:16.034+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:16.150 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:16.145+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:16.207 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:16.202+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:16.643 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:16.636+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:16.842 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:16.835+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:16.845 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:16.838+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:16.945 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:16.941+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:17.000 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:16.994+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:17.002 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:16.998+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:17.200 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:17.194+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:17.243 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:17.237+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:17.677 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:17.672+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:17.830 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:17.822+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:17.834 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:17.827+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:17.989 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:17.983+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:18.012 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:18.006+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:18.041 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:18.036+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:18.254 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:18.249+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:18.273 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:18.267+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:18.728 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:18.723+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:18.831 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:18.826+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:18.840 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:18.834+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:18.981 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:18.976+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:18.985 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:18.979+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:19.060 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:19.055+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:19.242 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:19.237+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:19.251 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:19.246+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:19.750 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:19.745+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:19.873 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:19.868+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:19.881 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:19.875+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:19.950 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:19.946+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:20.004 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:19.999+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:20.020 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:20.015+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:20.260 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:20.255+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:20.266 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:20.262+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:20.727 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:20.723+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:20.869 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:20.860+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:20.871 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:20.865+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:20.933 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:08:20.930+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e207 v207) 2019-12-09T18:08:20.948 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:20.944+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:21.000 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:20.996+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:21.007 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:21.004+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:21.254 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:21.250+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:21.312 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:21.307+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:21.703 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:21.697+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:21.869 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:21.861+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:21.872 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:21.866+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:21.908 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:21.904+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:22.010 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:22.005+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:22.010 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:22.005+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:22.242 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:22.236+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:22.361 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:22.356+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:22.692 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:22.687+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:22.878 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:22.872+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:22.884 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:22.875+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:22.887 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:22.880+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:22.965 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:22.960+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:23.055 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:23.050+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:23.242 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:23.238+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:23.330 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:23.324+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:23.715 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:23.709+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:23.839 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:23.833+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:23.936 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:23.928+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:23.939 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:23.933+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:23.951 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:23.946+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:24.081 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:24.073+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:24.278 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:24.273+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:24.307 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:24.302+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:24.767 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:24.763+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:24.792 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:24.787+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:24.930 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:24.924+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:24.931 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:24.926+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:24.934 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:24.930+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:25.094 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:25.089+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:25.274 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:25.269+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:25.330 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:25.324+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:25.726 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:25.721+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:25.765 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:25.760+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:25.954 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:25.946+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:25.958 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:08:25.951+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e207 v207) 2019-12-09T18:08:25.959 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:25.951+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:25.988 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:25.983+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:26.053 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:26.050+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:26.296 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:26.292+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:26.327 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:26.322+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:26.739 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:26.734+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:26.742 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:26.737+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:27.003 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:26.998+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:27.010 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:27.004+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:27.027 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:27.022+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:27.095 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:27.091+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:27.276 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:27.271+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:27.293 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:27.289+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:27.705 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:27.700+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:27.721 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:27.716+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:27.973 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:27.962+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:27.974 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:27.967+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:28.054 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:28.048+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:28.059 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:28.054+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:28.262 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:28.257+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:28.341 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:28.336+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:28.747 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:28.742+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:28.753 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:28.746+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:28.948 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:28.944+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:28.953 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:28.948+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:29.028 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:29.023+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:29.095 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:29.089+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:29.309 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:29.304+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:29.326 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:29.320+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:29.779 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:29.772+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:29.782 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:29.777+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:29.986 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:29.982+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:29.993 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:29.986+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:30.049 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:08:30.044+0000 1694f700 -1 osd.4 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164106+0000 front 2019-12-09T18:07:02.010776+0000 (oldest deadline 2019-12-09T18:07:45.863682+0000) 2019-12-09T18:08:30.095 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:30.090+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:08:30.296 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:08:30.292+0000 1694f700 -1 osd.7 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.389832+0000 front 2019-12-09T18:07:02.054658+0000 (oldest deadline 2019-12-09T18:07:44.900314+0000) 2019-12-09T18:08:30.301 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:08:30.297+0000 1694f700 -1 osd.6 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.689869+0000 front 2019-12-09T18:07:00.708225+0000 (oldest deadline 2019-12-09T18:07:42.401985+0000) 2019-12-09T18:08:30.732 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:08:30.727+0000 1694f700 -1 osd.3 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:00.893800+0000 front 2019-12-09T18:07:00.905272+0000 (oldest deadline 2019-12-09T18:07:45.645089+0000) 2019-12-09T18:08:30.830 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:08:30.823+0000 1694f700 -1 osd.1 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:03.117300+0000 front 2019-12-09T18:07:03.096343+0000 (oldest deadline 2019-12-09T18:07:47.686497+0000) 2019-12-09T18:08:31.008 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:31.002+0000 1694f700 -1 osd.2 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:07:17.226016+0000 (oldest deadline 2019-12-09T18:07:57.226016+0000) 2019-12-09T18:08:31.009 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:08:31.004+0000 1694f700 -1 osd.2 207 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4530.0:120020 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e205) 2019-12-09T18:08:31.015 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:08:31.010+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e207 v207) 2019-12-09T18:08:31.141 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:08:31.136+0000 1694f700 -1 osd.0 207 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:07:02.164295+0000 front 2019-12-09T18:07:01.451053+0000 (oldest deadline 2019-12-09T18:07:45.886922+0000) 2019-12-09T18:10:00.833 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:00.827+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:00.853 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:00.848+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:00.915 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:00.909+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:00.962 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:00.950+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:01.473 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:01.468+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:01.823 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:01.818+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:01.841 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:01.837+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:01.874 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:01.868+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:01.918 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:01.913+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:02.434 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:02.429+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:02.837 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:02.823+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:02.857 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:02.852+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:02.864 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:02.858+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:02.905 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:02.898+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:03.397 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:03.390+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:03.452 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:03.447+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:03.827 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:03.820+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:03.830 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:03.825+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:03.893 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:03.886+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:03.903 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:03.894+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:03.919 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:03.910+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:04.360 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:04.353+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:04.412 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:04.407+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:04.825 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:04.819+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:04.845 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:04.839+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:04.856 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:04.849+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:04.925 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:04.918+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:04.970 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:04.951+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:05.335 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:05.329+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:05.369 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:05.365+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:05.819 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:05.814+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:05.835 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:05.829+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:05.877 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:05.871+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:05.974 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:05.962+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:05.979 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:05.970+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:06.353 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:06.347+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:06.365 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:06.360+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:06.777 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:06.772+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:06.810 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:06.803+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:06.893 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:06.888+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:06.974 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:06.968+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:06.983 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:06.977+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:07.321 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:07.315+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:07.383 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:07.377+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:07.804 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:07.799+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:07.809 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:07.804+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:07.924 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:07.918+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:07.995 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:07.988+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:08.035 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:08.028+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:08.306 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:08.300+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:08.428 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:08.421+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:08.794 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:08.789+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:08.799 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:08.793+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:08.882 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:08.878+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:08.980 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:08.975+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:09.034 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:09.029+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:09.344 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:09.338+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:09.397 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:09.390+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:09.817 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:09.810+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:09.846 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:09.841+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:09.900 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:09.894+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:09.960 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:09.953+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:09.999 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:09.992+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:10.346 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:10.343+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:10.380 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:10.374+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:10.853 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:10.849+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:10.858 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:10.851+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:10.868 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:10.863+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:10.985 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:10.979+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:11.006 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:10.999+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:11.392 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:11.386+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:11.431 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:11.423+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:11.494 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:31:09.521 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:11.539 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:31:09.565 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:11.541 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:31:09.568 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:11.574 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:31:09.595 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:11.595 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:31:09.558 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:11.601 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:31:09.565 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:11.708 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:31:09.734 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:11.729 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:31:09.755 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:11.778 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:31:09.741 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:10:11.822 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:11.818+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:11.846 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:11.840+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:11.894 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:11.890+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:11.991 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:11.986+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:12.035 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:12.029+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:12.381 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:12.376+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:12.466 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:12.461+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:12.789 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:12.784+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:12.838 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:12.832+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:12.884 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:12.880+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:12.964 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:12.959+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:13.075 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:13.068+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:13.366 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:13.360+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:13.432 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:13.426+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:13.844 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:13.839+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:13.870 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:13.864+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:13.910 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:13.905+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:13.949 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:13.944+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:14.035 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:14.030+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:14.360 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:14.355+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:14.393 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:14.386+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:14.857 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:14.852+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:14.889 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:14.884+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:14.959 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:14.956+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:14.980 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:14.975+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:15.087 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:15.081+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:15.391 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:15.387+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:15.396 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:15.391+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:15.887 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:15.881+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:15.918 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:15.914+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:15.934 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:15.930+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:15.998 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:15.993+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:16.089 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:16.084+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:16.385 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:16.381+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:16.403 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:16.397+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:16.902 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:16.896+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:16.953 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:16.947+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:16.954 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:16.949+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:16.968 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:16.963+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:17.053 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:17.047+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:17.421 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:17.415+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:17.426 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:17.422+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:17.913 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:17.907+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:17.940 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:17.935+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:17.957 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:17.954+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:17.973 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:17.967+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:18.056 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:18.051+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:18.428 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:18.422+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:18.447 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:18.443+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:18.894 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:18.887+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:18.974 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:18.969+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:19.001 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:18.996+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:19.008 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:19.004+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:19.073 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:19.067+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:19.415 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:19.411+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:19.490 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:19.486+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:19.849 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:19.844+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:19.966 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:19.961+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:20.001 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:19.996+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:20.046 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:20.042+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:20.058 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:20.052+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:20.462 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:20.456+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:20.535 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:20.531+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:20.867 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:20.860+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:20.960 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:20.957+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:20.986 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:20.981+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:21.030 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:21.025+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:21.051 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:21.047+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:21.458 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:21.452+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:21.578 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:21.575+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:21.862 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:21.856+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:21.925 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:21.918+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:21.962 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:21.957+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:22.020 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:22.016+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:22.057 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:22.053+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:22.457 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:22.451+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:22.535 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:22.530+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:22.863 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:22.858+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:22.890 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:22.885+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:22.935 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:22.930+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:23.035 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:23.030+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:23.036 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:23.030+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:23.426 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:23.421+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:23.550 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:23.545+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:23.865 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:23.860+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:23.901 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:23.896+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:23.929 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:23.925+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:24.057 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:24.052+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:24.062 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:24.055+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:24.382 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:24.377+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:24.595 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:24.591+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:24.890 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:24.885+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:24.945 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:24.939+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:24.947 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:24.943+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:25.017 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:25.013+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:25.044 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:25.039+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:25.398 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:25.393+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:25.629 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:25.624+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:25.940 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:25.932+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:25.955 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:25.949+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:25.993 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:25.986+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:26.004 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:25.999+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:26.045 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:26.038+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:26.366 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:26.361+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:26.665 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:26.661+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:26.945 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:26.941+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:26.986 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:26.981+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:26.998 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:26.993+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:26.999 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:26.995+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:27.033 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:27.028+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:27.387 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:27.381+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:27.708 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:27.702+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:27.956 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:27.951+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:27.996 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:27.990+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:27.999 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:27.993+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:28.019 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:28.014+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:28.045 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:28.041+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:28.438 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:28.432+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:28.752 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:28.748+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:28.968 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:28.961+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:28.975 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:28.969+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:28.989 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:28.984+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:29.003 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:28.998+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:29.023 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:29.013+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:29.397 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:29.390+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:29.786 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:29.779+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:29.999 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:29.992+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:30.005 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:30.000+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:30.017 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:30.008+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:30.027 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:30.023+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:30.052 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:30.045+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:30.388 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:30.381+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:30.834 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:30.829+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:30.973 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:30.967+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:30.976 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:30.969+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:30.990 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:30.985+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:31.035 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:31.031+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:31.086 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:31.080+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:31.436 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:31.429+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:31.847 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:31.842+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:31.950 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:31.938+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:31.970 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:31.963+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:31.977 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:31.971+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:32.049 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:32.044+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:32.129 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:32.120+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:32.455 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:32.448+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:32.835 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:32.830+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:32.929 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:32.923+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:32.969 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:32.957+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:32.980 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:32.976+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:33.085 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:33.079+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:33.149 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:33.142+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:33.457 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:33.451+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:33.850 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:33.844+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:33.942 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:33.935+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:33.960 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:33.955+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:34.017 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:34.011+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:34.121 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:34.115+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:34.132 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:34.128+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:34.422 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:34.415+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:34.888 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:34.884+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:34.925 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:34.918+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:34.978 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:34.970+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:35.012 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:35.007+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:35.081 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:35.075+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:35.097 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:35.092+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:35.402 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:35.396+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:35.894 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:10:35.888+0000 1694f700 -1 osd.4 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.187215+0000 front 2019-12-09T18:09:19.123759+0000 (oldest deadline 2019-12-09T18:10:03.435890+0000) 2019-12-09T18:10:35.928 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:10:35.922+0000 1694f700 -1 osd.1 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:18.421271+0000 front 2019-12-09T18:09:18.419591+0000 (oldest deadline 2019-12-09T18:10:01.347350+0000) 2019-12-09T18:10:35.959 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:10:35.952+0000 1694f700 -1 osd.5 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.858069+0000 front 2019-12-09T18:09:19.910563+0000 (oldest deadline 2019-12-09T18:10:00.692611+0000) 2019-12-09T18:10:36.050 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:10:36.044+0000 1694f700 -1 osd.0 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.519864+0000 front 2019-12-09T18:09:19.910807+0000 (oldest deadline 2019-12-09T18:09:59.845532+0000) 2019-12-09T18:10:36.066 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:10:36.059+0000 1694f700 -1 osd.6 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:19.283279+0000 front 2019-12-09T18:09:19.281273+0000 (oldest deadline 2019-12-09T18:10:00.645733+0000) 2019-12-09T18:10:36.099 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:10:36.093+0000 1694f700 -1 osd.3 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.965768+0000 front 2019-12-09T18:09:16.966561+0000 (oldest deadline 2019-12-09T18:10:00.773264+0000) 2019-12-09T18:10:36.431 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:10:36.424+0000 1694f700 -1 osd.7 212 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:09:16.958066+0000 front 2019-12-09T18:09:16.785899+0000 (oldest deadline 2019-12-09T18:10:02.489349+0000) 2019-12-09T18:10:36.572 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:10:36.565+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 46sec e212 v212) 2019-12-09T18:11:13.285 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:32:11.311 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:13.294 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:32:11.321 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:13.300 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:32:11.326 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:13.305 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:32:11.268 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:13.305 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:32:11.332 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:13.312 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:32:11.276 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:13.397 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:32:11.424 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:13.403 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:32:11.430 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:13.472 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:32:11.435 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:11:34.184 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:34.179+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:34.619 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:34.615+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:34.675 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:34.669+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:34.843 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:34.838+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:35.170 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:35.163+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:35.640 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:35.635+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:35.712 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:35.706+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:35.853 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:35.848+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:36.012 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:36.008+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:36.015 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:36.012+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:36.201 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:36.196+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:36.644 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:36.640+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:36.672 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:36.667+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:36.893 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:36.888+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:36.988 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:36.983+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:37.055 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:37.049+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:37.234 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:37.229+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:37.649 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:37.644+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:37.653 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:37.647+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:37.875 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:37.870+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:38.024 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:38.020+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:38.082 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:38.077+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:38.281 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:38.275+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:38.664 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:38.659+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:38.675 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:38.670+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:38.929 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:38.923+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:38.997 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:38.991+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:39.041 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:39.035+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:39.243 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:39.238+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:39.624 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:39.619+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:39.690 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:39.685+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:39.920 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:39.915+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:40.003 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:39.998+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:40.045 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:40.041+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:40.289 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:40.285+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:40.606 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:40.601+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:40.694 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:40.689+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:40.906 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:40.901+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:40.982 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:40.977+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:41.011 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:41.006+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:41.317 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:41.314+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:41.621 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:41.617+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:41.729 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:41.724+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:41.899 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:41.895+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:41.925 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:41.919+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:41.998 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:41.994+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:42.065 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:42.061+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:42.331 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:42.326+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:42.635 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:42.629+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:42.730 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:42.725+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:42.909 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:42.903+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:42.912 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:42.906+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:43.030 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:43.024+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:43.037 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:43.032+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:43.384 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:43.379+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:43.635 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:43.630+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:43.688 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:43.684+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:43.871 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:43.864+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:43.963 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:43.957+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:43.992 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:43.988+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:43.995 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:43.989+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:44.351 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:44.346+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:44.645 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:44.640+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:44.681 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:44.676+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:44.837 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:44.830+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:44.956 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:44.950+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:44.964 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:44.959+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:44.968 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:44.962+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:45.337 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:45.332+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:45.682 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:45.676+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:45.710 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:45.704+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:45.800 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:45.793+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:45.941 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:45.936+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:45.961 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:45.954+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:46.010 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:46.005+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:46.315 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:46.309+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:46.663 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:46.657+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:46.734 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:46.729+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:46.809 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:46.803+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:46.937 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:46.931+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:46.960 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:46.954+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:46.989 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:46.985+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:47.269 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:47.265+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:47.684 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:47.679+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:47.765 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:47.760+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:47.831 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:47.825+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:47.910 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:47.904+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:47.947 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:47.940+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:48.010 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:48.005+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:48.244 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:48.238+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:48.663 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:48.658+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:48.744 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:48.739+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:48.791 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:48.783+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:11:48.795 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:48.787+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:48.950 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:48.943+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:48.997 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:48.989+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:49.035 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:49.030+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:49.226 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:49.222+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:49.708 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:49.703+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:49.761 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:49.756+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:11:49.767 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:49.761+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:49.792 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:49.787+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:49.905 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:49.899+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:49.963 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:49.957+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:50.077 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:50.072+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:50.225 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:50.220+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:50.747 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:50.742+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:50.766 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:50.762+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:50.801 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:50.796+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:11:50.810 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:50.803+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:50.870 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:50.864+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:50.933 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:50.927+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:51.058 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:51.053+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:51.260 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:51.256+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:51.756 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:51.750+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:51.801 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:51.795+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:51.837 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:51.832+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:11:51.840 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:51.834+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:51.844 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:51.838+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:51.901 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:51.896+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:52.086 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:52.080+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:52.284 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:52.280+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:52.769 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:52.765+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:52.836 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:52.830+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:52.846 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:52.840+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:52.896 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:52.888+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:11:52.898 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:52.893+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:52.955 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:52.945+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:53.089 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:53.085+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:53.289 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:53.284+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:53.779 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:53.774+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:53.849 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:53.844+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:53.852 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:53.846+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:53.919 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:53.912+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:11:53.922 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:53.915+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:53.927 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:53.921+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:54.081 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:54.076+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:54.339 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:54.334+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:54.778 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:54.773+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:54.815 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:54.809+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:54.840 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:54.834+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:54.927 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:54.919+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:11:54.929 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:54.924+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:54.971 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:54.966+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:55.116 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:55.111+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:55.342 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:55.336+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:55.794 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:55.788+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:55.794 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:55.789+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:55.808 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:55.801+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:55.938 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:55.931+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:55.939 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:55.935+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:11:55.947 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:55.941+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:56.140 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:56.135+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:56.366 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:56.361+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:56.764 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:56.758+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:56.799 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:56.794+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:56.827 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:56.822+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:56.991 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:56.984+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:56.996 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:56.988+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:11:57.002 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:56.992+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:57.131 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:57.127+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:57.339 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:57.335+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:57.722 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:57.716+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:57.781 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:57.777+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:57.844 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:57.838+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:57.950 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:57.945+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:11:57.950 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:57.944+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:57.958 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:57.951+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:58.100 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:58.095+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:58.354 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:58.350+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:58.755 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:58.748+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:58.836 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:58.831+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:58.896 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:58.890+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:58.937 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:58.930+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:58.978 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:58.968+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:11:58.980 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:58.975+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:11:59.077 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:11:59.072+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:11:59.325 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:11:59.320+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:11:59.774 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:11:59.769+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:11:59.811 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:11:59.806+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:11:59.892 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:11:59.885+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:11:59.957 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:11:59.951+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:11:59.966 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:59.961+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:11:59.974 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:11:59.968+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:00.032 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:00.028+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:00.363 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:00.358+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:00.794 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:00.788+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:00.815 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:00.810+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:00.938 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:00.932+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:00.965 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:00.958+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:00.972 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:00.964+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:00.976 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:00.968+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:01.075 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:01.071+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:01.333 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:01.328+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:01.785 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:01.778+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:01.806 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:01.801+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:01.916 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:01.909+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:01.933 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:01.924+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:01.934 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:01.930+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:01.954 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:01.949+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:02.117 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:02.113+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:02.346 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:02.341+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:02.816 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:02.811+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:02.851 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:02.847+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:02.886 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:02.880+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:02.909 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:02.903+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:02.952 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:02.946+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:02.955 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:02.949+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:03.169 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:03.164+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:03.374 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:03.369+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:03.850 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:03.846+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:03.872 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:03.867+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:03.894 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:03.889+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:03.908 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:03.903+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:03.962 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:03.953+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:03.965 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:03.958+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:04.173 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:04.168+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:04.395 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:04.390+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:04.831 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:04.824+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:04.876 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:04.872+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:04.894 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:04.889+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:04.909 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:04.903+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:04.957 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:04.949+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:04.961 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:04.953+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:05.141 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:05.136+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:05.354 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:05.350+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:05.841 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:05.836+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:05.842 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:05.836+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:05.897 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:05.892+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:05.929 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:05.925+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:05.972 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:05.967+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:05.981 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:05.975+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:06.186 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:06.181+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:06.313 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:06.308+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:06.807 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:06.803+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:06.814 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:06.809+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:06.922 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:12:06.914+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e218 v218) 2019-12-09T18:12:06.944 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:06.939+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:06.992 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:06.983+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:06.999 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:06.994+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:07.001 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:06.996+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:07.147 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:07.142+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:07.280 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:07.276+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:07.784 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:07.778+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:07.793 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:07.787+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:07.919 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:07.914+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:08.024 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:08.019+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:08.052 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:08.047+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:08.060 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:08.054+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:08.126 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:08.120+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:08.252 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:08.247+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:08.746 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:08.741+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:08.782 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:08.777+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:08.948 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:08.944+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:09.009 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:09.005+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:09.105 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:09.098+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:09.106 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:09.102+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:09.129 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:09.125+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:09.274 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:09.269+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:09.751 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:09.746+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:09.753 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:09.749+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:09.969 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:09.964+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:09.977 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:09.972+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:10.097 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:10.091+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:10.099 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:10.093+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:10.151 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:10.145+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:10.243 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:10.239+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:10.725 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:10.720+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:10.738 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:10.733+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:10.997 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:10.992+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:11.011 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:11.006+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:11.111 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:11.106+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:11.113 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:11.108+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:11.172 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:11.168+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:11.250 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:11.246+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:11.751 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:11.746+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:11.783 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:11.778+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:11.947 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:12:11.940+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e218 v218) 2019-12-09T18:12:11.991 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:11.987+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:12.027 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:12.022+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:12.083 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:12.077+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:12.086 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:12.079+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:12.212 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:12.207+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:12.235 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:12.231+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:12.743 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:12.737+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:12.776 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:12.771+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:12.970 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:12.966+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:13.039 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:13.035+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:13.102 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:13.097+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:13.111 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:13.104+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:13.167 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:13.163+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:13.266 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:13.263+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:13.749 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:13.744+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:13.780 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:13.775+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:14.003 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:13.999+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:14.075 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:14.071+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:14.135 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:14.128+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:14.138 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:14.132+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:14.211 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:14.206+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:14.296 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:14.291+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:14.764 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:14.755+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:14.798 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:14.793+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:15.013 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:15.009+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:15.029 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:15.025+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:15.101 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:15.096+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:15.110 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:15.103+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:15.197 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:15.191+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:15.293 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:15.287+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:15.781 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:15.777+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:15.840 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:15.835+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:16.054 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:16.049+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:16.055 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:16.051+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:16.106 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:16.098+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:16.110 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:16.102+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:16.237 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:16.232+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:16.332 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:16.328+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:16.784 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:16.779+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:16.799 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:16.795+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:16.957 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:12:16.953+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e218 v218) 2019-12-09T18:12:17.027 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:17.023+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:17.072 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:17.067+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:17.118 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:17.111+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:17.120 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:17.114+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:17.223 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:17.219+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:17.337 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:17.333+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:17.764 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:17.760+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:17.834 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:17.830+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:18.003 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:17.997+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:18.124 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:18.119+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:18.154 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:18.146+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:18.157 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:18.151+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:18.198 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:18.194+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:18.354 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:18.350+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:18.796 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:18.792+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:18.816 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:18.812+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:18.984 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:18.979+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:19.150 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:19.141+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:19.153 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:19.146+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:19.159 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:19.153+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:19.176 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:19.171+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:19.319 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:19.313+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:19.779 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:19.774+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:19.798 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:19.793+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:20.025 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:20.020+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:20.128 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:20.122+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:20.140 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:20.131+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:20.142 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:20.137+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:20.143 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:20.136+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:20.333 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:20.328+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:20.744 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:20.739+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:20.784 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:20.778+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:21.049 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:21.044+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:21.100 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:21.093+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:21.137 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:21.133+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:21.141 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:21.137+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:21.191 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:12:21.186+0000 1694f700 -1 osd.6 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.628510+0000 front 2019-12-09T18:10:53.958489+0000 (oldest deadline 2019-12-09T18:11:35.319027+0000) 2019-12-09T18:12:21.364 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:12:21.359+0000 1694f700 -1 osd.1 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:51.002812+0000 front 2019-12-09T18:10:53.484428+0000 (oldest deadline 2019-12-09T18:11:33.999517+0000) 2019-12-09T18:12:21.769 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:12:21.764+0000 1694f700 -1 osd.3 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:53.961136+0000 front 2019-12-09T18:10:53.497401+0000 (oldest deadline 2019-12-09T18:11:33.889374+0000) 2019-12-09T18:12:21.793 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:12:21.787+0000 1694f700 -1 osd.7 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.632040+0000 front 2019-12-09T18:10:53.936776+0000 (oldest deadline 2019-12-09T18:11:33.870532+0000) 2019-12-09T18:12:22.029 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:12:22.024+0000 1694f700 -1 osd.4 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:54.627303+0000 front 2019-12-09T18:10:52.383134+0000 (oldest deadline 2019-12-09T18:11:34.826601+0000) 2019-12-09T18:12:22.030 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:12:22.015+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e218 v218) 2019-12-09T18:12:22.074 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:12:22.069+0000 1694f700 -1 osd.0 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:10:52.707194+0000 front 2019-12-09T18:10:53.961572+0000 (oldest deadline 2019-12-09T18:11:35.388991+0000) 2019-12-09T18:12:22.122 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:22.118+0000 1694f700 -1 osd.2 218 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:11:07.978481+0000 (oldest deadline 2019-12-09T18:11:47.978481+0000) 2019-12-09T18:12:22.127 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:12:22.122+0000 1694f700 -1 osd.2 218 get_health_metrics reporting 35 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-12-09T18:12:48.165 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:12:48.160+0000 1694f700 -1 osd.5 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:133560 7.3 7.2b4165c3 (undecoded) ondisk+write+known_if_redirected e218) 2019-12-09T18:14:15.697 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:15.691+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:15.855 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:15.848+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:16.141 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:16.136+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:16.168 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:16.161+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:16.233 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:16.226+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:16.316 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:16.306+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:16.733 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:16.728+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:16.846 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:16.837+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:16.979 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:16.974+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:17.168 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:17.163+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:17.197 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:17.190+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:17.258 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:17.251+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:17.288 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:17.281+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:17.753 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:17.747+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:17.889 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:17.882+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:18.027 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:18.022+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:18.215 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:18.208+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:18.221 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:18.215+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:18.250 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:18.244+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:18.283 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:18.277+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:18.732 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:18.728+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:18.868 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:18.861+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:19.033 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:19.027+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:19.190 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:19.183+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:19.233 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:19.226+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:19.254 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:19.248+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:19.260 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:19.255+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:19.767 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:19.763+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:19.910 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:19.903+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:20.009 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:20.005+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:20.173 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:20.166+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:20.228 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:20.221+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:20.244 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:20.238+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:20.273 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:20.265+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:20.812 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:20.806+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:20.907 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:20.900+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:21.037 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:21.032+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:21.202 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:21.195+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:21.208 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:21.202+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:21.215 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:21.208+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:21.267 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:21.261+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:21.858 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:21.854+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:21.898 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:21.890+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:22.077 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:22.072+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:22.242 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:22.236+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:22.244 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:22.237+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:22.265 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:22.258+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:22.322 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:22.315+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:22.887 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:22.881+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:22.906 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:22.901+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:23.128 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:23.123+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:23.218 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:23.212+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:23.224 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:23.214+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:23.268 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:23.261+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:23.348 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:23.337+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:23.845 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:23.838+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:23.940 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:23.935+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:24.149 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:24.143+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:24.202 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:24.196+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:24.241 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:24.235+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:24.252 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:24.245+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:24.345 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:24.339+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:24.838 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:24.830+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:24.935 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:24.931+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:25.161 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:25.155+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:25.197 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:25.193+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:25.218 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:25.211+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:25.284 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:25.280+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:25.314 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:25.306+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:25.820 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:25.813+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:25.928 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:25.923+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:26.203 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:26.197+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:26.214 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:26.209+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:26.236 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:26.228+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:26.277 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:26.270+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:26.336 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:26.330+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:26.787 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:26.780+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:26.927 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:26.922+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:27.168 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:27.164+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:27.226 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:27.219+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:27.229 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:27.224+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:27.316 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:27.309+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:27.352 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:27.347+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:27.766 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:27.759+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:27.942 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:27.937+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:28.127 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:28.123+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:28.263 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:28.257+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:28.279 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:28.271+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:28.307 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:28.300+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:28.377 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:28.372+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:28.796 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:28.782+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:28.916 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:28.911+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:29.109 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:29.103+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:29.294 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:29.287+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:29.326 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:29.319+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:29.333 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:29.326+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:29.409 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:29.403+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:29.755 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:29.748+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:29.921 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:29.915+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:30.075 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:30.071+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:30.289 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:30.283+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:30.332 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:30.325+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:30.347 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:30.341+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:30.438 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:30.434+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:30.722 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:30.716+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:30.899 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:30.892+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:31.133 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:31.125+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:31.309 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:31.302+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:31.341 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:31.334+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:31.361 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:31.355+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:31.408 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:31.403+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:31.724 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:31.717+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:31.884 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:31.879+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:32.118 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:32.113+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:32.308 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:32.302+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:32.317 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:32.310+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:32.399 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:32.394+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:32.400 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:32.394+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:32.689 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:32.683+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:32.891 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:32.886+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:33.139 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:33.133+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:33.287 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:33.280+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:33.321 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:33.316+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:33.362 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:33.356+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:33.424 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:33.420+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:33.689 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:33.684+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:33.881 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:33.875+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:34.122 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:34.117+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:34.319 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:34.313+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:34.353 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:34.348+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:34.397 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:34.391+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:34.466 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:34.460+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:34.727 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:34.722+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:34.911 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:34.907+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:35.093 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:35.088+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:35.336 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:35.327+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:35.380 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:35.374+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:35.446 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:35.441+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:35.450 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:35.445+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:35.711 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:35.706+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:35.886 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:35.881+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:36.097 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:36.093+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:36.322 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:36.316+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:36.393 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:36.388+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:36.433 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:36.427+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:36.448 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:36.442+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:36.698 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:36.693+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:36.849 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:36.844+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:37.110 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:37.106+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:37.375 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:37.370+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:37.392 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:37.386+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:37.410 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:37.406+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:37.469 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:37.464+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:37.736 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:37.731+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:37.882 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:37.877+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:38.121 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:38.116+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:38.344 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:38.338+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:38.409 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:38.403+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:38.462 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:38.456+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:38.483 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:38.478+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:38.728 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:38.722+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:38.923 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:38.917+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:39.172 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:39.167+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:39.366 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:39.361+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:39.422 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:39.416+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:39.495 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:39.487+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:39.505 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:39.500+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:39.726 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:39.721+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:39.952 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:39.948+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:40.126 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:40.122+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:40.353 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:40.348+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:40.418 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:40.412+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:40.495 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:40.485+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:40.536 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:40.530+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:40.720 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:40.714+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:40.983 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:40.979+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:41.085 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:41.082+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:41.343 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:41.337+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:41.472 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:41.466+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:41.507 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:41.501+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:41.524 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:41.519+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:41.736 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:41.730+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:41.973 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:41.968+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:42.053 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:42.046+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:42.335 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:42.329+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:42.462 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:42.456+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:42.486 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:42.480+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:42.540 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:42.535+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:42.739 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:42.733+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:42.989 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:42.984+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:43.019 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:43.014+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:43.342 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:43.336+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:43.465 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:43.457+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:43.479 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:43.474+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:43.511 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:43.505+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:43.745 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:43.740+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:44.009 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:44.004+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:44.061 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:44.055+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:44.331 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:44.326+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:44.477 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:44.471+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:44.493 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:44.487+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:44.513 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:44.507+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:44.782 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:44.776+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:45.012 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:45.007+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:45.016 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:45.012+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:45.348 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:45.342+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:45.455 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:45.450+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:45.507 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:45.501+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:45.512 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:45.506+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:45.818 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:45.812+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:45.977 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:45.972+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:46.001 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:45.995+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:46.339 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:46.335+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:46.453 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:46.447+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:46.474 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:46.469+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:46.507 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:46.493+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:46.867 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:46.861+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:47.020 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:47.014+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:47.050 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:47.045+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:47.301 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:47.295+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:47.478 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:47.472+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:47.485 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:47.480+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:47.512 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:14:47.509+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 46sec e223 v223) 2019-12-09T18:14:47.530 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:47.525+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:47.923 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:47.917+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:47.988 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:47.983+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:48.033 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:48.028+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:48.342 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:48.336+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:48.456 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:48.450+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:48.493 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:48.487+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:48.511 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:48.505+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:48.973 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:48.968+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:48.997 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:48.991+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:49.052 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:49.047+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:49.336 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:49.330+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:49.428 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:49.423+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:49.479 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:49.472+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:49.496 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:49.490+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:49.940 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:49.933+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:50.041 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:50.035+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:50.053 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:50.047+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:50.348 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:50.342+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:50.388 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:50.382+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:50.472 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:50.466+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:50.492 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:50.486+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:50.951 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:50.931+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:51.085 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:51.078+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:51.101 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:51.096+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:51.355 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:51.349+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:51.383 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:51.374+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:51.521 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:51.516+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:51.536 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:51.529+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:51.977 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:14:51.970+0000 1694f700 -1 osd.6 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:33.919719+0000 front 2019-12-09T18:13:33.925731+0000 (oldest deadline 2019-12-09T18:14:14.864556+0000) 2019-12-09T18:14:52.124 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:14:52.119+0000 1694f700 -1 osd.1 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:29.770749+0000 front 2019-12-09T18:13:29.772397+0000 (oldest deadline 2019-12-09T18:14:15.049509+0000) 2019-12-09T18:14:52.133 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:14:52.128+0000 1694f700 -1 osd.3 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:31.810050+0000 front 2019-12-09T18:13:31.691124+0000 (oldest deadline 2019-12-09T18:14:16.964344+0000) 2019-12-09T18:14:52.365 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:14:52.359+0000 1694f700 -1 osd.5 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:30.109803+0000 front 2019-12-09T18:13:30.311124+0000 (oldest deadline 2019-12-09T18:14:15.976179+0000) 2019-12-09T18:14:52.411 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:14:52.404+0000 1694f700 -1 osd.4 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.678053+0000 front 2019-12-09T18:13:32.753543+0000 (oldest deadline 2019-12-09T18:14:15.983233+0000) 2019-12-09T18:14:52.528 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:14:52.523+0000 1694f700 -1 osd.0 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:32.591113+0000 front 2019-12-09T18:13:32.753416+0000 (oldest deadline 2019-12-09T18:14:15.722717+0000) 2019-12-09T18:14:52.543 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:14:52.535+0000 1694f700 -1 osd.7 223 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:13:34.640673+0000 front 2019-12-09T18:13:34.964192+0000 (oldest deadline 2019-12-09T18:14:15.709092+0000) 2019-12-09T18:14:52.546 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:14:52.543+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 46sec e223 v223) 2019-12-09T18:15:21.087 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:36:19.113 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:21.096 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:36:19.123 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:21.105 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:36:19.068 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:21.109 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:36:19.072 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:21.111 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:36:19.137 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:21.120 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:36:19.141 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:21.373 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:36:19.334 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:21.390 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:36:19.417 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:21.439 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:36:19.465 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:15:25.309 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:15:25.293+0000 33a73700 -1 osd.2 228 build_incremental_map_msg missing incremental map 228 2019-12-09T18:15:26.977 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:15:26.879+0000 35a77700 -1 osd.2 229 build_incremental_map_msg missing incremental map 228 2019-12-09T18:15:46.346 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:15:46.341+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:15:47.103 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:15:47.098+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:15:47.368 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:15:47.363+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:15:48.127 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:15:48.121+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:15:48.417 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:15:48.411+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:15:48.917 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:15:48.912+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:15:49.144 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:15:49.139+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:15:49.467 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:15:49.463+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:15:49.902 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:15:49.898+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:15:50.178 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:15:50.172+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:15:50.471 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:15:50.466+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:15:50.728 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:15:50.722+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:05.619541+0000 front 2019-12-09T18:15:08.159466+0000 (oldest deadline 2019-12-09T18:15:49.865067+0000) 2019-12-09T18:15:50.882 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:15:50.877+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:15:51.224 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:15:51.218+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:15:51.435 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:15:51.429+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:15:51.765 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:15:51.760+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:05.619541+0000 front 2019-12-09T18:15:08.159466+0000 (oldest deadline 2019-12-09T18:15:49.865067+0000) 2019-12-09T18:15:51.869 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:15:51.864+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:15:52.125 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:15:52.119+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:15:52.227 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:15:52.222+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:15:52.424 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:15:52.419+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:15:52.735 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:15:52.730+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:05.619541+0000 front 2019-12-09T18:15:08.159466+0000 (oldest deadline 2019-12-09T18:15:49.865067+0000) 2019-12-09T18:15:52.818 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:15:52.812+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:15:52.899 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:15:52.894+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:15:53.174 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:15:53.169+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:15:53.267 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:15:53.262+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:15:53.472 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:15:53.467+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:15:53.786 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:15:53.781+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:15:53.788 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:15:53.784+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:05.619541+0000 front 2019-12-09T18:15:08.159466+0000 (oldest deadline 2019-12-09T18:15:49.865067+0000) 2019-12-09T18:15:53.949 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:15:53.945+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:15:54.156 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:15:54.151+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:15:54.277 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:15:54.272+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:15:54.480 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:15:54.476+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:15:54.726 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:15:54.719+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:15:54.750 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:15:54.744+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:05.619541+0000 front 2019-12-09T18:15:08.159466+0000 (oldest deadline 2019-12-09T18:15:49.865067+0000) 2019-12-09T18:15:54.760 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:15:54.755+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:15:54.993 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:15:54.989+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:15:55.179 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:15:55.174+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:15:55.263 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:15:55.258+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:15:55.480 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:15:55.474+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:15:55.719 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:15:55.714+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:05.619541+0000 front 2019-12-09T18:15:08.159466+0000 (oldest deadline 2019-12-09T18:15:49.865067+0000) 2019-12-09T18:15:55.723 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:15:55.719+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:15:55.739 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:15:55.733+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:15:55.981 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:15:55.971+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:15:56.185 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:15:56.181+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:15:56.287 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:15:56.282+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:15:56.516 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:15:56.511+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:15:56.744 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:15:56.737+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:15:56.765 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:15:56.760+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:05.619541+0000 front 2019-12-09T18:15:08.159466+0000 (oldest deadline 2019-12-09T18:15:49.865067+0000) 2019-12-09T18:15:56.771 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:15:56.766+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:15:56.968 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:15:56.963+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:15:57.187 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:15:57.183+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:15:57.285 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:15:57.281+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:15:57.571 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:15:57.560+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:15:57.777 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:15:57.772+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:15:57.786 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:15:57.777+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:15:57.808 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:15:57.804+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:05.619541+0000 front 2019-12-09T18:15:08.159466+0000 (oldest deadline 2019-12-09T18:15:49.865067+0000) 2019-12-09T18:15:57.972 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:15:57.967+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:15:58.197 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:15:58.192+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:15:58.325 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:15:58.321+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:15:58.540 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:15:58.536+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:15:58.786 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:15:58.780+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:05.619541+0000 front 2019-12-09T18:15:08.159466+0000 (oldest deadline 2019-12-09T18:15:49.865067+0000) 2019-12-09T18:15:58.786 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:15:58.781+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:15:58.801 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:15:58.796+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:15:59.023 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:15:59.018+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:15:59.171 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:15:59.166+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:15:59.291 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:15:59.285+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:15:59.541 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:15:59.535+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:15:59.775 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:15:59.770+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:15:59.782 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:15:59.775+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:15:59.792 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:15:59.786+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:05.619541+0000 front 2019-12-09T18:15:08.159466+0000 (oldest deadline 2019-12-09T18:15:49.865067+0000) 2019-12-09T18:16:00.051 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:00.047+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:00.189 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:00.185+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:00.272 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:00.266+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:00.515 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:00.506+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:00.748 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:00.741+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:00.769 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:16:00.764+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:05.619541+0000 front 2019-12-09T18:15:08.159466+0000 (oldest deadline 2019-12-09T18:15:49.865067+0000) 2019-12-09T18:16:00.789 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:00.784+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:01.062 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:01.057+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:01.214 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:01.208+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:01.310 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:01.304+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:01.535 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:01.530+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:01.757 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:16:01.752+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:05.619541+0000 front 2019-12-09T18:15:08.159466+0000 (oldest deadline 2019-12-09T18:15:49.865067+0000) 2019-12-09T18:16:01.764 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:01.755+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:01.766 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:01.760+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:01.832 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:01.826+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:02.056 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:02.051+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:02.187 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:02.182+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:02.344 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:02.339+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:02.556 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:02.551+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:02.724 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:02.719+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:02.732 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:02.726+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:02.808 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:16:02.803+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:05.619541+0000 front 2019-12-09T18:15:08.159466+0000 (oldest deadline 2019-12-09T18:15:49.865067+0000) 2019-12-09T18:16:02.862 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:02.856+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:03.079 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:03.074+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:03.173 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:03.167+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:03.320 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:03.314+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:03.604 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:03.599+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:03.731 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:03.722+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:03.732 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:03.727+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:03.830 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:16:03.825+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:05.619541+0000 front 2019-12-09T18:15:08.159466+0000 (oldest deadline 2019-12-09T18:15:49.865067+0000) 2019-12-09T18:16:03.855 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:03.850+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:04.090 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:04.085+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:04.197 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:04.193+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:04.297 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:04.292+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:04.572 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:04.566+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:04.782 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:04.776+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:04.785 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:04.781+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:04.821 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:04.814+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:04.871 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:16:04.866+0000 1694f700 -1 osd.6 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:05.619541+0000 front 2019-12-09T18:15:08.159466+0000 (oldest deadline 2019-12-09T18:15:49.865067+0000) 2019-12-09T18:16:05.137 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:05.132+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:05.167 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:05.163+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:05.305 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:05.300+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:05.606 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:05.601+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:05.759 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:05.754+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:05.766 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:05.759+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:05.853 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:05.847+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:06.129 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:06.123+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:06.151 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:06.146+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:06.274 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:06.270+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:06.597 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:06.592+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:06.754 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:06.747+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:06.758 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:06.753+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:06.810 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:06.804+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:07.159 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:07.153+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:07.187 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:07.182+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:07.253 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:07.248+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:07.616 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:07.611+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:07.792 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:07.786+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:07.805 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:07.799+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:07.809 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:07.802+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:08.153 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:08.148+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:08.225 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:08.220+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:08.305 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:08.300+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:08.666 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:08.661+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:08.759 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:08.753+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:08.815 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:08.811+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:08.823 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:08.817+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:09.170 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:09.164+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:09.268 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:09.262+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:09.302 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:09.297+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:09.669 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:09.663+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:09.786 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:09.779+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:09.846 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:09.838+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:09.848 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:09.843+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:10.133 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:10.126+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:10.266 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:10.261+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:10.312 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:10.308+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:10.648 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:10.643+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:10.822 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:10.816+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:10.878 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:10.869+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:10.881 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:10.874+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:11.109 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:11.104+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:11.278 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:11.274+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:11.285 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:11.280+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:11.610 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:11.605+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:11.797 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:11.790+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:11.916 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:11.907+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:11.919 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:11.912+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:12.099 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:12.088+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:12.244 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:12.240+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:12.334 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:12.328+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:12.608 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:12.603+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:12.788 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:12.781+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:12.908 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:12.904+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:12.917 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:12.907+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:13.077 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:13.072+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:13.247 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:13.243+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:13.344 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:13.340+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:13.595 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:13.588+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:13.777 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:13.772+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:13.959 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:13.953+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:13.960 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:13.956+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:14.037 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:14.032+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:14.287 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:14.281+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:14.332 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:14.327+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:14.652 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:14.647+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:14.736 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:14.730+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:14.939 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:14.934+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:14.947 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:14.942+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:15.013 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:15.007+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:15.307 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:15.303+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:15.320 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:15.316+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:15.672 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:15.668+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:15.720 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:15.714+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:15.963 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:15.954+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:15.966 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:15.959+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:15.969 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:15.963+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:16.274 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:16.271+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:16.354 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:16.350+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:16.659 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:16.654+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:16.750 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:16.744+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:16.949 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:16.942+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:16.950 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:16.946+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:16.994 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:16.988+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:17.274 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:17.270+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:17.391 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:17.387+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:17.694 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:17.690+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:17.784 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:17.778+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:17.968 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:17.962+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:18.006 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:17.998+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:18.009 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:18.002+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:18.273 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:18.269+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:18.357 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:18.353+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:18.726 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:18.722+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:18.825 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:18.818+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:18.971 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:18.967+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:18.979 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:18.974+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:19.018 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:19.011+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:19.256 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:19.252+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:19.340 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:19.336+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:19.769 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:19.765+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:19.866 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:19.860+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:19.999 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:19.995+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:20.006 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:20.001+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:20.028 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:20.022+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:20.291 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:20.286+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:20.326 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:20.321+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:20.728 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:20.724+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:20.844 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:20.839+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:20.971 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:20.967+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:20.980 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:20.974+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:21.070 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:21.064+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:21.322 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:21.319+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:21.329 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:21.326+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:21.770 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:21.766+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:21.844 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:21.837+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:21.974 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:21.967+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:21.976 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:21.970+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:22.045 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:22.038+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:22.298 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:22.292+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:22.370 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:22.366+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:22.767 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:22.762+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:22.834 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:22.828+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:22.876 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:16:22.871+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e229 v229) 2019-12-09T18:16:23.010 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:23.004+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:23.011 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:23.006+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:23.061 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:23.054+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:23.326 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:23.321+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:23.421 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:23.417+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:23.794 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:23.788+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:23.810 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:23.804+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:24.020 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:24.016+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:24.027 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:24.021+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:24.102 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:24.096+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:24.317 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:24.312+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:24.434 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:24.429+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:24.791 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:24.785+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:24.811 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:24.806+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:25.039 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:25.030+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:25.043 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:25.035+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:25.079 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:25.074+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:25.319 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:25.314+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:25.393 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:25.388+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:25.815 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:25.809+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:25.824 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:25.818+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:26.088 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:26.083+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:26.095 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:26.089+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:26.122 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:26.117+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:26.372 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:26.367+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:26.382 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:26.374+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:26.861 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:26.849+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:26.866 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:26.862+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:27.106 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:27.098+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:27.109 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:27.102+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:27.116 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:27.110+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:27.382 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:27.377+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:27.410 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:27.405+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:27.881 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:27.876+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:27.897 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:27.892+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:27.897 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:16:27.894+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e229 v229) 2019-12-09T18:16:28.105 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:28.098+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:28.116 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:28.107+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:28.119 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:28.112+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:28.364 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:28.360+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:28.433 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:28.428+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:28.902 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:28.897+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:28.909 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:28.905+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:29.110 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:29.102+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:29.112 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:29.105+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:29.153 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:29.149+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:29.397 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:29.392+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:29.474 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:29.470+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:29.889 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:29.879+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:29.889 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:29.878+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:30.160 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:30.153+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:30.163 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:30.156+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:30.164 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:30.159+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:30.450 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:30.445+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:30.506 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:30.502+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:30.890 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:30.884+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:30.920 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:30.915+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:31.116 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:31.111+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:31.123 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:31.117+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:31.168 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:31.163+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:31.459 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:31.454+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:31.505 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:31.500+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:31.911 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:31.906+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:31.921 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:31.916+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:32.140 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:16:32.135+0000 1694f700 -1 osd.7 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:07.646671+0000 front 2019-12-09T18:15:07.648238+0000 (oldest deadline 2019-12-09T18:15:48.150089+0000) 2019-12-09T18:16:32.166 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:32.159+0000 1694f700 -1 osd.2 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:15:20.866856+0000 (oldest deadline 2019-12-09T18:16:00.866856+0000) 2019-12-09T18:16:32.169 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:32.164+0000 1694f700 -1 osd.2 229 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:16:32.441 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:16:32.436+0000 1694f700 -1 osd.0 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:10.327485+0000 front 2019-12-09T18:15:10.326037+0000 (oldest deadline 2019-12-09T18:15:51.889970+0000) 2019-12-09T18:16:32.555 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:16:32.550+0000 1694f700 -1 osd.1 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:02.764768+0000 front 2019-12-09T18:15:02.945419+0000 (oldest deadline 2019-12-09T18:15:46.552112+0000) 2019-12-09T18:16:32.940 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:16:32.935+0000 1694f700 -1 osd.4 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:08.291919+0000 front 2019-12-09T18:15:08.322919+0000 (oldest deadline 2019-12-09T18:15:52.480013+0000) 2019-12-09T18:16:32.943 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:16:32.938+0000 1694f700 -1 osd.3 229 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:15:06.093553+0000 front 2019-12-09T18:15:02.746232+0000 (oldest deadline 2019-12-09T18:15:45.965751+0000) 2019-12-09T18:16:32.970 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:16:32.966+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e229 v229) 2019-12-09T18:16:33.505 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:16:33.418+0000 1694f700 -1 osd.2 230 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4530.0:120026 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e227) 2019-12-09T18:17:07.311 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:17:07.307+0000 39a7f700 -1 osd.5 234 build_incremental_map_msg missing incremental map 234 2019-12-09T18:17:07.680 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:17:07.507+0000 37a7b700 -1 osd.5 234 build_incremental_map_msg missing incremental map 234 2019-12-09T18:17:07.865 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:17:07.509+0000 11caf700 -1 osd.5 234 build_incremental_map_msg missing incremental map 234 2019-12-09T18:17:07.883 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:17:07.582+0000 3aa81700 -1 osd.5 234 build_incremental_map_msg missing incremental map 234 2019-12-09T18:17:07.887 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:17:07.593+0000 37a7b700 -1 osd.5 234 build_incremental_map_msg missing incremental map 234 2019-12-09T18:17:08.067 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:17:07.965+0000 34274700 -1 osd.5 234 build_incremental_map_msg missing incremental map 234 2019-12-09T18:18:29.612 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:29.607+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:29.845 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:29.840+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:30.370 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:30.364+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:30.635 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:30.630+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:30.828 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:30.823+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:31.363 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:31.358+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:31.386 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:31.382+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:31.390 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:31.385+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:31.650 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:31.643+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:31.794 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:31.788+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:32.208 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:32.202+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:32.371 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:32.365+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:32.384 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:32.375+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:32.394 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:32.389+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:32.421 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:32.414+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:32.607 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:32.602+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:32.807 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:32.801+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:33.202 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:33.197+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:33.401 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:33.397+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:33.419 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:33.414+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:33.426 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:33.421+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:33.450 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:33.446+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:33.618 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:33.613+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:33.678 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:39:31.705 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:33.714 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:39:31.741 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:33.718 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:39:31.745 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:33.723 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:39:31.750 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:33.754 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:39:31.717 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:33.796 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:33.789+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:33.815 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:39:31.778 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:33.885 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:39:31.911 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:33.927 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:39:31.953 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:34.037 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:39:32.000 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:18:34.187 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:34.180+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:34.398 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:34.393+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:34.408 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:34.398+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:34.465 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:34.461+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:34.487 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:34.481+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:34.573 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:34.567+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:34.806 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:34.800+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:35.223 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:35.216+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:35.374 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:35.369+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:35.452 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:35.445+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:35.455 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:35.449+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:35.466 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:35.462+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:35.563 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:35.559+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:35.801 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:35.794+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:36.206 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:36.200+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:36.419 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:36.414+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:36.436 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:36.429+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:36.445 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:36.440+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:36.475 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:36.468+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:36.589 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:36.580+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:36.759 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:36.753+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:37.197 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:37.192+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:37.407 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:37.397+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:37.408 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:37.404+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:37.467 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:37.460+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:37.469 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:37.457+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:37.629 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:37.624+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:37.767 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:37.761+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:38.160 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:38.153+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:38.408 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:38.404+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:38.440 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:38.435+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:38.497 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:38.491+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:38.520 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:38.512+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:38.583 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:38.579+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:38.722 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:38.716+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:39.141 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:39.134+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:39.399 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:39.396+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:39.419 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:39.415+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:39.470 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:39.463+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:39.521 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:39.511+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:39.566 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:39.562+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:39.778 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:39.771+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:40.135 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:40.129+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:40.438 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:40.434+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:40.458 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:40.454+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:40.486 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:40.479+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:40.540 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:40.532+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:40.590 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:40.584+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:40.787 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:40.780+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:41.113 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:41.104+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:41.399 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:41.393+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:41.499 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:41.495+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:41.508 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:41.502+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:41.538 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:41.532+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:41.608 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:41.603+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:41.828 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:41.822+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:42.088 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:42.081+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:42.438 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:42.426+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:42.472 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:42.467+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:42.523 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:42.517+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:42.536 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:42.529+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:42.605 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:42.600+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:42.824 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:42.816+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:43.136 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:43.128+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:43.457 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:43.453+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:43.521 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:43.517+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:43.551 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:43.544+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:43.552 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:43.546+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:43.638 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:43.633+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:43.859 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:43.853+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:44.105 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:44.099+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:44.453 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:44.448+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:44.515 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:44.508+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:44.522 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:44.515+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:44.525 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:44.521+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:44.630 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:44.625+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:44.891 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:44.884+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:45.106 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:45.100+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:45.473 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:45.469+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:45.492 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:45.488+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:45.496 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:45.489+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:45.511 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:45.503+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:45.596 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:45.591+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:45.880 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:45.874+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:46.142 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:46.136+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:46.434 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:46.428+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:46.456 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:46.449+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:46.489 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:46.483+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:46.532 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:46.526+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:46.573 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:46.568+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:46.906 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:46.900+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:47.114 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:47.105+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:47.388 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:47.383+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:47.483 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:47.476+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:47.522 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:47.515+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:47.533 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:47.527+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:47.623 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:47.617+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:47.945 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:47.938+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:48.146 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:48.139+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:48.392 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:48.386+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:48.487 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:48.480+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:48.510 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:48.504+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:48.521 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:48.515+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:48.586 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:48.578+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:48.991 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:48.984+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:49.192 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:49.186+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:49.361 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:49.356+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:49.467 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:49.461+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:49.502 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:49.496+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:49.563 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:49.556+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:49.609 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:49.604+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:49.980 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:49.974+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:50.227 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:50.220+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:50.345 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:50.341+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:50.480 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:50.474+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:50.567 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:50.493+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:50.581 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:50.575+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:50.615 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:50.608+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:50.938 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:50.932+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:51.204 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:51.197+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:51.357 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:51.352+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:51.465 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:51.459+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:51.546 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:51.540+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:51.568 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:51.563+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:51.663 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:51.652+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:51.963 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:51.956+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:52.256 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:52.249+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:52.380 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:52.374+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:52.426 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:52.419+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:52.535 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:52.526+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:52.602 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:52.595+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:52.673 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:52.667+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:52.954 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:52.943+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:53.243 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:53.237+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:53.399 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:53.393+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:53.467 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:53.460+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:53.510 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:53.503+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:53.657 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:53.649+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:53.719 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:53.712+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:53.997 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:53.990+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:54.263 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:54.257+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:54.361 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:54.357+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:54.480 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:54.474+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:54.532 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:54.525+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:54.685 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:54.679+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:54.703 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:54.698+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:55.018 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:55.011+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:55.300 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:55.293+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:55.364 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:55.360+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:55.440 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:55.435+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:55.525 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:55.520+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:55.709 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:55.703+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:55.758 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:55.752+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:55.981 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:55.975+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:56.303 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:56.296+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:56.356 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:56.352+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:56.493 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:56.487+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:56.494 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:56.489+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:56.706 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:56.700+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:56.718 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:56.713+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:56.959 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:56.954+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:57.310 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:57.303+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:57.322 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:57.318+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:57.510 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:57.505+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:57.520 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:57.514+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:57.684 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:57.678+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:57.720 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:57.714+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:57.916 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:57.910+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:58.281 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:58.276+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:58.322 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:58.316+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:58.545 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:58.540+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:58.557 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:58.552+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:58.702 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:58.696+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:58.722 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:58.716+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:58.952 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:58.946+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:18:59.282 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:18:59.277+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:18:59.296 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:18:59.292+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:18:59.531 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:18:59.526+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:18:59.590 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:18:59.585+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:18:59.703 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:18:59.697+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:18:59.714 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:18:59.709+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:18:59.973 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:18:59.967+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:19:00.290 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:19:00.284+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:19:00.311 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:19:00.305+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:19:00.553 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:19:00.547+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:19:00.635 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:19:00.629+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:19:00.733 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:19:00.727+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:19:00.748 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:19:00.742+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:19:00.953 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:19:00.947+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:19:01.323 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:19:01.317+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:19:01.327 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:19:01.321+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:19:01.524 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:19:01.518+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:19:01.642 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:19:01.637+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:19:01.707 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:19:01.701+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:19:01.716 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:19:01.710+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:19:01.924 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:19:01.919+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:19:02.340 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:19:02.334+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:19:02.370 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:19:02.365+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:19:02.521 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:19:02.516+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:19:02.647 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:19:02.642+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:19:02.716 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:19:02.711+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:19:02.745 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:19:02.739+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:19:02.888 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:19:02.880+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:19:03.388 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:19:03.384+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.336919+0000 front 2019-12-09T18:17:45.076577+0000 (oldest deadline 2019-12-09T18:18:29.750824+0000) 2019-12-09T18:19:03.389 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:19:03.381+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:47.626589+0000 front 2019-12-09T18:17:47.809041+0000 (oldest deadline 2019-12-09T18:18:31.505385+0000) 2019-12-09T18:19:03.497 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:19:03.492+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:43.353582+0000 front 2019-12-09T18:17:43.174664+0000 (oldest deadline 2019-12-09T18:18:29.075634+0000) 2019-12-09T18:19:03.689 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:19:03.684+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.620734+0000 front 2019-12-09T18:17:46.248302+0000 (oldest deadline 2019-12-09T18:18:30.864642+0000) 2019-12-09T18:19:03.708 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:19:03.702+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:45.021071+0000 front 2019-12-09T18:17:45.088717+0000 (oldest deadline 2019-12-09T18:18:30.760391+0000) 2019-12-09T18:19:03.729 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:19:03.724+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:46.166411+0000 front 2019-12-09T18:17:46.247861+0000 (oldest deadline 2019-12-09T18:18:31.882579+0000) 2019-12-09T18:19:03.820 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:19:03.811+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 45sec e234 v234) 2019-12-09T18:19:03.850 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:19:03.844+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:17:48.272153+0000 front 2019-12-09T18:17:48.322322+0000 (oldest deadline 2019-12-09T18:18:29.337927+0000) 2019-12-09T18:19:21.404 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:40:19.430 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:19:21.411 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:40:19.438 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:19:21.420 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:40:19.446 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:19:21.423 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:40:19.449 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:19:21.426 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:40:19.390 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:19:21.436 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:40:19.399 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:19:21.493 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:40:19.519 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:19:21.496 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:40:19.522 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:19:21.503 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:40:19.467 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:19:58.406 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:19:58.402+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:19:59.090 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:19:59.085+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:19:59.407 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:19:59.402+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:19:59.865 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:19:59.859+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:00.102 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:00.096+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:00.295 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:00.289+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:00.438 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:00.431+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:00.659 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:00.653+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:00.880 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:00.874+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:00.978 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:00.972+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:01.129 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:01.124+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:01.342 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:01.335+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:01.426 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:01.421+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:01.710 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:01.705+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:01.877 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:01.872+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:01.955 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:01.950+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:02.143 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:02.138+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:02.368 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:02.361+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:02.480 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:02.475+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:02.740 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:02.734+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:02.914 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:02.909+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:02.934 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:02.927+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:03.143 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:03.138+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:03.395 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:03.389+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:03.534 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:03.528+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:03.718 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:03.712+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:03.898 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:03.891+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:03.907 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:03.901+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:04.143 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:04.138+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:04.434 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:04.429+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:04.535 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:04.530+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:04.769 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:04.763+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:04.891 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:04.885+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:04.943 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:04.937+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:05.194 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:05.188+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:05.458 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:05.452+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:05.536 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:05.532+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:05.728 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:05.723+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:05.881 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:05.874+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:05.923 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:05.918+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:06.179 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:06.174+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:06.448 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:06.442+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:06.551 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:06.546+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:06.740 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:06.731+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:06.908 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:06.904+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:06.924 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:06.918+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:07.188 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:07.182+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:07.499 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:07.493+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:07.521 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:07.516+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:07.713 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:07.708+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:07.873 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:07.867+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:07.915 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:07.908+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:08.202 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:08.195+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:08.551 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:08.545+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:08.554 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:08.550+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:08.689 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:08.684+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:08.914 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:08.909+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:08.953 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:08.948+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:09.112 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:09.105+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:09.203 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:09.199+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:09.524 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:09.520+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:09.554 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:09.550+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:09.737 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:09.731+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:09.874 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:09.869+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:10.002 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:09.997+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:10.130 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:10.123+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:10.267 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:10.262+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:10.541 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:10.536+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:10.552 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:10.548+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:10.730 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:10.725+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:10.890 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:10.883+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:11.000 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:10.996+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:11.135 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:11.129+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:11.312 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:11.308+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:11.511 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:11.507+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:11.534 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:11.530+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:11.751 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:11.741+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:11.892 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:11.887+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:11.987 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:11.982+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:12.141 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:12.135+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:12.329 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:12.324+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:12.502 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:12.498+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:12.550 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:12.545+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:12.797 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:12.792+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:12.851 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:12.846+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:13.038 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:13.033+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:13.119 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:13.114+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:13.347 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:13.342+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:13.479 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:13.472+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:13.540 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:13.536+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:13.780 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:13.774+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:13.897 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:13.893+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:14.010 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:14.005+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:14.137 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:14.132+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:14.370 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:14.365+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:14.449 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:14.444+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:14.552 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:14.547+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:14.772 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:14.767+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:14.946 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:14.941+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:14.970 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:14.965+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:15.115 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:15.106+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:15.117 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:15.110+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:15.385 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:15.379+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:15.481 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:15.476+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:15.573 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:15.566+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:15.779 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:15.775+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:15.975 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:15.970+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:15.993 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:15.988+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:16.149 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:16.142+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:16.152 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:16.146+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:16.389 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:16.384+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:16.465 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:16.460+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:16.581 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:16.576+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:16.783 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:16.779+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:16.936 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:16.930+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:17.036 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:17.030+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:17.195 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:17.188+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:17.198 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:17.191+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:17.419 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:17.414+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:17.436 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:17.432+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:17.603 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:17.599+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:17.752 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:17.747+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:17.906 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:17.901+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:18.066 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:18.061+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:18.192 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:18.188+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:18.199 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:18.194+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:18.450 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:18.444+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:18.489 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:18.484+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:18.638 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:18.633+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:18.766 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:18.760+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:18.874 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:18.869+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:19.035 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:19.029+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:19.233 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:19.227+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:19.234 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:19.230+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:19.477 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:19.473+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:19.517 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:19.511+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:19.633 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:19.629+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:19.720 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:19.715+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:19.842 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:19.837+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:19.999 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:19.994+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:20.240 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:20.235+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:20.243 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:20.237+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:20.497 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:20.492+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:20.519 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:20.514+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:20.682 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:20.677+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:20.716 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:20.710+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:20.855 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:20.850+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:21.012 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:21.006+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:21.228 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:21.220+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:21.236 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:21.224+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:21.470 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:21.465+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:21.550 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:21.546+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:21.641 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:21.637+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:21.693 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:21.688+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:21.834 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:21.830+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:21.984 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:21.979+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:22.278 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:22.269+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:22.281 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:22.274+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:22.431 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:22.426+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:22.597 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:22.592+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:22.620 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:22.615+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:22.650 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:22.645+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:22.850 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:22.845+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:22.944 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:22.940+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:23.239 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:23.232+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:23.240 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:23.235+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:23.438 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:23.433+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:23.576 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:23.571+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:23.608 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:23.603+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:23.669 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:23.663+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:23.806 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:23.802+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:23.973 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:23.968+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:24.257 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:24.249+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:24.259 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:24.254+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:24.445 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:24.441+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:24.550 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:24.547+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:24.650 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:24.645+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:24.651 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:24.646+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:24.824 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:24.819+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:24.931 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:24.926+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:25.283 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:25.275+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:25.285 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:25.279+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:25.495 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:25.486+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:25.534 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:25.528+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:25.613 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:25.608+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:25.614 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:25.609+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:25.876 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:25.869+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:25.889 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:25.884+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:26.297 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:26.292+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:26.306 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:26.299+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:26.538 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:26.532+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:26.539 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:26.533+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:26.604 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:26.597+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:26.852 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:26.601+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:26.862 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:26.858+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:26.900 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:26.894+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:27.329 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:27.322+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:27.331 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:27.325+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:27.553 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:27.547+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:27.563 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:27.556+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:27.615 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:27.610+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:27.639 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:27.634+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:27.873 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:27.867+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:27.907 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:27.902+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:28.345 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:28.337+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:28.347 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:28.341+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:28.590 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:28.584+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:28.599 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:28.592+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:28.626 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:28.621+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:28.632 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:28.628+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:28.925 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:28.919+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:28.927 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:28.922+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:29.393 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:29.387+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:29.393 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:29.389+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:29.607 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:29.602+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:29.609 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:29.603+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:29.611 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:29.605+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:29.685 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:29.678+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:29.922 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:29.916+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:29.976 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:29.971+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:30.380 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:30.371+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:30.381 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:30.377+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:30.565 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:30.559+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:30.582 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:30.577+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:30.590 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:30.584+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:30.707 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:30.702+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:30.930 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:30.925+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:30.990 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:30.985+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:31.398 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:31.392+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:31.399 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:31.395+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:31.554 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:31.548+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:31.656 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:31.571+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:31.656 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:31.578+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:31.725 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:31.720+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:31.930 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:31.925+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:32.040 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:32.035+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:32.450 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:32.442+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:32.453 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:32.446+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:32.542 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:32.536+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:32.573 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:32.567+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:32.638 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:32.630+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:32.716 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:32.711+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:32.892 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:32.886+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:33.086 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:33.080+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:33.467 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:33.463+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:33.471 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:33.467+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:33.528 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:33.522+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:33.596 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:33.591+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:33.674 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:33.668+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:33.736 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:33.731+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:33.874 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:33.868+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:34.113 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:20:34.103+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 40sec e240 v240) 2019-12-09T18:20:34.126 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:34.117+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:34.470 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:34.464+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:34.471 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:34.467+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:34.503 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:34.498+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:34.597 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:34.592+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:34.730 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:34.723+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:34.786 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:34.780+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:34.836 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:34.826+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:35.179 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:35.171+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:35.500 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:35.492+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:35.502 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:35.496+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:35.502 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:35.496+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:35.635 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:35.630+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:35.690 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:35.684+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:35.796 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:35.791+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:35.815 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:35.809+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:36.235 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:36.229+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:36.475 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:36.469+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:36.515 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:36.507+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:36.518 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:36.512+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:36.657 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:36.651+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:36.742 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:36.734+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:36.817 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:36.808+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:36.817 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:36.811+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:37.218 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:37.213+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:37.463 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:37.455+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:37.514 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:37.506+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:37.516 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:37.511+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:37.645 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:37.640+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:37.749 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:37.743+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:37.822 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:37.817+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:37.829 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:37.824+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:38.196 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:38.191+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:38.485 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:38.479+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:38.537 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:38.530+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:38.539 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:38.534+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:38.653 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:38.649+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:38.742 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:38.736+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:38.804 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:38.798+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:38.837 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:38.828+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:39.138 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:20:39.127+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 40sec e240 v240) 2019-12-09T18:20:39.155 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:39.151+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:39.441 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:39.436+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:39.592 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:39.584+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:39.595 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:39.589+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:39.670 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:39.666+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:39.726 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:39.720+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:39.783 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:39.777+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:39.881 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:39.876+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:40.180 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:40.175+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:40.466 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:40.460+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:40.577 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:40.569+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:40.581 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:40.574+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:40.699 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:40.693+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:40.710 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:40.705+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:40.830 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:40.823+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:40.851 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:40.846+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:41.164 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:41.158+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:41.458 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:41.452+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:41.535 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:41.526+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:41.537 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:41.531+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:41.665 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:41.659+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:41.695 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:41.689+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:41.843 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:41.838+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:41.873 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:41.866+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:42.201 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:42.196+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:42.424 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:42.416+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:42.527 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:42.518+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:42.529 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:42.523+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:42.630 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:42.624+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:42.690 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:42.685+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:42.870 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:42.864+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:42.889 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:42.885+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:43.216 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:43.211+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:43.397 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:43.386+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:43.537 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:43.529+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:43.539 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:43.533+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:43.589 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:43.584+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:43.698 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:43.692+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:43.840 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:43.833+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:43.919 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:43.914+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:44.152 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:20:44.147+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 40sec e240 v240) 2019-12-09T18:20:44.240 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:44.235+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:44.421 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:44.415+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:44.502 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:44.495+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:44.505 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:44.498+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:44.575 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:44.569+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:44.679 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:44.675+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:44.878 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:44.872+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:44.944 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:44.939+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:45.262 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:45.257+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:45.443 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:45.437+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:45.538 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:45.533+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:45.553 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:45.544+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:45.555 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:45.549+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:45.662 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:45.656+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:45.916 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:45.910+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:45.965 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:45.961+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:46.289 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:46.284+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:46.422 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:46.418+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:46.523 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:46.518+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:46.576 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:46.572+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:46.586 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:46.578+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:46.645 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:46.640+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:46.879 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:46.875+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:46.981 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:46.976+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:47.289 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:47.283+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:47.448 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:47.444+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:47.506 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:47.501+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:47.549 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:47.542+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:47.552 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:47.545+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:47.659 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:47.652+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:47.925 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:47.920+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:47.965 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:47.961+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:48.326 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:48.321+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:48.473 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:20:48.463+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:19.267364+0000 front 2019-12-09T18:19:21.752415+0000 (oldest deadline 2019-12-09T18:19:58.135151+0000) 2019-12-09T18:20:48.479 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:20:48.470+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.723660+0000 front 2019-12-09T18:19:16.022642+0000 (oldest deadline 2019-12-09T18:20:00.264691+0000) 2019-12-09T18:20:48.525 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:48.518+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:19:35.072733+0000 (oldest deadline 2019-12-09T18:20:15.072733+0000) 2019-12-09T18:20:48.528 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:48.521+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:48.642 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:20:48.637+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:21.750186+0000 front 2019-12-09T18:19:17.332876+0000 (oldest deadline 2019-12-09T18:19:59.674092+0000) 2019-12-09T18:20:48.930 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:20:48.925+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:17.768373+0000 front 2019-12-09T18:19:17.771127+0000 (oldest deadline 2019-12-09T18:19:58.228749+0000) 2019-12-09T18:20:48.965 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:20:48.960+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:16.023429+0000 front 2019-12-09T18:19:17.766821+0000 (oldest deadline 2019-12-09T18:20:00.728743+0000) 2019-12-09T18:20:49.232 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:20:49.224+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 40sec e240 v240) 2019-12-09T18:20:49.364 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:20:49.358+0000 1694f700 -1 osd.1 240 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:19:15.812839+0000 front 2019-12-09T18:19:21.528952+0000 (oldest deadline 2019-12-09T18:19:59.080550+0000) 2019-12-09T18:20:49.522 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:20:49.515+0000 1694f700 -1 osd.2 241 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-09T18:20:59.615 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:41:57.642 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:20:59.651 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:41:57.677 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:20:59.672 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:41:57.698 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:20:59.690 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:41:57.716 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:20:59.764 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:41:57.727 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:20:59.775 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:41:57.802 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:20:59.780 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:41:57.743 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:20:59.804 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:41:57.831 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:21:00.003 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:41:57.966 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:21:23.050 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:21:23.012+0000 3927e700 -1 osd.5 245 build_incremental_map_msg missing incremental map 245 2019-12-09T18:21:23.199 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:21:23.193+0000 36a79700 -1 osd.5 245 build_incremental_map_msg missing incremental map 245 2019-12-09T18:21:23.236 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:21:23.214+0000 34a75700 -1 osd.5 245 build_incremental_map_msg missing incremental map 245 2019-12-09T18:21:23.332 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:21:23.247+0000 38a7d700 -1 osd.5 245 build_incremental_map_msg missing incremental map 245 2019-12-09T18:21:23.724 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:21:23.569+0000 3b282700 -1 osd.5 245 build_incremental_map_msg missing incremental map 245 2019-12-09T18:21:27.531 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:21:27.521+0000 36a79700 -1 osd.5 245 build_incremental_map_msg missing incremental map 245 2019-12-09T18:22:20.802 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:20.797+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:21.153 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:21.145+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:21.832 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:21.829+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:22.151 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:22.145+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:22.819 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:22.813+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:23.128 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:23.122+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:23.174 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:23.167+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:23.237 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:23.229+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:23.846 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:23.841+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:23.885 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:23.880+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:24.163 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:24.155+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:24.223 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:24.216+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:24.228 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:24.219+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:24.454 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:24.447+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:24.866 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:24.860+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:24.897 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:24.890+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:25.152 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:25.146+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:25.234 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:25.229+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:25.261 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:25.255+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:25.419 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:25.413+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:25.836 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:25.832+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:25.904 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:25.898+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:26.113 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:26.107+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:26.170 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:26.161+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:26.206 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:26.202+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:26.250 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:26.244+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:26.444 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:26.438+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:26.803 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:26.798+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:26.942 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:26.935+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:27.155 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:27.149+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:27.180 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:27.175+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:27.209 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:27.203+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:27.260 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:27.254+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:27.491 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:27.485+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:27.829 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:27.824+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:27.957 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:27.945+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:28.128 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:28.122+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:28.164 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:28.157+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:28.198 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:28.193+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:28.286 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:28.279+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:28.524 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:28.517+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:28.847 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:28.841+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:28.990 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:28.986+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:29.126 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:29.120+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:29.139 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:29.131+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:29.164 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:29.151+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:29.264 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:29.257+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:29.543 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:29.536+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:29.813 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:29.808+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:30.038 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:30.034+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:30.153 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:30.146+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:30.156 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:30.150+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:30.179 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:30.173+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:30.285 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:30.280+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:30.561 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:30.555+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:30.784 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:30.778+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:31.054 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:31.048+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:31.145 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:31.134+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:31.149 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:31.142+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:31.208 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:31.201+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:31.251 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:31.239+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:31.569 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:31.562+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:31.755 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:31.749+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:32.079 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:32.073+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:32.113 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:32.107+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:32.121 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:32.114+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:32.222 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:32.215+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:32.235 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:32.229+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:32.606 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:32.600+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:32.757 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:32.751+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:33.113 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:33.093+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:33.128 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:33.121+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:33.145 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:33.107+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:33.188 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:33.183+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:33.224 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:33.217+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:33.590 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:33.584+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:33.799 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:33.795+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:34.119 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:34.113+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:34.187 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:34.178+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:34.187 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:34.182+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:34.207 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:34.201+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:34.210 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:34.204+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:34.576 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:34.569+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:34.761 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:34.756+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:35.077 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:35.074+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:35.203 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:35.199+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:35.210 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:35.205+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:35.212 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:35.205+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:35.253 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:35.247+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:35.552 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:35.546+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:35.801 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:35.797+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:36.107 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:36.102+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:36.163 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:36.158+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:36.199 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:36.192+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:36.207 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:36.200+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:36.292 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:36.285+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:36.567 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:36.560+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:36.849 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:36.844+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:37.105 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:37.100+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:37.190 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:37.176+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:37.203 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:37.199+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:37.261 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:37.255+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:37.284 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:37.277+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:37.593 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:37.586+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:37.864 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:37.859+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:38.130 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:38.124+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:38.197 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:38.192+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:38.248 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:38.243+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:38.278 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:38.273+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:38.279 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:38.273+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:38.578 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:38.573+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:38.913 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:38.907+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:39.147 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:39.141+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:39.172 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:39.166+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:39.272 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:39.266+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:39.287 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:39.281+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:39.315 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:39.310+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:39.632 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:39.626+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:39.874 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:39.869+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:40.155 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:40.147+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:40.162 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:40.157+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:40.229 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:40.223+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:40.304 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:40.296+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:40.306 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:40.299+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:40.604 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:40.598+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:40.906 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:40.902+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:41.131 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:41.126+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:41.143 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:41.137+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:41.207 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:41.201+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:41.313 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:41.307+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:41.330 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:41.324+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:41.594 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:41.587+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:41.931 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:41.925+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:42.091 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:42.086+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:42.134 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:42.128+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:42.249 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:42.243+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:42.273 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:42.267+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:42.374 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:42.370+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:42.564 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:42.558+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:42.962 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:42.958+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:43.075 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:43.070+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:43.150 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:43.144+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:43.227 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:43.221+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:43.312 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:43.306+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:43.417 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:43.411+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:43.546 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:43.538+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:43.990 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:43.985+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:44.076 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:44.071+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:44.201 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:44.196+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:44.207 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:44.201+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:44.349 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:44.343+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:44.413 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:44.406+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:44.511 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:44.506+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:44.985 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:44.981+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:45.052 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:45.046+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:45.223 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:45.216+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:45.226 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:45.220+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:45.354 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:45.348+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:45.377 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:45.373+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:45.547 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:45.542+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:46.000 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:45.996+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:46.054 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:46.048+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:46.215 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:46.209+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:46.226 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:46.221+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:46.379 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:46.373+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:46.381 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:46.376+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:46.528 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:46.522+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:47.010 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:47.005+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:47.061 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:47.056+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:47.234 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:47.229+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:47.263 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:47.258+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:47.369 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:47.363+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:47.411 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:47.405+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:47.537 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:47.531+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:48.033 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:48.027+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:48.072 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:48.068+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:48.241 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:48.233+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:48.306 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:48.301+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:48.391 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:48.386+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:48.400 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:48.395+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:48.551 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:48.544+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:49.038 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:49.033+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:49.055 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:49.049+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:49.201 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:49.195+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:49.289 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:49.283+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:49.358 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:49.352+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:49.359 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:49.355+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:49.555 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:49.549+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:50.047 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:50.043+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:50.058 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:50.053+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:50.224 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:50.211+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:50.306 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:50.300+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:50.347 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:50.341+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:50.355 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:50.350+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:50.542 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:50.536+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:51.018 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:51.013+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:51.072 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:51.067+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:51.189 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:51.184+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:51.302 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:51.297+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:51.311 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:51.305+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:51.348 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:51.342+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:51.530 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:51.524+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:52.008 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:52.003+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:52.100 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:52.093+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:52.188 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:52.182+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:52.262 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:52.257+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:52.303 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:52.298+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:52.304 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:52.298+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:52.512 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:52.506+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:52.997 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:52.992+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:53.151 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:53.145+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:53.179 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:53.174+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:53.273 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:53.268+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:53.283 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:53.278+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:53.357 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:53.350+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:53.549 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:53.543+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:53.978 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:53.973+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:54.168 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:54.162+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:54.182 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:54.177+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:54.271 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:54.265+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:54.307 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:54.302+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:54.323 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:54.318+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:54.596 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:54.591+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:54.930 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:22:54.926+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 41sec e245 v245) 2019-12-09T18:22:55.015 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:55.011+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:55.148 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:55.142+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:55.225 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:55.218+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:55.278 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:55.272+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:55.303 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:55.297+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:55.360 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:55.354+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:55.594 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:55.587+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:56.030 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:56.026+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:56.117 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:56.112+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:56.202 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:56.197+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:56.264 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:56.258+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:56.300 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:56.293+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:56.380 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:56.372+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:56.574 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:56.567+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:57.013 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:57.008+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:57.109 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:57.104+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:57.250 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:57.243+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:57.262 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:57.255+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:57.267 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:57.261+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:57.428 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:57.417+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:57.544 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:57.537+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:58.020 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:58.013+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:58.079 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:58.074+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:58.230 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:58.224+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:58.294 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:58.287+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:58.300 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:58.295+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:58.458 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:58.452+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:58.525 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:58.519+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:59.021 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:22:59.017+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:22:59.088 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:22:59.083+0000 1694f700 -1 osd.3 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.668953+0000 front 2019-12-09T18:21:40.648019+0000 (oldest deadline 2019-12-09T18:22:23.249258+0000) 2019-12-09T18:22:59.201 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:22:59.195+0000 1694f700 -1 osd.4 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.382610+0000 front 2019-12-09T18:21:39.364700+0000 (oldest deadline 2019-12-09T18:22:25.219321+0000) 2019-12-09T18:22:59.308 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:22:59.302+0000 1694f700 -1 osd.7 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:40.566664+0000 front 2019-12-09T18:21:41.216259+0000 (oldest deadline 2019-12-09T18:22:22.819924+0000) 2019-12-09T18:22:59.324 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:22:59.319+0000 1694f700 -1 osd.1 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.947256+0000 front 2019-12-09T18:21:38.735766+0000 (oldest deadline 2019-12-09T18:22:22.404569+0000) 2019-12-09T18:22:59.439 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:22:59.432+0000 1694f700 -1 osd.6 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:39.839290+0000 front 2019-12-09T18:21:39.834186+0000 (oldest deadline 2019-12-09T18:22:20.755316+0000) 2019-12-09T18:22:59.521 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:22:59.514+0000 1694f700 -1 osd.5 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:38.995856+0000 front 2019-12-09T18:21:38.998122+0000 (oldest deadline 2019-12-09T18:22:23.569405+0000) 2019-12-09T18:22:59.991 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:22:59.979+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 41sec e245 v245) 2019-12-09T18:23:00.063 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:23:00.055+0000 1694f700 -1 osd.0 245 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:21:41.263983+0000 front 2019-12-09T18:21:35.906122+0000 (oldest deadline 2019-12-09T18:22:20.639782+0000) 2019-12-09T18:23:19.665 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:44:17.691 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:23:19.668 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:44:17.695 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:23:19.677 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:44:17.640 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:23:19.679 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:44:17.706 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:23:19.681 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:44:17.644 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:23:19.687 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:44:17.714 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:23:19.805 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:44:17.831 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:23:19.831 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:44:17.857 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:23:19.855 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:44:17.818 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:23:56.924 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:23:56.920+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:23:57.014 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:23:57.009+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:23:57.038 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:23:57.033+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:23:57.945 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:23:57.941+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:23:57.978 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:23:57.973+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:23:58.010 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:23:58.005+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:23:58.459 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:23:58.452+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:23:58.807 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:23:58.800+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:23:58.920 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:23:58.914+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:23:58.976 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:23:58.971+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:23:58.977 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:23:58.972+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:23:59.356 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:23:59.351+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:23:59.422 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:23:59.418+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:23:59.801 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:23:59.796+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:23:59.876 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:23:59.871+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:23:59.981 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:23:59.975+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:00.010 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:00.005+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:00.354 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:00.349+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:00.405 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:00.401+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:00.467 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:00.462+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:00.765 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:00.760+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:00.836 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:00.831+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:00.941 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:00.937+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:00.990 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:00.984+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:01.335 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:01.330+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:01.415 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:01.406+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:01.432 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:01.426+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:01.750 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:01.745+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:01.835 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:01.830+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:01.984 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:01.979+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:02.005 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:01.999+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:02.344 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:02.340+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:02.400 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:02.396+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:02.405 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:02.394+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:02.789 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:02.784+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:02.833 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:02.828+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:02.950 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:02.946+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:02.983 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:02.978+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:03.386 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:03.381+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:03.400 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:03.393+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:03.420 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:03.415+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:03.759 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:03.754+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:03.864 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:03.860+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:03.977 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:03.972+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:04.023 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:04.019+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:04.367 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:04.362+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:04.405 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:04.401+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:04.454 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:04.448+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:04.768 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:04.763+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:04.861 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:04.856+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:04.944 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:04.939+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:05.020 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:05.016+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:05.338 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:05.333+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:05.372 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:05.367+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:05.468 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:05.463+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:05.777 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:05.772+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:05.847 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:05.841+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:05.985 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:05.980+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:06.014 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:06.009+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:06.336 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:06.331+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:06.411 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:06.406+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:06.452 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:06.445+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:06.740 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:06.734+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:06.897 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:06.891+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:06.955 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:06.950+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:06.968 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:06.963+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:07.361 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:07.356+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:07.435 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:07.430+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:07.486 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:07.483+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:07.494 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:07.487+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:07.716 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:07.710+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:07.872 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:07.866+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:07.989 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:07.984+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:08.008 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:08.003+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:08.377 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:08.371+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:08.427 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:08.422+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:08.486 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:08.478+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:08.489 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:08.482+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:08.687 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:08.681+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:08.834 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:08.829+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:08.993 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:08.988+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:09.016 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:09.011+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:09.398 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:09.393+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:09.466 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:09.461+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:09.467 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:09.460+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:09.469 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:09.464+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:09.725 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:09.719+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:09.865 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:09.860+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:10.036 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:10.030+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:10.055 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:10.049+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:10.407 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:10.401+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:10.471 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:10.465+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:10.505 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:10.494+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:10.508 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:10.501+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:10.755 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:10.749+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:10.835 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:10.829+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:11.017 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:11.011+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:11.090 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:11.085+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:11.444 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:11.438+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:11.470 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:11.464+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:11.505 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:11.501+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:11.510 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:11.506+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:11.724 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:11.713+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:11.837 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:11.833+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:12.026 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:12.019+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:12.045 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:12.040+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:12.501 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:12.489+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:12.501 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:12.494+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:12.502 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:12.491+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:12.502 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:12.494+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:12.704 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:12.694+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:12.832 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:12.812+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:13.006 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:13.000+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:13.034 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:13.028+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:13.467 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:13.462+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:13.494 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:13.489+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:13.496 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:13.491+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:13.537 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:13.531+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:13.708 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:13.702+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:13.772 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:13.767+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:13.989 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:13.984+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:13.994 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:13.988+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:14.498 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:14.493+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:14.511 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:14.505+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:14.512 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:14.503+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:14.515 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:14.508+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:14.699 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:14.694+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:14.774 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:14.769+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:15.033 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:15.026+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:15.050 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:15.045+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:15.505 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:15.498+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:15.507 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:15.501+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:15.516 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:15.510+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:15.526 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:15.520+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:15.727 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:15.723+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:15.809 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:15.805+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:16.021 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:16.015+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:16.033 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:16.027+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:16.485 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:16.479+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:16.492 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:16.486+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:16.493 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:16.489+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:16.559 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:16.554+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:16.758 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:16.753+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:16.775 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:16.769+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:17.053 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:17.048+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:17.063 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:17.057+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:17.463 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:17.456+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:17.465 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:17.459+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:17.535 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:17.530+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:17.609 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:17.603+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:17.721 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:17.716+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:17.752 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:17.747+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:18.079 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:18.072+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:18.093 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:18.088+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:18.484 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:18.477+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:18.486 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:18.481+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:18.560 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:18.555+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:18.613 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:18.603+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:18.698 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:18.694+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:18.739 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:18.734+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:19.049 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:19.045+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:19.073 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:19.067+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:19.443 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:19.436+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:19.445 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:19.439+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:19.518 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:19.512+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:19.610 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:19.603+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:19.713 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:19.709+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:19.769 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:19.764+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:20.030 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:20.023+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:20.076 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:20.071+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:20.463 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:20.454+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:20.466 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:20.459+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:20.492 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:20.486+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:20.660 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:20.653+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:20.737 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:20.732+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:20.794 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:20.790+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:21.016 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:21.009+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:21.054 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:21.049+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:21.445 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:21.439+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:21.448 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:21.441+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:21.458 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:21.453+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:21.680 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:21.673+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:21.708 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:21.704+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:21.803 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:21.798+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:22.039 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:22.033+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:22.070 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:22.066+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:22.440 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:22.432+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:22.443 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:22.436+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:22.495 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:22.489+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:22.645 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:22.639+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:22.756 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:22.750+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:22.807 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:22.802+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:23.009 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:23.003+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:23.071 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:23.065+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:23.427 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:23.421+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:23.428 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:23.423+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:23.498 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:23.493+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:23.610 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:23.605+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:23.804 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:23.799+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:23.851 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:23.845+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:24.002 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:23.995+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:24.033 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:24.028+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:24.418 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:24.411+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:24.421 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:24.414+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:24.500 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:24.494+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:24.625 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:24.619+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:24.820 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:24.812+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:24.822 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:24.817+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:25.000 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:24.995+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:25.019 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:25.014+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:25.381 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:25.372+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:25.384 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:25.377+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:25.518 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:25.512+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:25.610 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:25.604+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:25.819 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:25.814+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:25.832 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:25.827+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:26.011 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:26.004+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:26.029 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:26.024+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:26.345 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:26.341+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:26.354 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:26.348+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:26.570 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:26.564+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:26.588 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:26.583+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:26.819 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:26.815+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:26.841 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:26.837+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:27.023 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:27.017+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:27.062 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:27.057+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:27.366 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:27.357+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:27.369 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:27.362+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:27.558 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:27.552+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:27.598 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:27.592+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:27.853 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:27.847+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:27.858 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:27.854+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:27.999 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:27.993+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:28.104 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:28.099+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:28.381 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:28.376+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:28.389 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:28.382+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:28.588 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:28.581+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:28.623 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:28.616+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:28.813 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:28.807+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:28.859 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:28.852+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:28.973 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:28.967+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:29.093 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:29.089+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:29.384 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:29.377+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:29.387 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:29.381+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:29.551 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:29.545+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:29.625 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:29.620+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:29.821 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:29.817+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:29.836 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:29.831+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:29.953 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:29.947+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:30.142 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:30.137+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:30.370 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:24:30.365+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e250 v250) 2019-12-09T18:24:30.375 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:30.365+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:30.377 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:30.370+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:30.545 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:30.540+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:30.672 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:30.667+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:30.797 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:30.793+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:30.859 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:30.854+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:30.947 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:30.942+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:31.191 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:31.187+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:31.342 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:31.337+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:31.349 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:31.342+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:31.590 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:31.585+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:31.658 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:31.652+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:31.756 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:31.751+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:31.830 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:31.825+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:31.917 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:31.912+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:32.186 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:32.180+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:32.383 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:32.376+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:32.384 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:32.380+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:32.560 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:32.554+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:32.705 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:32.701+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:32.774 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:32.769+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:32.820 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:32.815+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:32.895 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:32.889+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:33.207 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:33.202+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:33.339 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:33.334+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:33.348 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:33.341+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:33.578 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:33.572+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:33.675 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:33.670+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:33.746 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:33.741+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:33.813 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:33.807+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:33.916 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:33.912+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:34.176 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:34.171+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:34.314 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:34.304+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:34.324 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:34.308+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:34.568 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:34.563+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:34.640 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:34.634+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:34.796 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:34.792+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:34.857 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:34.852+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:34.941 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:34.936+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:35.134 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:35.130+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:35.346 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:35.340+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:35.348 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:35.343+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:35.420 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:24:35.415+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e250 v250) 2019-12-09T18:24:35.590 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:35.585+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:35.619 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:35.613+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:35.770 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:35.766+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:35.833 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:35.828+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:35.915 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:35.910+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:36.160 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:36.155+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:36.342 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:36.333+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:36.345 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:36.338+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:36.605 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:36.598+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:36.640 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:36.634+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:36.728 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:36.723+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:36.845 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:36.840+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:36.923 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:36.913+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:37.150 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:37.146+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:37.372 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:37.368+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:37.381 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:37.375+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:37.626 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:37.621+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:37.680 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:37.675+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:37.746 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:37.741+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:37.860 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:37.854+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:37.900 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:37.895+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:38.186 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:38.180+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:38.432 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:38.427+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:38.440 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:38.434+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:38.618 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:38.612+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:38.705 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:38.700+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:38.754 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:38.749+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:38.838 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:38.833+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:38.919 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:38.914+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:39.147 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:39.143+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:39.481 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:39.476+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:39.488 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:39.482+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:39.631 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:24:39.626+0000 1694f700 -1 osd.6 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.243423+0000 front 2019-12-09T18:23:15.230949+0000 (oldest deadline 2019-12-09T18:23:57.780773+0000) 2019-12-09T18:24:39.680 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:24:39.675+0000 1694f700 -1 osd.7 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.163944+0000 front 2019-12-09T18:23:15.051744+0000 (oldest deadline 2019-12-09T18:23:58.638105+0000) 2019-12-09T18:24:39.778 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:39.773+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:24:39.861 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:24:39.853+0000 1694f700 -1 osd.1 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.476592+0000 front 2019-12-09T18:23:17.481835+0000 (oldest deadline 2019-12-09T18:23:58.040683+0000) 2019-12-09T18:24:39.927 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:24:39.922+0000 1694f700 -1 osd.4 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:13.848068+0000 front 2019-12-09T18:23:17.066911+0000 (oldest deadline 2019-12-09T18:23:56.567871+0000) 2019-12-09T18:24:40.152 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:24:40.147+0000 1694f700 -1 osd.3 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:17.464238+0000 front 2019-12-09T18:23:15.060959+0000 (oldest deadline 2019-12-09T18:23:56.080634+0000) 2019-12-09T18:24:40.499 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:40.492+0000 1694f700 -1 osd.2 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:23:26.963317+0000 (oldest deadline 2019-12-09T18:24:06.963317+0000) 2019-12-09T18:24:40.500 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:24:40.488+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e250 v250) 2019-12-09T18:24:40.502 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:24:40.495+0000 1694f700 -1 osd.2 250 get_health_metrics reporting 33 slow ops, oldest is osd_op(client.4530.0:120040 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e249) 2019-12-09T18:24:40.802 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:24:40.799+0000 1694f700 -1 osd.0 250 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:23:15.127415+0000 front 2019-12-09T18:23:15.128009+0000 (oldest deadline 2019-12-09T18:23:55.902579+0000) 2019-12-09T18:25:11.740 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:25:11.726+0000 1694f700 -1 osd.5 250 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:134535 7.8 7.e008008 (undecoded) ondisk+write+known_if_redirected e250) 2019-12-09T18:26:37.722 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:37.718+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:38.009 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:38.002+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:38.571 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:38.565+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:38.752 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:38.747+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:38.796 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:38.791+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:39.064 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:39.057+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:39.214 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:39.208+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:39.590 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:39.584+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:39.744 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:39.740+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:39.786 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:39.779+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:40.087 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:40.081+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:40.188 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:40.180+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:40.312 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:40.306+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:40.514 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:40.509+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:40.548 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:40.541+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:40.782 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:40.776+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:40.831 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:40.824+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:41.138 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:41.131+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:41.209 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:41.197+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:41.296 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:41.290+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:41.471 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:41.465+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:41.538 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:41.531+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:41.816 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:41.811+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:41.864 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:41.857+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:42.174 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:42.167+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:42.205 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:42.198+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:42.302 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:42.297+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:42.453 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:42.448+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:42.577 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:42.567+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:42.807 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:42.797+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:42.836 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:42.826+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:43.213 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:43.207+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:43.216 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:43.209+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:43.350 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:43.345+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:43.485 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:43.480+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:43.575 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:43.567+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:43.824 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:43.819+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:43.865 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:43.858+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:44.205 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:44.198+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:44.233 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:44.226+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:44.391 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:44.385+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:44.478 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:44.472+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:44.571 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:44.565+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:44.820 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:44.815+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:44.874 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:44.867+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:45.200 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:45.193+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:45.229 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:45.222+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:45.431 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:45.426+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:45.501 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:45.496+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:45.534 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:45.527+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:45.813 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:45.808+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:45.895 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:45.888+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:46.243 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:46.232+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:46.257 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:46.250+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:46.448 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:46.442+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:46.477 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:46.472+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:46.515 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:46.508+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:46.793 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:46.787+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:46.857 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:46.850+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:47.193 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:47.187+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:47.249 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:47.242+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:47.474 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:47.468+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:47.490 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:47.483+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:47.567 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:47.557+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:47.774 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:47.768+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:47.872 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:47.865+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:48.176 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:48.169+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:48.267 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:48.260+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:48.434 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:48.429+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:48.494 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:48.489+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:48.581 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:48.575+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:48.801 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:48.796+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:48.869 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:48.863+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:49.222 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:49.214+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:49.224 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:49.218+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:49.449 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:49.444+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:49.460 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:49.455+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:49.622 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:49.614+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:49.823 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:49.818+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:49.827 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:49.820+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:50.212 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:50.205+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:50.240 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:50.233+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:50.426 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:50.421+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:50.455 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:50.450+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:50.644 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:50.637+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:50.803 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:50.796+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:50.857 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:50.852+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:51.188 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:51.181+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:51.272 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:51.265+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:51.399 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:51.394+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:51.433 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:51.428+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:51.634 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:51.628+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:51.829 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:51.823+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:51.907 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:51.902+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:52.199 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:52.192+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:52.316 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:52.309+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:52.393 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:52.389+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:52.393 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:52.387+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:52.666 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:52.660+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:52.790 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:52.784+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:52.865 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:52.860+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:53.246 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:53.239+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:53.357 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:53.350+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:53.393 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:53.385+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:53.404 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:53.400+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:53.663 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:53.655+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:53.831 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:53.823+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:53.846 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:53.842+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:54.223 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:54.217+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:54.343 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:54.336+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:54.388 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:54.383+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:54.411 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:54.405+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:54.624 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:54.614+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:54.823 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:54.818+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:54.837 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:54.831+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:55.190 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:55.183+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:55.366 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:55.362+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:55.380 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:55.359+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:55.455 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:55.449+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:55.609 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:55.602+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:55.793 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:55.789+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:55.877 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:55.871+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:56.076 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:47:54.102 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:56.123 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:47:54.149 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:56.126 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:47:54.152 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:56.127 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:47:54.154 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:56.140 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:47:54.103 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:56.143 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:47:54.106 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:56.150 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:56.144+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:56.318 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:47:54.337 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:56.326 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:56.321+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:56.329 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:47:54.356 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:56.372 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:56.363+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:56.373 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:47:54.336 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:26:56.455 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:56.451+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:56.640 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:56.633+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:56.831 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:56.826+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:56.855 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:56.849+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:57.117 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:57.108+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:57.381 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:57.376+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:57.391 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:57.385+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:57.505 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:57.500+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:57.689 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:57.683+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:57.836 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:57.832+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:57.848 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:57.841+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:58.080 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:58.073+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:58.338 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:58.333+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:58.417 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:58.410+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:58.548 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:58.543+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:58.738 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:58.732+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:58.832 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:58.828+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:58.852 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:58.846+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:26:59.038 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:26:59.031+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:26:59.318 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:26:59.313+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:26:59.394 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:26:59.388+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:26:59.527 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:26:59.523+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:26:59.762 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:26:59.756+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:26:59.867 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:26:59.863+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:26:59.893 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:26:59.888+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:27:00.062 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:27:00.057+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:27:00.300 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:27:00.295+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:27:00.389 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:27:00.383+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:27:00.513 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:27:00.508+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:27:00.776 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:27:00.771+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:27:00.870 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:27:00.865+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:27:00.880 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:27:00.875+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:27:01.063 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:27:01.056+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:27:01.285 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:27:01.280+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:27:01.403 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:27:01.398+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:27:01.492 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:27:01.487+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:27:01.831 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:27:01.825+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:27:01.849 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:27:01.843+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:27:01.860 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:27:01.852+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:27:02.115 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:27:02.109+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:27:02.311 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:27:02.305+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:27:02.452 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:27:02.446+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:27:02.523 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:27:02.517+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:27:02.800 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:27:02.794+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:27:02.876 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:27:02.870+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:27:02.880 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:27:02.874+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:27:03.114 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:27:03.109+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:27:03.269 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:27:03.264+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:27:03.485 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:27:03.480+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:27:03.488 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:27:03.482+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:27:03.798 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:27:03.786+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:27:03.872 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:27:03.866+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:27:03.930 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:27:03.926+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:27:04.090 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:27:04.083+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:27:04.321 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:27:04.316+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:27:04.450 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:27:04.445+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:27:04.542 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:27:04.535+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:27:04.836 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:27:04.830+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:27:04.877 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:27:04.871+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:27:04.981 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:27:04.975+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:27:05.073 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:27:05.067+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:27:05.319 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:27:05.314+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:27:05.458 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:27:05.452+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:27:05.577 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:27:05.572+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:27:05.889 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:27:05.884+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:27:05.920 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:27:05.914+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:27:05.936 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:27:05.931+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:27:06.100 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:27:06.094+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:27:06.296 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:27:06.291+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:27:06.481 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:27:06.476+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:27:06.611 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:27:06.605+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:27:06.914 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:27:06.909+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:27:06.961 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:27:06.955+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:27:06.962 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:27:06.957+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:27:07.154 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:27:07.148+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:27:07.330 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:27:07.326+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:27:07.452 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:27:07.449+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:27:07.660 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:27:07.655+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:27:07.931 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:27:07.925+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:27:07.953 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:27:07.950+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:27:08.006 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:27:07.999+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:27:08.158 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:27:08.152+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:27:08.298 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:27:08.293+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:27:08.495 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:27:08.490+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:27:08.635 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:27:08.629+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:27:08.893 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:27:08.888+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:27:08.949 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:27:08.944+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:27:09.032 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:27:09.027+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:27:09.136 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:27:09.132+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:27:09.301 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:27:09.297+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:27:09.498 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:27:09.493+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:27:09.624 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:27:09.619+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:27:09.911 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:27:09.908+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:27:09.946 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:27:09.940+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:27:10.076 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:27:10.070+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:27:10.120 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:27:10.114+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:27:10.301 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:27:10.295+0000 1694f700 -1 osd.3 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.133406+0000 front 2019-12-09T18:25:55.270218+0000 (oldest deadline 2019-12-09T18:26:39.422211+0000) 2019-12-09T18:27:10.507 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:27:10.500+0000 1694f700 -1 osd.1 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.098098+0000 front 2019-12-09T18:25:55.048003+0000 (oldest deadline 2019-12-09T18:26:40.295001+0000) 2019-12-09T18:27:10.606 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:27:10.599+0000 1694f700 -1 osd.5 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.554326+0000 front 2019-12-09T18:25:55.482719+0000 (oldest deadline 2019-12-09T18:26:37.218220+0000) 2019-12-09T18:27:10.894 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:27:10.889+0000 1694f700 -1 osd.0 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.410921+0000 front 2019-12-09T18:25:55.476390+0000 (oldest deadline 2019-12-09T18:26:37.617522+0000) 2019-12-09T18:27:10.973 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:27:10.968+0000 1694f700 -1 osd.4 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:54.830965+0000 front 2019-12-09T18:25:54.921945+0000 (oldest deadline 2019-12-09T18:26:38.178664+0000) 2019-12-09T18:27:11.053 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:27:11.047+0000 1694f700 -1 osd.7 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.271006+0000 front 2019-12-09T18:25:55.150004+0000 (oldest deadline 2019-12-09T18:26:38.609309+0000) 2019-12-09T18:27:11.143 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:27:11.138+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 42sec e256 v256) 2019-12-09T18:27:11.147 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:27:11.140+0000 1694f700 -1 osd.6 256 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:25:55.269486+0000 front 2019-12-09T18:25:55.294041+0000 (oldest deadline 2019-12-09T18:26:38.281091+0000) 2019-12-09T18:27:22.346 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:48:20.373 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:27:22.353 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:48:20.380 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:27:22.364 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:48:20.391 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:27:22.367 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:48:20.331 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:27:22.368 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:48:20.394 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:27:22.371 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:48:20.334 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:27:22.404 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:48:20.430 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:27:22.421 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:48:20.447 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:27:22.441 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:48:20.404 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:28:05.514 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:05.509+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:06.507 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:06.502+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:06.563 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:06.558+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:06.728 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:06.720+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:07.518 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:07.509+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:07.581 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:07.576+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:07.731 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:07.725+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:08.487 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:08.483+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:08.563 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:08.558+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:08.565 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:08.561+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:08.774 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:08.767+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:09.452 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:09.446+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:09.552 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:09.547+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:09.584 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:09.580+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:09.754 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:09.748+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:10.489 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:10.481+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:10.523 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:10.519+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:10.577 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:10.571+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:10.736 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:10.729+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:10.739 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:10.733+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:11.471 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:11.467+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:11.548 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:11.543+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:11.597 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:11.593+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:11.751 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:11.744+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:11.788 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:11.782+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:12.283 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:12.277+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:12.440 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:12.435+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:12.552 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:12.547+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:12.578 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:12.574+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:12.750 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:12.743+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:12.771 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:12.765+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:13.276 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:13.270+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:13.412 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:13.407+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:13.545 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:13.537+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:13.597 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:13.581+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:13.776 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:13.771+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:13.816 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:13.810+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:14.301 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:14.296+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:14.401 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:14.397+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:14.525 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:14.520+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:14.575 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:14.570+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:14.770 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:14.764+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:14.782 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:14.777+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:15.261 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:15.256+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:15.386 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:15.381+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:15.510 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:15.505+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:15.561 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:15.555+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:15.736 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:15.732+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:15.763 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:15.759+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:16.297 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:16.291+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:16.402 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:16.397+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:16.540 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:16.536+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:16.559 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:16.555+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:16.747 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:16.743+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:16.768 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:16.764+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:17.292 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:17.288+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:17.438 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:17.433+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:17.565 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:17.558+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:17.575 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:17.569+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:17.769 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:17.764+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:17.813 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:17.808+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:18.335 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:18.329+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:18.463 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:18.455+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:18.564 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:18.560+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:18.600 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:18.596+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:18.620 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:18.617+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:18.822 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:18.817+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:18.828 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:18.824+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:19.378 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:19.372+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:19.478 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:19.474+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:19.570 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:19.565+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:19.595 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:19.590+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:19.617 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:19.612+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:19.787 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:19.782+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:19.797 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:19.793+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:20.414 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:20.409+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:20.472 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:20.469+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:20.566 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:20.557+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:20.566 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:20.563+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:20.582 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:20.578+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:20.804 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:20.799+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:20.845 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:20.840+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:21.429 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:21.426+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:21.452 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:21.447+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:21.553 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:21.549+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:21.596 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:21.592+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:21.602 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:21.598+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:21.812 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:21.807+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:21.839 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:21.834+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:22.437 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:22.431+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:22.482 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:22.478+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:22.528 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:22.524+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:22.565 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:22.562+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:22.652 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:22.647+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:22.766 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:22.761+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:22.890 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:22.885+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:23.471 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:23.465+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:23.490 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:23.486+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:23.501 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:23.489+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:23.539 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:23.535+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:23.657 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:23.653+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:23.797 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:23.790+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:23.887 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:23.882+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:24.463 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:24.459+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:24.507 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:24.501+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:24.529 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:24.525+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:24.544 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:24.539+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:24.708 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:24.705+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:24.784 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:24.778+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:24.901 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:24.896+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:25.477 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:25.471+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:25.479 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:25.474+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:25.512 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:25.507+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:25.512 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:25.505+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:25.540 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:25.535+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:25.688 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:25.684+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:25.745 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:25.741+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:25.919 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:25.914+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:26.504 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:26.500+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:26.509 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:26.504+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:26.519 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:26.514+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:26.533 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:26.529+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:26.562 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:26.556+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:26.734 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:26.728+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:26.754 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:26.748+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:26.975 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:26.967+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:27.497 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:27.492+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:27.547 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:27.541+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:27.560 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:27.552+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:27.563 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:27.556+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:27.603 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:27.598+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:27.765 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:27.759+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:27.773 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:27.769+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:27.952 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:27.948+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:28.516 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:28.511+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:28.534 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:28.526+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:28.538 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:28.534+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:28.562 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:28.557+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:28.628 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:28.623+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:28.731 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:28.727+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:28.752 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:28.746+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:28.937 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:28.933+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:29.553 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:29.548+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:29.578 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:29.573+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:29.580 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:29.575+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:29.600 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:29.596+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:29.634 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:29.629+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:29.742 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:29.736+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:29.774 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:29.769+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:29.959 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:29.955+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:30.568 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:30.563+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:30.572 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:30.567+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:30.598 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:30.593+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:30.611 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:30.603+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:30.614 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:30.607+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:30.788 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:30.781+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:30.791 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:30.787+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:30.962 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:30.956+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:31.559 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:31.555+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:31.596 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:31.591+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:31.602 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:31.596+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:31.632 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:31.626+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:31.637 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:31.629+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:31.798 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:31.793+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:31.824 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:31.818+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:31.931 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:31.924+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:32.536 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:32.531+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:32.574 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:32.570+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:32.618 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:32.613+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:32.636 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:32.628+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:32.639 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:32.632+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:32.774 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:32.769+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:32.836 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:32.830+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:32.958 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:32.952+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:33.526 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:33.521+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:33.530 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:33.525+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:33.603 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:33.596+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:33.630 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:33.624+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:33.633 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:33.627+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:33.805 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:33.800+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:33.857 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:33.851+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:33.923 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:33.918+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:34.514 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:34.509+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:34.558 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:34.552+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:34.566 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:34.560+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:34.665 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:34.658+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:34.667 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:34.661+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:34.809 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:34.804+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:34.824 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:34.818+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:34.957 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:34.951+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:35.550 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:35.545+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:35.563 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:35.556+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:35.585 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:35.579+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:35.686 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:35.681+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:35.687 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:35.683+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:35.822 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:35.811+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:35.831 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:35.824+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:35.937 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:35.931+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:36.547 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:36.541+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:36.599 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:36.594+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:36.614 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:36.609+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:36.703 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:36.699+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:36.708 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:36.703+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:36.812 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:36.806+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:36.813 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:36.807+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:36.959 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:36.953+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:37.535 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:28:37.529+0000 1694f700 -1 osd.7 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.675607+0000 front 2019-12-09T18:27:31.569661+0000 (oldest deadline 2019-12-09T18:28:12.002521+0000) 2019-12-09T18:28:37.597 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:37.593+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:37.650 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:37.645+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:37.758 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:37.753+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:37.770 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:37.764+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:37.792 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:37.785+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:37.814 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:37.810+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:37.965 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:37.959+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:38.589 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:38.583+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:38.615 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:38.610+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:38.777 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:38.772+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:38.779 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:38.772+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:38.781 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:38.777+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:38.803 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:38.799+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:39.010 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:39.003+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:39.561 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:39.557+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:39.657 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:39.652+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:39.775 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:39.770+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:39.799 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:39.793+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:39.831 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:39.822+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:39.834 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:39.827+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:40.047 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:40.041+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:40.571 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:40.565+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:40.669 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:40.664+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:40.761 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:40.755+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:40.816 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:40.811+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:40.886 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:40.878+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:40.890 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:40.883+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:41.068 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:41.063+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:41.424 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:28:41.417+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e261 v261) 2019-12-09T18:28:41.583 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:41.579+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:41.644 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:41.639+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:41.776 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:41.770+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:41.799 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:41.790+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:41.877 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:41.869+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:41.880 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:41.873+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:42.111 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:42.105+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:42.574 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:42.569+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:42.617 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:42.612+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:42.776 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:42.771+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:42.806 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:42.801+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:42.871 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:42.862+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:42.873 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:42.867+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:43.095 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:43.085+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:43.535 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:43.530+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:43.636 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:43.630+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:43.747 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:43.741+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:43.836 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:43.828+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:43.845 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:43.837+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:43.847 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:43.841+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:44.088 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:44.082+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:44.559 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:44.555+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:44.663 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:44.658+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:44.713 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:44.707+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:44.834 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:44.829+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:44.835 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:44.826+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:44.841 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:44.835+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:45.091 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:45.085+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:45.527 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:45.523+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:45.643 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:45.639+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:45.689 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:45.685+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:45.850 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:45.845+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:45.889 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:45.883+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:45.891 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:45.886+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:46.100 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:46.094+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:46.442 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:28:46.437+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e261 v261) 2019-12-09T18:28:46.511 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:46.505+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:46.649 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:46.645+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:46.721 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:46.715+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:46.850 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:46.843+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:46.911 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:46.906+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:46.913 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:46.908+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:47.151 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:47.145+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:47.560 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:47.555+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:47.664 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:47.659+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:47.674 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:47.669+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:47.823 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:47.816+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:47.888 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:47.883+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:47.897 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:47.890+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:48.175 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:48.170+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:48.586 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:48.581+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:48.702 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:48.697+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:48.726 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:48.721+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:48.783 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:48.776+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:48.897 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:48.890+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:48.902 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:48.893+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:49.227 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:49.221+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:49.639 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:49.634+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:49.753 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:49.747+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:49.754 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:49.749+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:49.773 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:49.768+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:49.872 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:49.864+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:49.876 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:49.867+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:50.251 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:50.242+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:50.602 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:50.598+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:50.716 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:50.711+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:50.738 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:50.730+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:50.826 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:50.822+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:50.914 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:50.910+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:50.922 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:50.916+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:51.283 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:51.279+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:51.460 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:28:51.456+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e261 v261) 2019-12-09T18:28:51.564 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:51.560+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:51.688 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:51.683+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:51.767 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:51.762+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:51.824 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:51.819+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:51.930 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:51.922+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:51.933 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:51.926+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:52.307 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:52.302+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:52.537 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:52.532+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:52.711 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:52.706+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:52.732 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:52.727+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:52.805 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:52.800+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:52.959 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:52.954+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:52.962 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:52.956+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:53.310 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:53.306+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:53.588 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:53.583+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:53.679 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:53.675+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:53.734 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:53.728+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:53.796 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:53.792+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:53.960 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:53.956+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:53.964 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:53.959+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:54.311 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:54.306+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:54.598 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:54.593+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:54.637 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:54.632+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:54.748 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:54.744+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:54.782 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:54.778+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:54.963 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:54.958+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:54.964 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:54.959+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:55.358 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:55.352+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:55.572 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:55.567+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:55.673 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:55.668+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:55.728 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:55.722+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:55.835 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:55.830+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:55.986 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:55.981+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:55.993 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:55.987+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:56.413 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:56.407+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:56.472 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:28:56.468+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e261 v261) 2019-12-09T18:28:56.606 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:56.601+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:56.637 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:56.633+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:56.762 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:56.756+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:56.848 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:56.843+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:56.959 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:56.954+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:56.967 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:56.961+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:57.464 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:57.459+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:57.605 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:57.600+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:57.632 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:57.625+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:57.794 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:57.789+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:57.818 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:57.814+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:57.964 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:57.957+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:57.968 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:57.961+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:58.485 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:58.480+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:58.613 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:58.608+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:58.628 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:58.623+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:58.762 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:58.756+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:58.871 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:58.866+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:28:58.984 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:58.975+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:28:58.988 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:28:58.980+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:28:59.517 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:28:59.512+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:28:59.641 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:28:59.636+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:28:59.658 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:28:59.653+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:28:59.788 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:28:59.783+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:28:59.875 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:28:59.870+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:29:00.024 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:29:00.017+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:29:00.026 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:29:00.020+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:29:00.520 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:29:00.515+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:29:00.652 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:29:00.647+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:29:00.692 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:29:00.687+0000 1694f700 -1 osd.1 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.800050+0000 front 2019-12-09T18:27:27.739456+0000 (oldest deadline 2019-12-09T18:28:07.719563+0000) 2019-12-09T18:29:00.793 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:29:00.784+0000 1694f700 -1 osd.4 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:31.564876+0000 front 2019-12-09T18:27:27.768248+0000 (oldest deadline 2019-12-09T18:28:10.246805+0000) 2019-12-09T18:29:00.921 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:29:00.915+0000 1694f700 -1 osd.0 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:23.324307+0000 front 2019-12-09T18:27:27.901566+0000 (oldest deadline 2019-12-09T18:28:04.824938+0000) 2019-12-09T18:29:01.070 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:29:01.061+0000 1694f700 -1 osd.2 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:27:45.188280+0000 (oldest deadline 2019-12-09T18:28:25.188280+0000) 2019-12-09T18:29:01.074 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:29:01.066+0000 1694f700 -1 osd.2 261 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:29:01.513 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:29:01.508+0000 1694f700 -1 osd.6 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:22.343406+0000 front 2019-12-09T18:27:27.916063+0000 (oldest deadline 2019-12-09T18:28:06.446522+0000) 2019-12-09T18:29:01.549 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:29:01.542+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e261 v261) 2019-12-09T18:29:01.612 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:29:01.607+0000 1694f700 -1 osd.3 261 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:27:27.917276+0000 front 2019-12-09T18:27:22.479614+0000 (oldest deadline 2019-12-09T18:28:05.957540+0000) 2019-12-09T18:29:02.177 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:29:02.104+0000 1694f700 -1 osd.2 262 get_health_metrics reporting 32 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e260) 2019-12-09T18:29:25.672 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:29:25.660+0000 37a7b700 -1 osd.5 266 build_incremental_map_msg missing incremental map 266 2019-12-09T18:29:25.734 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:29:25.703+0000 35276700 -1 osd.5 266 build_incremental_map_msg missing incremental map 266 2019-12-09T18:29:25.797 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:29:25.738+0000 34a75700 -1 osd.5 266 build_incremental_map_msg missing incremental map 266 2019-12-09T18:29:26.094 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:29:26.079+0000 3b282700 -1 osd.5 266 build_incremental_map_msg missing incremental map 266 2019-12-09T18:29:26.202 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:29:26.181+0000 35276700 -1 osd.5 266 build_incremental_map_msg missing incremental map 266 2019-12-09T18:29:55.698 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:29:55.444+0000 1694f700 -1 osd.2 266 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7:3a0daaa6:::2019-12-09-18-a55fd90f-db62-40cd-9264-5916c91f1695.4358.631-a47cb22a28624be88843ef6efd1db7d7:head [append 0~516 in=516b] snapc 0=[] RETRY=22 ondisk+retry+write+known_if_redirected e265) 2019-12-09T18:30:46.996 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:30:46.991+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:30:47.152 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:30:47.148+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:30:47.933 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:30:47.927+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:30:48.019 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:30:48.013+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:30:48.155 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:30:48.146+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:30:48.924 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:30:48.918+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:30:48.978 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:30:48.973+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:30:49.148 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:30:49.145+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:30:49.198 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:30:49.194+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:30:49.489 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:30:49.483+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:30:49.941 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:30:49.935+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:30:50.026 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:30:50.020+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:30:50.057 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:30:50.050+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:30:50.181 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:30:50.177+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:30:50.249 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:30:50.244+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:30:50.538 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:30:50.531+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:30:50.767 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:30:50.763+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:30:50.927 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:30:50.922+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:30:51.010 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:30:51.004+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:30:51.069 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:30:51.061+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:30:51.157 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:30:51.152+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:30:51.249 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:30:51.243+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:30:51.504 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:30:51.498+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:30:51.815 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:30:51.809+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:30:51.897 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:30:51.892+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:30:52.047 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:30:52.042+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:30:52.100 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:30:52.094+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:30:52.184 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:30:52.180+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:30:52.277 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:30:52.273+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:30:52.521 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:30:52.508+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:30:52.813 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:30:52.808+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:30:52.884 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:30:52.879+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:30:53.035 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:30:53.029+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:30:53.108 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:30:53.102+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:30:53.199 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:30:53.194+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:30:53.323 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:30:53.319+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:30:53.489 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:30:53.484+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:30:53.770 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:30:53.765+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:30:53.931 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:30:53.925+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:30:54.076 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:30:54.071+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:30:54.161 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:30:54.157+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:30:54.165 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:30:54.157+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:30:54.346 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:30:54.341+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:30:54.510 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:30:54.499+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:30:54.732 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:30:54.726+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:30:54.917 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:30:54.911+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:30:55.053 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:30:55.047+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:30:55.160 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:30:55.154+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:30:55.168 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:30:55.163+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:30:55.340 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:30:55.335+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:30:55.517 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:30:55.509+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:30:55.726 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:30:55.721+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:30:55.876 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:30:55.870+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:30:56.094 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:30:56.088+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:30:56.146 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:30:56.140+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:30:56.176 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:30:56.170+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:30:56.307 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:30:56.302+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:30:56.543 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:30:56.537+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:30:56.741 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:30:56.736+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:30:56.915 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:30:56.910+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:30:57.082 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:30:57.076+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:30:57.150 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:30:57.145+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:30:57.200 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:30:57.194+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:30:57.278 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:30:57.273+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:30:57.592 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:30:57.586+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:30:57.795 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:30:57.790+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:30:57.903 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:30:57.897+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:30:58.117 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:30:58.111+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:30:58.137 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:30:58.132+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:30:58.251 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:30:58.244+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:30:58.257 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:30:58.252+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:30:58.632 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:30:58.626+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:30:58.828 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:30:58.822+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:30:58.898 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:30:58.892+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:30:59.091 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:30:59.082+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:30:59.177 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:30:59.172+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:30:59.252 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:30:59.247+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:30:59.294 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:30:59.288+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:30:59.587 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:30:59.582+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:30:59.785 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:30:59.781+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:30:59.905 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:30:59.898+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:00.060 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:31:00.053+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:31:00.140 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:00.134+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:00.259 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:00.252+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:00.284 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:00.279+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:00.585 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:00.578+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:00.798 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:00.792+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:00.926 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:00.919+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:01.075 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:31:01.068+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:31:01.180 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:01.174+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:01.291 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:01.284+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:01.322 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:01.318+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:01.590 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:01.582+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:01.791 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:01.786+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:01.887 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:01.881+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:02.118 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:31:02.111+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:31:02.190 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:02.186+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:02.309 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:02.302+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:02.376 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:02.371+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:02.596 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:02.589+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:02.845 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:02.839+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:02.870 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:02.864+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:03.148 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:31:03.135+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:31:03.229 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:03.225+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:03.277 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:03.270+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:03.427 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:03.422+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:03.633 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:03.627+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:03.880 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:03.875+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:03.904 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:03.897+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:04.101 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:31:04.094+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:31:04.235 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:04.229+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:04.248 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:04.241+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:04.480 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:04.475+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:04.591 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:04.584+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:04.897 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:04.892+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:04.933 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:04.927+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:05.158 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:31:05.151+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:31:05.213 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:05.207+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:05.222 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:05.217+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:05.519 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:05.514+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:05.573 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:05.566+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:05.911 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:05.907+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:05.962 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:05.955+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:06.176 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:31:06.168+0000 1694f700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:01.730662+0000 front 2019-12-09T18:30:01.696297+0000 (oldest deadline 2019-12-09T18:30:46.208195+0000) 2019-12-09T18:31:06.246 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:06.239+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:06.271 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:06.266+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:06.538 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:06.532+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:06.568 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:06.561+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:06.926 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:06.920+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:06.988 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:06.981+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:07.226 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:07.220+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:07.315 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:07.309+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:07.518 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:07.513+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:07.528 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:07.521+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:07.916 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:07.911+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:07.947 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:07.940+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:08.191 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:08.185+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:08.353 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:08.347+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:08.505 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:08.500+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:08.548 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:08.540+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:08.916 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:08.910+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:08.970 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:08.963+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:09.174 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:09.166+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:09.323 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:09.317+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:09.546 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:09.535+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:09.556 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:09.549+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:09.935 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:09.930+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:09.973 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:09.966+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:10.142 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:10.136+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:10.319 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:10.314+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:10.513 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:10.505+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:10.580 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:10.573+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:10.934 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:10.929+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:10.995 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:10.986+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:11.115 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:11.108+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:11.311 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:11.305+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:11.472 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:11.467+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:11.565 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:11.558+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:11.915 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:11.911+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:12.020 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:12.013+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:12.141 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:12.134+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:12.320 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:12.315+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:12.492 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:12.486+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:12.534 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:12.527+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:12.960 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:12.954+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:13.042 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:13.036+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:13.125 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:13.118+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:13.319 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:13.313+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:13.516 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:13.511+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:13.583 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:13.576+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:13.995 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:13.990+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:14.061 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:14.054+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:14.097 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:14.090+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:14.351 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:14.343+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:14.493 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:14.488+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:14.593 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:14.587+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:15.008 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:15.003+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:15.028 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:15.021+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:15.141 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:15.134+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:15.313 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:15.303+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:15.483 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:15.478+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:15.624 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:15.616+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:15.972 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:15.966+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:16.082 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:16.075+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:16.195 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:16.188+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:16.354 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:16.350+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:16.483 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:16.477+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:16.605 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:16.595+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:16.932 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:16.927+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:17.130 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:17.123+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:17.248 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:17.241+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:17.379 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:17.374+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:17.491 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:17.483+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:17.587 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:17.579+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:17.896 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:17.890+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:18.166 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:18.159+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:18.288 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:18.283+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:18.342 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:18.337+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:18.541 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:18.535+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:18.552 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:18.546+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:18.942 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:18.936+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:19.146 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:19.139+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:19.292 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:19.286+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:19.305 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:19.299+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:19.576 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:19.570+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:19.591 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:19.586+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:19.941 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:19.937+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:20.154 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:20.147+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:20.249 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:20.242+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:20.327 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:20.321+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:20.536 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:20.531+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:20.639 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:20.634+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:20.909 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:20.904+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:21.142 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:31:21.136+0000 1694f700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:05.762676+0000 front 2019-12-09T18:30:04.865159+0000 (oldest deadline 2019-12-09T18:30:47.646583+0000) 2019-12-09T18:31:21.242 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:31:21.236+0000 1694f700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:04.042115+0000 front 2019-12-09T18:30:04.040035+0000 (oldest deadline 2019-12-09T18:30:49.753901+0000) 2019-12-09T18:31:21.344 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:31:21.338+0000 1694f700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.665323+0000 front 2019-12-09T18:30:03.742321+0000 (oldest deadline 2019-12-09T18:30:48.416737+0000) 2019-12-09T18:31:21.560 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:31:21.554+0000 1694f700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.727371+0000 front 2019-12-09T18:30:03.753394+0000 (oldest deadline 2019-12-09T18:30:48.557142+0000) 2019-12-09T18:31:21.645 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:31:21.640+0000 1694f700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:02.911566+0000 front 2019-12-09T18:30:03.454892+0000 (oldest deadline 2019-12-09T18:30:46.791108+0000) 2019-12-09T18:31:21.944 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:31:21.938+0000 1694f700 -1 osd.3 266 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:30:03.978334+0000 front 2019-12-09T18:30:04.606766+0000 (oldest deadline 2019-12-09T18:30:49.858966+0000) 2019-12-09T18:31:22.024 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:31:22.018+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 43sec e266 v266) 2019-12-09T18:31:24.447 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:52:22.473 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:31:24.459 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:52:22.486 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:31:24.473 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:52:22.436 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:31:24.475 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:52:22.502 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:31:24.481 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:52:22.444 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:31:24.487 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:52:22.510 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:31:24.747 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:52:22.774 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:31:24.751 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:52:22.714 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:31:24.783 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:52:22.809 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:32:19.124 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:19.117+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:19.133 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:19.126+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:19.644 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:32:19.638+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:38.265846+0000 front 2019-12-09T18:31:38.294753+0000 (oldest deadline 2019-12-09T18:32:19.110681+0000) 2019-12-09T18:32:19.853 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:19.848+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:20.091 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:20.085+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:20.158 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:20.152+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:20.663 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:32:20.657+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:38.265846+0000 front 2019-12-09T18:31:38.294753+0000 (oldest deadline 2019-12-09T18:32:19.110681+0000) 2019-12-09T18:32:20.833 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:20.828+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:21.095 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:21.088+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:21.186 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:21.180+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:21.478 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:21.473+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:21.711 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:32:21.704+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:38.265846+0000 front 2019-12-09T18:31:38.294753+0000 (oldest deadline 2019-12-09T18:32:19.110681+0000) 2019-12-09T18:32:21.836 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:21.831+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:22.106 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:22.100+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:22.174 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:22.168+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:22.457 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:22.451+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:22.736 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:32:22.729+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:38.265846+0000 front 2019-12-09T18:31:38.294753+0000 (oldest deadline 2019-12-09T18:32:19.110681+0000) 2019-12-09T18:32:22.861 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:22.856+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:23.117 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:23.104+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:23.205 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:23.198+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:23.457 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:23.448+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:23.769 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:32:23.763+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:38.265846+0000 front 2019-12-09T18:31:38.294753+0000 (oldest deadline 2019-12-09T18:32:19.110681+0000) 2019-12-09T18:32:23.818 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:23.813+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:23.943 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:23.939+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:24.161 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:24.156+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:24.171 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:24.166+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:24.185 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:24.180+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:24.455 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:24.450+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:24.815 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:24.810+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:24.826 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:32:24.816+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:38.265846+0000 front 2019-12-09T18:31:38.294753+0000 (oldest deadline 2019-12-09T18:32:19.110681+0000) 2019-12-09T18:32:24.949 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:24.943+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:25.136 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:25.131+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:25.172 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:25.167+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:25.180 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:25.174+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:25.492 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:25.486+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:25.777 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:25.772+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:25.835 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:32:25.830+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:38.265846+0000 front 2019-12-09T18:31:38.294753+0000 (oldest deadline 2019-12-09T18:32:19.110681+0000) 2019-12-09T18:32:25.972 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:25.965+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:26.133 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:26.128+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:26.161 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:26.155+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:26.219 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:26.213+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:26.445 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:26.441+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:26.813 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:26.808+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:26.848 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:32:26.836+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:38.265846+0000 front 2019-12-09T18:31:38.294753+0000 (oldest deadline 2019-12-09T18:32:19.110681+0000) 2019-12-09T18:32:26.950 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:26.945+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:27.088 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:27.084+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:27.182 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:27.177+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:27.192 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:27.186+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:27.458 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:27.453+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:27.840 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:32:27.835+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:38.265846+0000 front 2019-12-09T18:31:38.294753+0000 (oldest deadline 2019-12-09T18:32:19.110681+0000) 2019-12-09T18:32:27.847 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:27.842+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:27.922 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:27.915+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:28.045 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:28.041+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:28.154 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:28.147+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:28.246 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:28.239+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:28.444 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:28.439+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:28.863 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:28.859+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:28.895 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:32:28.888+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:38.265846+0000 front 2019-12-09T18:31:38.294753+0000 (oldest deadline 2019-12-09T18:32:19.110681+0000) 2019-12-09T18:32:28.895 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:28.883+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:29.054 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:29.048+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:29.142 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:29.136+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:29.252 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:29.246+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:29.432 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:29.428+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:29.851 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:29.845+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:29.877 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:29.870+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:29.915 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:32:29.909+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:38.265846+0000 front 2019-12-09T18:31:38.294753+0000 (oldest deadline 2019-12-09T18:32:19.110681+0000) 2019-12-09T18:32:30.013 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:30.008+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:30.154 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:30.147+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:30.238 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:30.232+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:30.449 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:30.445+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:30.827 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:30.822+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:30.861 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:30.855+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:30.893 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:32:30.888+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:38.265846+0000 front 2019-12-09T18:31:38.294753+0000 (oldest deadline 2019-12-09T18:32:19.110681+0000) 2019-12-09T18:32:30.984 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:30.979+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:31.142 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:31.135+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:31.255 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:31.249+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:31.421 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:31.416+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:31.796 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:31.791+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:31.845 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:31.838+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:31.847 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:31.842+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:31.919 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:32:31.914+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:38.265846+0000 front 2019-12-09T18:31:38.294753+0000 (oldest deadline 2019-12-09T18:32:19.110681+0000) 2019-12-09T18:32:31.988 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:31.984+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:32.154 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:32.149+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:32.287 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:32.282+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:32.433 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:32.429+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:32.824 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:32.820+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:32.896 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:32.888+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:32.899 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:32.893+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:32.948 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:32:32.941+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:38.265846+0000 front 2019-12-09T18:31:38.294753+0000 (oldest deadline 2019-12-09T18:32:19.110681+0000) 2019-12-09T18:32:32.997 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:32.993+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:33.195 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:33.188+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:33.295 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:33.288+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:33.455 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:33.450+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:33.834 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:33.829+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:33.941 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:33.932+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:33.945 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:33.940+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:33.983 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:33.979+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:34.156 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:34.149+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:34.282 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:34.276+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:34.482 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:34.476+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:34.822 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:34.816+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:34.941 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:34.936+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:34.948 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:34.940+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:34.950 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:34.944+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:35.140 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:35.134+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:35.270 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:35.264+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:35.524 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:35.519+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:35.807 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:35.801+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:35.968 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:35.963+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:35.976 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:35.972+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:35.981 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:35.975+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:36.136 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:36.132+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:36.311 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:36.306+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:36.554 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:36.549+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:36.801 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:36.796+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:37.000 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:36.990+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:37.000 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:36.994+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:37.004 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:36.997+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:37.177 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:37.172+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:37.360 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:37.356+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:37.556 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:37.553+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:37.793 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:37.789+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:37.984 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:37.980+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:38.015 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:38.009+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:38.016 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:38.012+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:38.178 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:38.173+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:38.371 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:38.365+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:38.543 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:38.537+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:38.826 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:38.821+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:38.970 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:38.965+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:39.045 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:39.041+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:39.051 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:39.046+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:39.211 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:39.206+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:39.415 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:39.410+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:39.551 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:39.537+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:39.834 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:39.829+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:39.976 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:39.971+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:40.080 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:40.072+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:40.083 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:40.076+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:40.191 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:40.186+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:40.443 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:40.439+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:40.555 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:40.550+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:40.871 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:40.866+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:40.938 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:40.934+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:41.129 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:41.124+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:41.137 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:41.131+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:41.162 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:41.157+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:41.477 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:41.472+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:41.598 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:41.593+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:41.830 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:41.825+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:41.901 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:41.896+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:42.099 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:42.095+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:42.105 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:42.099+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:42.200 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:42.196+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:42.486 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:42.481+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:42.615 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:42.610+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:42.821 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:42.816+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:42.939 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:42.935+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:43.137 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:43.133+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:43.141 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:43.136+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:43.244 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:43.239+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:43.467 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:43.462+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:43.659 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:43.654+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:43.782 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:43.778+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:43.973 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:43.969+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:44.172 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:44.165+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:44.174 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:44.169+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:44.295 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:44.290+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:44.440 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:44.435+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:44.646 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:44.641+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:44.763 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:44.758+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:45.002 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:44.997+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:45.177 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:45.169+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:45.179 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:45.173+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:45.348 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:45.343+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:45.469 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:45.458+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:45.623 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:45.618+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:45.747 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:45.742+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:46.014 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:46.009+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:46.179 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:46.175+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:46.182 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:46.178+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:46.338 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:46.334+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:46.494 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:46.489+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:46.613 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:46.609+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:46.720 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:46.715+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:47.040 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:47.034+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:47.164 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:47.155+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:47.165 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:47.160+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:47.346 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:47.340+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:47.454 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:47.449+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:47.610 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:47.605+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:47.688 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:47.683+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:48.018 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:48.014+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:48.166 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:48.161+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:48.173 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:48.169+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:48.387 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:48.382+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:48.451 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:48.445+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:48.600 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:48.595+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:48.737 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:48.733+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:49.071 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:49.066+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:49.174 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:49.170+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:49.180 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:49.173+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:49.425 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:49.419+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:49.429 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:49.423+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:49.640 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:49.634+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:49.702 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:49.698+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:50.080 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:50.075+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:50.165 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:50.160+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:50.170 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:50.165+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:50.407 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:50.402+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:50.452 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:50.447+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:50.673 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:50.668+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:50.708 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:50.701+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:51.047 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:51.042+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:51.190 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:51.186+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:51.196 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:51.190+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:51.422 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:51.417+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:51.440 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:51.435+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:51.675 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:51.670+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:51.748 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:51.743+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:52.067 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:52.063+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:52.195 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:52.186+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:52.198 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:52.191+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:52.353 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:32:52.349+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 46sec e271 v271) 2019-12-09T18:32:52.456 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:52.450+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:52.472 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:52.466+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:52.647 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:52.642+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:52.779 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:52.774+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:53.056 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:53.051+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:53.211 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:53.202+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:53.213 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:53.207+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:53.480 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:53.474+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:53.506 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:53.501+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:53.620 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:53.615+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:53.806 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:53.801+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:54.035 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:54.030+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:54.200 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:54.193+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:54.203 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:54.197+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:54.525 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:54.514+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:54.533 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:54.527+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:54.584 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:54.578+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:54.827 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:54.821+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:55.054 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:55.050+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:55.204 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:55.193+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:55.206 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:55.201+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:55.515 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:55.509+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:55.565 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:55.559+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:55.612 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:55.608+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:55.805 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:55.799+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:56.047 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:56.042+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:56.194 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:56.186+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:56.196 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:56.191+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:56.560 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:56.553+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:56.594 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:56.587+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:56.604 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:56.596+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:56.832 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:56.826+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:57.095 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:57.090+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:57.201 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:57.194+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:57.205 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:57.198+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:57.378 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:32:57.367+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 46sec e271 v271) 2019-12-09T18:32:57.575 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:57.571+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:57.601 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:57.595+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:57.645 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:57.639+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:57.834 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:57.829+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:58.080 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:58.075+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:58.258 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:58.250+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:58.261 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:58.254+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:58.537 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:58.533+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:58.568 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:58.562+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:58.678 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:58.673+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:58.821 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:58.814+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:32:59.047 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:32:59.042+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:32:59.292 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:59.286+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:32:59.293 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:32:59.289+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:32:59.528 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:32:59.522+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:32:59.560 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:32:59.555+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:32:59.696 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:32:59.690+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:32:59.842 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:32:59.838+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:33:00.058 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:33:00.052+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:33:00.347 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:33:00.339+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:33:00.349 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:33:00.343+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:33:00.562 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:33:00.555+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:33:00.623 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:33:00.615+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:33:00.736 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:33:00.729+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:33:00.869 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:33:00.865+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:33:01.082 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:33:01.077+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:33:01.397 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:33:01.390+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:33:01.400 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:33:01.393+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:33:01.521 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:33:01.515+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:33:01.648 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:33:01.643+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:33:01.782 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:33:01.775+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:33:01.842 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:33:01.836+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:33:02.117 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:33:02.112+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:33:02.374 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:33:02.368+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:33:02.375 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:33:02.370+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:33:02.386 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:33:02.380+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 46sec e271 v271) 2019-12-09T18:33:02.482 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:33:02.477+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:33:02.675 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:33:02.671+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:33:02.790 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:33:02.784+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:33:02.843 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:33:02.833+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:33:03.080 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:33:03.075+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:33:03.365 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:33:03.357+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:33:03.370 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:33:03.361+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:33:03.534 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:33:03.528+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:33:03.722 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:33:03.718+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:33:03.762 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:33:03.756+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:33:03.804 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:33:03.796+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:33:04.058 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:33:04.053+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:33:04.365 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:33:04.356+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:33:04.368 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:33:04.361+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:33:04.491 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:33:04.484+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:33:04.744 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:33:04.739+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:33:04.811 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:33:04.805+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:33:04.817 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:33:04.811+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:33:05.071 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:33:05.066+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:33:05.363 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:33:05.355+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:33:05.365 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:33:05.360+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:33:05.451 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:33:05.446+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:33:05.710 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:33:05.703+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:33:05.822 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:33:05.816+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:33:05.843 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:33:05.838+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:33:06.056 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:33:06.050+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:33:06.398 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:33:06.389+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:33:06.401 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:33:06.394+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:33:06.498 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:33:06.491+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:33:06.689 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:33:06.684+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:35.117764+0000 front 2019-12-09T18:31:35.225868+0000 (oldest deadline 2019-12-09T18:32:20.954175+0000) 2019-12-09T18:33:06.835 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:33:06.826+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:42.567053+0000 front 2019-12-09T18:31:38.305922+0000 (oldest deadline 2019-12-09T18:32:18.233619+0000) 2019-12-09T18:33:06.836 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:33:06.832+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.169858+0000 front 2019-12-09T18:31:36.412193+0000 (oldest deadline 2019-12-09T18:32:19.213085+0000) 2019-12-09T18:33:07.020 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:33:07.014+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:43.040470+0000 front 2019-12-09T18:31:43.019043+0000 (oldest deadline 2019-12-09T18:32:23.570674+0000) 2019-12-09T18:33:07.401 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:33:07.393+0000 1694f700 -1 osd.2 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:31:51.367465+0000 (oldest deadline 2019-12-09T18:32:31.367465+0000) 2019-12-09T18:33:07.406 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:33:07.397+0000 1694f700 -1 osd.2 271 get_health_metrics reporting 31 slow ops, oldest is osd_op(client.4530.0:120060 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e270) 2019-12-09T18:33:07.462 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:33:07.455+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 46sec e271 v271) 2019-12-09T18:33:07.519 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:33:07.511+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:31:36.534257+0000 front 2019-12-09T18:31:36.050250+0000 (oldest deadline 2019-12-09T18:32:18.388372+0000) 2019-12-09T18:33:37.097 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:33:37.076+0000 34274700 -1 osd.5 276 build_incremental_map_msg missing incremental map 276 2019-12-09T18:33:39.773 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:33:39.598+0000 3927e700 -1 osd.5 277 build_incremental_map_msg missing incremental map 276 2019-12-09T18:35:00.007 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:35:00.002+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:16.797867+0000 front 2019-12-09T18:34:16.792734+0000 (oldest deadline 2019-12-09T18:34:59.992768+0000) 2019-12-09T18:35:00.206 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:35:00.198+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:14.213387+0000 front 2019-12-09T18:34:14.363279+0000 (oldest deadline 2019-12-09T18:34:59.730958+0000) 2019-12-09T18:35:00.799 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:00.793+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:01.011 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:35:01.006+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:16.797867+0000 front 2019-12-09T18:34:16.792734+0000 (oldest deadline 2019-12-09T18:34:59.992768+0000) 2019-12-09T18:35:01.166 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:35:01.158+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:14.213387+0000 front 2019-12-09T18:34:14.363279+0000 (oldest deadline 2019-12-09T18:34:59.730958+0000) 2019-12-09T18:35:01.803 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:01.797+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:01.921 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:01.913+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:02.155 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:35:02.149+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:14.213387+0000 front 2019-12-09T18:34:14.363279+0000 (oldest deadline 2019-12-09T18:34:59.730958+0000) 2019-12-09T18:35:02.762 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:02.755+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:02.930 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:02.923+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:02.997 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:02.991+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:03.108 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:56:01.135 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:03.131 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:56:01.158 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:03.175 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:56:01.201 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:03.186 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:56:01.212 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:03.225 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:56:01.188 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:03.232 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:56:01.195 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:03.384 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:56:01.410 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:03.431 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:56:01.458 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:03.474 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:56:01.437 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:03.474 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:03.470+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:03.747 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:03.741+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:03.944 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:03.936+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:04.049 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:04.042+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:04.358 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:04.353+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:04.461 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:04.456+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:04.777 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:04.770+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:04.989 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:04.983+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:05.097 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:05.090+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:05.363 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:05.357+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:05.492 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:05.486+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:05.818 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:05.812+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:05.980 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:05.974+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:06.101 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:06.094+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:06.393 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:06.389+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:06.533 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:06.528+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:06.837 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:06.830+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:07.032 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:07.025+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:07.156 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:07.148+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:07.422 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:07.418+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:07.496 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:07.489+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:07.814 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:07.808+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:08.068 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:08.062+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:08.172 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:08.167+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:08.406 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:08.401+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:08.520 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:08.515+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:08.802 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:08.796+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:09.122 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:09.116+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:09.180 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:09.174+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:09.365 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:09.359+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:09.540 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:09.535+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:09.765 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:09.759+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:10.120 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:10.114+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:10.180 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:10.174+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:10.392 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:10.387+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:10.583 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:10.578+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:10.743 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:10.737+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:11.091 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:11.085+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:11.234 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:11.228+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:11.441 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:11.436+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:11.580 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:11.576+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:11.789 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:11.784+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:12.058 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:12.053+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:12.265 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:12.260+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:12.491 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:12.486+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:12.589 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:12.580+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:12.833 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:12.827+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:13.024 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:13.019+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:13.296 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:13.291+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:13.485 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:13.480+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:13.622 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:13.616+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:13.851 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:13.845+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:14.041 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:14.035+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:14.269 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:14.263+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:14.513 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:14.507+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:14.583 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:14.577+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:14.858 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:14.852+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:15.050 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:15.044+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:15.234 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:15.227+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:15.548 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:15.543+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:15.607 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:15.601+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:15.909 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:15.903+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:16.048 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:16.041+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:16.204 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:16.192+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:16.572 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:16.566+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:16.601 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:16.597+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:16.911 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:16.905+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:17.005 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:16.999+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:17.261 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:17.255+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:17.589 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:17.582+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:17.605 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:17.599+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:17.898 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:17.892+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:18.007 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:18.001+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:18.294 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:56:16.320 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:18.297 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:56:16.324 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:18.310 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:18.305+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:18.330 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:56:16.356 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:18.336 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:56:16.362 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:18.344 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:56:16.371 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:18.369 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:56:16.395 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:18.370 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:56:16.333 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:18.376 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:56:16.339 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:18.435 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:56:16.398 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:18.609 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:18.604+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:18.647 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:18.643+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:18.924 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:18.918+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:19.058 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:19.052+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:19.332 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:19.326+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:19.600 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:19.596+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:19.618 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:19.613+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:19.934 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:19.926+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:20.035 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:20.030+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:20.315 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:20.309+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:20.638 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:20.633+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:20.649 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:20.644+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:20.969 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:20.963+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:21.050 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:21.044+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:21.272 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:21.266+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:21.601 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:21.595+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:21.616 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:21.610+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:22.007 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:22.000+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:22.105 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:22.098+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:22.265 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:22.258+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:22.609 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:22.604+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:22.646 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:22.641+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:23.022 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:23.015+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:23.067 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:23.060+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:23.314 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:23.305+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:23.577 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:23.572+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:23.663 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:23.659+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:23.978 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:23.972+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:24.043 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:24.037+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:24.339 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:24.330+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:24.624 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:24.619+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:24.648 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:24.643+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:24.992 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:24.984+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:25.001 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:24.994+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:25.322 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:25.315+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:25.610 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:25.605+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:25.669 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:25.665+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:25.985 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:25.978+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:26.032 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:26.025+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:26.340 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:26.334+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:26.564 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:26.559+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:26.716 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:26.712+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:26.995 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:26.984+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:27.020 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:27.013+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:27.356 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:27.349+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:27.606 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:27.601+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:27.733 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:27.729+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:28.049 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:28.038+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:28.071 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:28.064+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:28.149 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:56:26.176 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:28.155 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:56:26.182 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:28.168 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:56:26.194 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:28.171 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:56:26.198 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:28.177 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:56:26.140 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:28.184 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:56:26.147 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:28.189 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:08:56:26.216 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:28.196 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:08:56:26.221 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:28.227 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:08:56:26.190 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:35:28.386 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:28.380+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:28.577 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:28.573+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:28.719 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:28.714+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:29.035 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:29.029+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:29.113 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:29.106+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:29.441 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:29.434+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:29.555 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:29.550+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:29.751 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:29.746+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:30.025 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:30.016+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:30.117 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:30.111+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:30.405 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:30.398+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:30.585 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:30.580+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:30.752 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:30.747+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:31.016 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:31.010+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:31.106 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:31.099+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:31.405 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:31.397+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:31.618 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:31.613+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:31.721 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:31.716+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:31.974 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:31.967+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:32.102 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:32.095+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:32.430 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:32.423+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:32.652 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:32.647+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:32.752 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:32.747+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:35:32.999 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:35:32.991+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:15.474597+0000 front 2019-12-09T18:34:15.345133+0000 (oldest deadline 2019-12-09T18:35:01.124065+0000) 2019-12-09T18:35:33.069 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:35:33.063+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.359633+0000 front 2019-12-09T18:34:17.347918+0000 (oldest deadline 2019-12-09T18:35:00.226475+0000) 2019-12-09T18:35:33.415 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:35:33.408+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178620+0000 front 2019-12-09T18:34:17.169505+0000 (oldest deadline 2019-12-09T18:35:02.165442+0000) 2019-12-09T18:35:33.637 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:35:33.631+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.949855+0000 front 2019-12-09T18:34:17.967402+0000 (oldest deadline 2019-12-09T18:35:03.739577+0000) 2019-12-09T18:35:33.717 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:35:33.694+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 45sec e277 v277) 2019-12-09T18:35:33.740 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:35:33.733+0000 1694f700 -1 osd.1 277 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:34:17.178911+0000 front 2019-12-09T18:34:17.432332+0000 (oldest deadline 2019-12-09T18:35:03.054838+0000) 2019-12-09T18:36:31.411 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:31.406+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:31.695 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:31.690+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:32.437 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:32.433+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:32.653 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:32.649+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:33.125 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:33.120+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:33.488 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:33.482+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:33.648 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:33.643+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:34.146 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:34.142+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:34.511 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:34.506+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:34.652 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:34.647+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:34.664 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:34.659+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:35.119 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:35.113+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:35.170 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:35.165+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:35.523 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:35.518+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:35.665 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:35.661+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:35.692 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:35.687+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:36.085 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:36.080+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:36.158 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:36.152+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:36.508 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:36.503+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:36.640 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:36.632+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:36.695 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:36.691+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:37.033 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:37.029+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:37.119 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:37.113+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:37.152 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:37.148+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:37.478 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:37.472+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:37.621 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:37.614+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:37.667 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:37.662+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:38.070 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:38.065+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:38.104 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:38.098+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:38.210 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:38.203+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:38.494 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:38.487+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:38.627 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:38.622+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:38.652 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:38.646+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:39.092 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:39.088+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:39.095 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:39.090+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:39.213 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:39.207+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:39.424 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:39.418+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:39.480 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:39.474+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:39.643 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:39.638+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:39.650 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:39.644+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:40.069 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:40.065+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:40.070 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:40.063+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:40.193 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:40.190+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:40.396 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:40.390+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:40.523 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:40.514+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:40.656 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:40.650+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:40.665 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:40.660+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:41.065 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:41.060+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:41.088 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:41.083+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:41.193 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:41.189+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:41.406 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:41.400+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:41.535 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:41.529+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:41.666 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:41.660+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:41.718 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:41.711+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:42.095 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:42.091+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:42.101 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:42.094+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:42.221 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:42.217+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:42.373 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:42.368+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:42.540 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:42.534+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:42.647 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:42.641+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:42.699 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:42.695+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:43.110 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:43.101+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:43.112 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:43.108+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:43.274 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:43.268+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:43.330 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:43.323+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:43.524 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:43.517+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:43.682 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:43.677+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:43.726 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:43.720+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:44.092 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:44.081+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:44.113 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:44.106+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:44.303 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:44.297+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:44.324 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:44.320+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:44.520 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:44.513+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:44.710 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:44.705+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:44.716 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:44.710+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:45.086 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:45.080+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:45.109 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:45.105+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:45.277 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:45.269+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:36:45.280 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:45.273+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:45.353 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:45.347+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:45.540 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:45.533+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:45.672 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:45.667+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:45.678 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:45.673+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:46.068 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:46.064+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:46.097 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:46.091+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:46.303 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:46.294+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:36:46.307 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:46.300+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:46.367 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:46.361+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:46.566 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:46.560+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:46.631 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:46.628+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:46.689 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:46.683+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:47.107 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:47.100+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:47.119 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:47.116+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:47.266 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:47.262+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:36:47.269 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:47.263+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:47.391 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:47.387+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:47.534 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:47.528+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:47.618 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:47.614+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:47.704 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:47.697+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:48.099 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:48.093+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:48.159 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:48.154+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:48.228 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:48.221+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:36:48.230 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:48.225+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:48.368 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:48.365+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:48.557 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:48.551+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:48.649 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:48.645+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:48.725 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:48.718+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:49.108 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:49.103+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:49.203 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:49.199+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:49.204 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:49.199+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:36:49.207 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:49.202+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:49.413 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:49.410+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:49.537 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:49.531+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:49.702 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:49.698+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:49.763 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:49.757+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:50.073 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:50.067+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:50.209 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:50.200+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:36:50.209 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:50.205+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:50.212 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:50.206+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:50.454 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:50.450+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:50.520 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:50.513+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:50.715 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:50.710+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:50.748 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:50.742+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:51.122 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:51.115+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:51.192 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:51.187+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:51.203 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:51.196+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:36:51.206 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:51.201+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:51.421 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:51.417+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:51.551 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:51.545+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:51.700 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:51.696+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:51.793 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:51.787+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:52.141 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:52.135+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:52.189 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:52.185+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:36:52.191 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:52.187+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:52.195 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:52.189+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:52.417 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:52.413+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:52.603 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:52.596+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:52.681 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:52.677+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:52.839 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:52.833+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:53.145 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:53.140+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:53.213 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:53.209+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:53.227 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:53.221+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:36:53.229 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:53.225+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:53.397 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:53.393+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:53.588 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:53.581+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:53.683 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:53.679+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:53.881 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:53.876+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:54.149 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:54.141+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:54.165 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:54.162+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:54.235 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:54.227+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:36:54.236 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:54.232+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:54.406 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:54.401+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:54.595 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:54.589+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:54.663 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:54.658+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:54.932 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:54.926+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:55.126 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:55.121+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:55.144 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:55.138+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:55.215 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:55.207+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:36:55.218 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:55.212+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:55.430 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:55.425+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:55.632 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:55.626+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:55.644 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:55.640+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:55.919 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:55.912+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:56.143 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:56.138+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:56.195 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:56.188+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:56.255 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:56.251+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:36:56.260 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:56.256+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:56.470 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:56.465+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:56.593 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:56.586+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:56.677 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:56.670+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:56.952 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:56.946+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:57.138 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:57.133+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:57.173 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:57.168+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:57.310 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:57.299+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:36:57.312 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:57.304+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:57.425 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:57.421+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:57.644 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:57.639+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:57.720 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:57.712+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:57.919 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:57.913+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:58.145 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:58.140+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:58.146 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:58.142+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:58.304 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:58.295+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:36:58.307 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:58.300+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:58.414 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:58.404+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:58.611 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:58.606+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:58.727 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:58.721+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:58.959 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:58.953+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:36:59.168 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:36:59.164+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:36:59.183 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:36:59.162+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:36:59.272 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:59.265+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:36:59.275 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:36:59.268+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:36:59.405 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:36:59.400+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:36:59.624 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:36:59.618+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:36:59.727 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:36:59.722+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:36:59.957 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:36:59.952+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:00.151 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:00.147+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:00.161 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:00.157+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:00.226 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:00.222+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:00.233 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:00.226+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:00.449 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:00.443+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:00.590 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:00.584+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:00.750 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:00.746+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:00.949 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:00.944+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:01.120 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:01.115+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:01.182 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:01.177+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:01.201 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:01.195+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:01.204 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:01.197+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:01.416 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:01.411+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:01.642 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:01.636+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:01.769 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:01.764+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:01.947 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:01.942+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:02.169 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:02.164+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:02.174 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:02.163+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:02.194 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:02.187+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:02.196 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:02.191+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:02.439 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:02.434+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:02.630 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:02.625+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:02.775 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:02.769+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:02.925 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:02.920+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:03.129 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:03.123+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:03.191 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:03.186+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:03.210 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:03.202+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:03.213 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:03.206+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:03.422 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:03.416+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:03.639 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:03.634+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:03.738 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:03.733+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:03.977 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:03.972+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:04.088 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:04.078+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:04.088 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:37:04.075+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 46sec e282 v282) 2019-12-09T18:37:04.160 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:04.149+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:04.176 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:04.169+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:04.177 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:04.173+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:04.468 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:04.462+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:04.661 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:04.656+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:04.787 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:04.782+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:04.934 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:04.928+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:05.100 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:05.095+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:05.119 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:05.115+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:05.183 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:05.172+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:05.183 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:05.176+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:05.464 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:05.459+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:05.640 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:05.635+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:05.792 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:05.786+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:05.935 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:05.930+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:06.094 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:06.089+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:06.146 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:06.140+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:06.151 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:06.146+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:06.160 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:06.153+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:06.511 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:06.506+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:06.660 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:06.654+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:06.788 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:06.783+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:06.902 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:06.896+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:07.096 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:07.091+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:07.154 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:07.149+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:07.198 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:07.189+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:07.201 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:07.194+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:07.520 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:07.516+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:07.692 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:07.686+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:07.777 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:07.772+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:07.859 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:07.854+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:08.075 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:08.070+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:08.177 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:08.172+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:08.235 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:08.228+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:08.237 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:08.232+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:08.529 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:08.523+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:08.740 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:08.734+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:08.798 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:08.793+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:08.841 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:08.836+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:09.100 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:37:09.095+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 46sec e282 v282) 2019-12-09T18:37:09.128 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:09.123+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:09.159 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:09.153+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:09.202 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:09.196+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:09.204 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:09.199+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:09.513 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:09.507+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:09.779 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:09.774+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:09.839 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:09.834+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:09.888 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:09.882+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:10.087 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:10.082+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:10.196 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:10.190+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:10.244 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:10.237+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:10.246 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:10.241+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:10.490 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:10.484+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:10.744 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:10.739+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:10.884 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:10.878+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:10.941 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:10.936+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:11.092 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:11.087+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:11.227 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:11.223+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:11.235 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:11.227+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:11.236 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:11.229+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:11.541 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:11.537+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:11.743 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:11.737+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:11.883 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:11.878+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:11.900 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:11.896+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:12.132 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:12.127+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:12.230 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:12.224+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:12.231 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:12.226+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:12.259 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:12.254+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:12.526 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:12.520+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:12.779 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:12.774+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:12.882 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:12.877+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:12.941 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:12.937+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:13.110 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:13.106+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:13.278 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:13.273+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:13.279 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:13.275+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:13.296 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:13.291+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:13.522 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:13.516+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:13.771 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:13.766+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:13.909 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:13.904+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:13.926 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:13.921+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:14.115 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:37:14.109+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 46sec e282 v282) 2019-12-09T18:37:14.149 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:14.145+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:14.238 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:14.232+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:14.243 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:14.235+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:14.285 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:14.280+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:14.571 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:14.566+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:14.806 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:14.799+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:14.921 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:14.915+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:14.952 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:14.947+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:15.116 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:15.111+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:15.273 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:15.267+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:15.275 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:15.270+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:15.329 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:15.322+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:15.591 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:15.586+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:15.794 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:15.788+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:15.967 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:15.962+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:15.991 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:15.986+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:16.083 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:16.078+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:16.248 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:16.240+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:16.251 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:16.244+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:16.381 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:16.375+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:16.617 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:16.612+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:16.842 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:16.835+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:16.965 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:16.958+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:16.991 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:16.986+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:17.090 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:17.085+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:17.223 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:17.218+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:17.231 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:17.225+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:17.355 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:17.349+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:17.603 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:17.597+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:17.849 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:17.843+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:17.997 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:17.991+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:18.018 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:18.013+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:18.133 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:18.128+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:18.230 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:18.223+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:18.232 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:18.226+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:37:18.407 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:37:18.401+0000 1694f700 -1 osd.7 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:49.753882+0000 front 2019-12-09T18:35:49.861173+0000 (oldest deadline 2019-12-09T18:36:34.640682+0000) 2019-12-09T18:37:18.643 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:37:18.638+0000 1694f700 -1 osd.3 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:47.531776+0000 front 2019-12-09T18:35:47.531177+0000 (oldest deadline 2019-12-09T18:36:32.714342+0000) 2019-12-09T18:37:18.863 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:37:18.857+0000 1694f700 -1 osd.4 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:46.966405+0000 front 2019-12-09T18:35:46.604213+0000 (oldest deadline 2019-12-09T18:36:30.952547+0000) 2019-12-09T18:37:18.975 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:37:18.969+0000 1694f700 -1 osd.0 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:50.272991+0000 front 2019-12-09T18:35:50.274534+0000 (oldest deadline 2019-12-09T18:36:33.948650+0000) 2019-12-09T18:37:18.977 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:37:18.971+0000 1694f700 -1 osd.6 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.417633+0000 front 2019-12-09T18:35:50.044420+0000 (oldest deadline 2019-12-09T18:36:30.818846+0000) 2019-12-09T18:37:19.104 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:37:19.099+0000 1694f700 -1 osd.1 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:35:51.390724+0000 front 2019-12-09T18:35:51.055209+0000 (oldest deadline 2019-12-09T18:36:36.501261+0000) 2019-12-09T18:37:19.175 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:37:19.167+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 46sec e282 v282) 2019-12-09T18:37:19.190 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:19.186+0000 1694f700 -1 osd.2 282 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:36:05.129400+0000 (oldest deadline 2019-12-09T18:36:45.129400+0000) 2019-12-09T18:37:19.195 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:37:19.191+0000 1694f700 -1 osd.2 282 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e281) 2019-12-09T18:39:10.185 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:10.178+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:10.647 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:10.642+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:11.169 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:11.162+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:11.211 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:11.203+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:11.602 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:11.597+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:11.965 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:11.958+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:12.193 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:12.186+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:12.238 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:12.232+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:12.571 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:12.561+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:12.924 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:12.920+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:12.969 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:12.961+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:13.196 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:13.189+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:13.222 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:13.216+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:13.604 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:13.600+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:13.883 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:13.878+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:13.984 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:13.974+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:14.209 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:14.202+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:14.267 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:14.260+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:14.614 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:14.611+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:14.837 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:14.834+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:14.950 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:14.943+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:15.176 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:15.169+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:15.270 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:15.263+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:15.640 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:15.635+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:15.718 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:15.710+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:15.795 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:15.792+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:15.991 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:15.984+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:16.184 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:16.177+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:16.240 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:16.232+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:16.667 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:16.663+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:16.700 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:16.693+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:16.770 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:16.767+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:17.029 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:17.022+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:17.181 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:17.173+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:17.213 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:17.206+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:17.708 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:17.704+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:17.747 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:17.740+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:17.793 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:17.787+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:18.054 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:18.047+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:18.173 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:18.167+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:18.182 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:18.174+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:18.673 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:18.669+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:18.707 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:18.699+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:18.757 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:18.754+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:19.008 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:19.001+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:19.207 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:19.200+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:19.226 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:19.219+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:19.696 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:19.687+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:19.700 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:19.689+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:19.762 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:19.757+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:20.047 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:20.040+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:20.245 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:20.239+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:20.263 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:20.256+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:20.687 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:20.682+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:20.734 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:20.727+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:20.792 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:20.786+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:21.017 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:21.011+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:21.211 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:21.205+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:21.241 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:21.233+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:21.671 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:21.666+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:21.724 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:21.717+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:21.811 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:21.806+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:22.030 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:22.023+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:22.232 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:22.225+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:22.238 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:22.230+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:22.692 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:22.687+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:22.745 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:22.736+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:22.832 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:22.826+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:23.076 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:23.069+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:23.237 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:23.230+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:23.237 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:23.230+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:23.659 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:23.654+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:23.779 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:23.772+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:23.791 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:23.786+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:24.040 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:24.033+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:24.240 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:24.234+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:24.244 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:24.238+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:24.681 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:24.677+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:24.745 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:24.738+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:24.746 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:24.741+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:25.006 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:25.000+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:25.206 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:25.199+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:25.280 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:25.274+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:25.701 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:25.693+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:25.709 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:25.704+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:25.715 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:25.710+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:25.997 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:25.989+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:26.185 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:26.178+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:26.295 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:26.286+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:26.676 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:26.669+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:26.680 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:26.676+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:26.723 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:26.717+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:26.962 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:26.956+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:27.165 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:27.158+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:27.291 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:27.284+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:27.647 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:27.640+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:27.652 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:27.645+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:27.719 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:27.714+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:28.012 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:28.006+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:28.125 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:28.119+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:28.288 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:28.282+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:28.682 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:28.676+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:28.691 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:28.686+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:28.718 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:28.713+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:28.984 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:00:27.011 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:39:28.992 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:00:27.019 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:39:29.005 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:00:27.032 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:39:29.012 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:00:27.039 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:39:29.013 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:00:26.976 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:39:29.022 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:29.017+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:29.043 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:00:27.006 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:39:29.111 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:29.102+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:29.240 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:00:27.267 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:39:29.258 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:29.247+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:29.320 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:00:27.346 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:39:29.342 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:00:27.305 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:39:29.645 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:29.641+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:29.657 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:29.653+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:29.759 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:29.755+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:29.995 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:29.990+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:30.146 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:30.140+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:30.256 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:30.250+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:30.641 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:30.636+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:30.652 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:30.645+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:30.733 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:30.728+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:30.952 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:30.946+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:31.146 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:31.138+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:31.297 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:31.291+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:31.626 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:31.620+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:31.637 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:31.631+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:31.749 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:31.745+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:31.934 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:31.927+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:32.125 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:32.117+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:32.270 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:32.264+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:32.593 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:32.588+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:32.623 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:32.617+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:32.749 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:32.744+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:32.933 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:32.926+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:33.085 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:33.079+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:33.245 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:33.238+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:33.635 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:33.631+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:33.660 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:33.654+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:33.806 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:33.801+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:33.900 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:33.894+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:34.086 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:34.080+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:34.238 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:34.232+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:34.661 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:34.655+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:34.662 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:34.656+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:34.812 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:34.806+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:34.897 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:34.891+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:35.064 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:35.058+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:35.210 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:35.203+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:35.662 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:35.656+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:35.715 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:35.707+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:35.862 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:35.856+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:35.921 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:35.916+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:36.070 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:36.064+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:36.218 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:36.211+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:36.667 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:36.661+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:36.753 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:36.747+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:36.875 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:36.870+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:36.931 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:36.925+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:37.072 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:37.066+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:37.267 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:37.262+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:37.670 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:37.665+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:37.766 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:37.761+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:37.854 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:37.849+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:37.913 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:37.908+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:38.111 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:38.105+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:38.245 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:38.239+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:38.628 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:38.623+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:38.731 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:38.725+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:38.871 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:38.866+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:38.958 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:38.952+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:39.079 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:39.073+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:39.279 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:39.272+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:39.632 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:39.627+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:39.720 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:39.714+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:39.913 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:39.908+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:40.005 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:39.994+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:40.045 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:40.039+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:40.243 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:40.238+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:40.636 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:40.630+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:40.731 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:40.725+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:40.935 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:40.930+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:41.044 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:41.038+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:41.093 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:41.087+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:41.220 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:41.215+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:41.597 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:41.591+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:41.693 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:41.686+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:41.947 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:41.941+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:42.057 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:42.051+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:42.092 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:42.086+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:42.240 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:42.235+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:42.569 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:42.565+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:42.653 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:42.646+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:42.957 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:42.952+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:43.056 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:43.050+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:43.099 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:43.093+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:43.251 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:43.245+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:43.541 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:43.536+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:43.669 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:43.663+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:44.000 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:43.996+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:44.091 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:44.086+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:44.132 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:44.128+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:44.281 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:44.277+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:44.507 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:44.502+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:44.664 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:39:44.658+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 43sec e287 v287) 2019-12-09T18:39:44.716 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:44.711+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:45.002 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:44.997+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:45.130 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:45.124+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:45.158 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:45.152+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:45.252 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:45.245+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:45.497 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:45.491+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:45.688 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:45.680+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:46.035 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:46.029+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:46.127 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:46.120+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:46.174 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:46.167+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:46.279 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:46.273+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:46.489 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:46.484+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:46.679 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:46.672+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:47.050 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:47.044+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:47.113 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:47.106+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:47.150 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:47.143+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:47.329 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:47.322+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:47.523 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:47.518+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:47.640 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:47.633+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:48.009 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:48.004+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:48.116 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:48.108+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:48.153 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:48.145+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:48.335 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:39:48.330+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.750656+0000 front 2019-12-09T18:38:27.309780+0000 (oldest deadline 2019-12-09T18:39:47.577432+0000) 2019-12-09T18:39:48.337 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:48.331+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:48.485 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:48.480+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:48.653 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:48.646+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:48.978 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:39:48.974+0000 1694f700 -1 osd.3 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:28.919988+0000 front 2019-12-09T18:38:28.901582+0000 (oldest deadline 2019-12-09T18:39:10.513483+0000) 2019-12-09T18:39:49.133 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:39:49.127+0000 1694f700 -1 osd.6 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:26.135463+0000 front 2019-12-09T18:38:26.201527+0000 (oldest deadline 2019-12-09T18:39:11.418055+0000) 2019-12-09T18:39:49.141 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:39:49.135+0000 1694f700 -1 osd.5 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.885345+0000 front 2019-12-09T18:38:27.749433+0000 (oldest deadline 2019-12-09T18:39:10.872012+0000) 2019-12-09T18:39:49.358 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:39:49.353+0000 1694f700 -1 osd.0 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:27.750656+0000 front 2019-12-09T18:38:27.309780+0000 (oldest deadline 2019-12-09T18:39:47.577432+0000) 2019-12-09T18:39:49.385 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:39:49.378+0000 1694f700 -1 osd.7 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.720749+0000 front 2019-12-09T18:38:29.784249+0000 (oldest deadline 2019-12-09T18:39:10.103496+0000) 2019-12-09T18:39:49.523 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:39:49.518+0000 1694f700 -1 osd.1 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.773593+0000 front 2019-12-09T18:38:29.966623+0000 (oldest deadline 2019-12-09T18:39:12.637635+0000) 2019-12-09T18:39:49.624 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:39:49.618+0000 1694f700 -1 osd.4 287 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:38:29.228095+0000 front 2019-12-09T18:38:29.227430+0000 (oldest deadline 2019-12-09T18:39:15.120781+0000) 2019-12-09T18:39:49.719 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:39:49.715+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 43sec e287 v287) 2019-12-09T18:40:20.095 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:40:20.091+0000 34274700 -1 osd.2 292 build_incremental_map_msg missing incremental map 292 2019-12-09T18:40:20.967 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:40:20.963+0000 3827c700 -1 osd.2 292 build_incremental_map_msg missing incremental map 292 2019-12-09T18:40:50.018 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:40:50.014+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:40:51.069 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:40:51.065+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:40:52.100 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:40:52.094+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:40:53.114 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:40:53.108+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:40:54.082 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:40:54.076+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:40:55.099 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:40:55.094+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:40:56.108 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:40:56.101+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:40:57.096 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:40:57.088+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:40:58.138 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:40:58.133+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:40:59.135 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:40:59.130+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:00.186 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:00.180+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:01.228 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:01.222+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:02.213 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:02.207+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:03.191 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:03.185+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:04.204 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:04.198+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:05.200 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:05.193+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:06.220 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:06.216+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:07.259 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:07.254+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:08.243 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:08.236+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:09.277 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:09.270+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:10.276 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:10.272+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:11.268 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:11.262+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:12.280 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:12.274+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:13.283 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:13.277+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:14.262 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:14.256+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:15.259 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:15.253+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:16.313 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:16.307+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:17.361 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:17.355+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:18.330 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:18.325+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:19.371 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:19.365+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:20.330 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:20.324+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:21.299 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:21.294+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:22.323 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:22.315+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:23.329 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:23.322+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:24.373 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:24.368+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:25.393 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:25.389+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:26.446 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:26.440+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:27.450 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:27.443+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:28.494 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:28.488+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:29.492 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:29.486+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:30.542 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:30.536+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:31.534 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:31.529+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:32.079 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:32.073+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:32.292 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:32.287+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:32.483 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:32.476+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:32.584 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:32.579+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:33.123 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:33.118+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:33.278 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:33.272+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:33.505 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:33.500+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:33.548 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:33.543+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:34.150 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:34.145+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:34.301 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:34.296+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:34.480 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:34.474+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:34.513 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:34.500+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:34.549 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:34.543+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:35.135 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:35.131+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:35.339 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:35.334+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:35.475 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:35.470+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:35.479 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:35.474+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:35.604 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:35.597+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:36.094 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:36.088+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:36.338 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:36.332+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:36.469 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:36.464+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:36.487 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:36.483+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:36.650 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:36.643+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:37.069 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:37.064+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:37.338 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:37.333+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:37.489 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:37.483+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:37.539 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:37.534+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:37.687 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:37.684+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:37.691 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:37.687+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:37.971 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:37.967+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:38.085 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:38.080+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:38.372 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:38.366+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:38.502 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:38.497+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:38.506 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:38.502+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:38.739 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:38.734+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:38.740 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:38.736+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:38.962 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:38.957+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:39.055 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:39.048+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:39.407 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:39.401+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:39.457 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:39.451+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:39.506 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:39.502+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:39.718 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:39.711+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:39.720 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:39.715+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:39.968 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:39.965+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:40.022 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:40.016+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:40.395 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:40.389+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:40.496 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:40.490+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:40.522 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:40.517+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:40.705 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:40.698+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:40.707 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:40.702+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:40.987 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:40.983+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:41.030 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:41.024+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:41.350 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:41.345+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:41.517 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:41.513+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:41.523 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:41.517+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:41.755 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:41.748+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:41.758 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:41.752+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:41.960 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:41.957+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:41.994 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:41.988+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:42.391 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:42.385+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:42.494 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:42.488+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:42.495 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:42.491+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:42.800 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:42.796+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:42.809 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:42.803+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:42.977 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:42.971+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:42.982 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:42.978+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:43.410 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:43.403+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:43.522 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:43.516+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:43.540 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:43.533+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:43.850 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:43.844+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:43.851 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:43.846+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:44.010 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:44.005+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:44.018 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:44.014+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:44.410 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:44.404+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:44.562 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:44.556+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:44.593 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:44.582+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:44.863 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:44.856+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:44.865 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:44.860+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:45.007 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:45.001+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:45.037 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:45.031+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:45.406 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:45.398+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:45.557 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:45.552+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:45.586 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:45.579+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:45.857 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:45.851+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:45.860 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:45.854+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:46.023 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:46.018+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:46.036 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:46.031+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:46.381 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:46.375+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:46.565 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:46.556+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:46.602 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:46.597+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:46.867 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:46.860+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:46.870 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:46.863+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:47.015 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:47.009+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:47.047 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:47.042+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:47.422 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:47.416+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:47.520 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:47.515+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:47.637 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:47.632+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:47.852 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:47.846+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:47.853 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:47.848+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:48.018 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:48.012+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:48.023 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:48.018+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:48.398 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:48.392+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:48.553 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:48.548+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:48.629 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:48.623+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:48.903 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:48.896+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:48.909 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:48.900+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:49.040 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:49.034+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:49.050 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:49.044+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:49.417 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:49.411+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:49.582 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:49.577+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:49.627 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:49.620+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:49.858 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:49.855+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:49.861 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:49.857+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:50.025 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:50.020+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:50.046 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:50.040+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:50.465 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:50.459+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:50.564 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:50.559+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:50.600 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:50.594+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:50.859 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:50.854+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:50.867 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:50.861+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:51.001 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:50.997+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:51.038 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:51.032+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:51.460 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:51.453+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:51.543 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:51.538+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:51.556 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:41:51.550+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:41:51.655 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:51.650+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:51.870 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:51.860+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:51.871 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:51.866+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:52.016 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:52.011+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:52.025 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:52.019+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:52.457 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:52.451+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:52.539 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:41:52.534+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:41:52.593 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:52.588+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:52.652 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:52.646+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:52.837 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:52.832+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:52.839 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:52.834+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:52.993 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:52.988+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:53.015 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:53.009+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:53.445 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:53.438+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:53.533 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:41:53.521+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:41:53.608 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:53.602+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:53.665 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:53.659+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:53.831 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:53.827+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:53.838 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:53.832+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:53.983 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:53.978+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:53.997 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:53.991+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:54.448 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:54.443+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:54.581 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:41:54.577+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:41:54.593 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:54.588+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:54.670 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:54.664+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:54.828 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:54.821+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:54.830 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:54.824+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:54.954 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:54.949+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:55.009 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:55.003+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:55.458 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:55.452+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:55.566 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:41:55.559+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:41:55.636 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:55.629+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:55.640 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:55.634+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:55.853 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:55.845+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:55.856 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:55.848+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:55.963 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:55.959+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:56.012 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:56.006+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:56.450 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:56.443+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:56.567 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:41:56.562+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:41:56.636 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:56.630+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:56.653 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:56.648+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:56.899 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:56.892+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:56.903 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:56.895+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:57.018 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:57.012+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:57.061 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:57.055+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:57.500 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:57.493+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:57.546 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:41:57.542+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:41:57.655 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:57.650+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:57.679 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:57.672+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:57.884 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:57.879+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:57.885 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:57.881+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:58.010 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:58.006+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:58.053 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:58.047+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:58.498 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:58.493+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:58.562 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:41:58.557+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:41:58.624 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:58.617+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:58.716 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:58.710+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:58.855 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:58.847+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:58.858 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:58.852+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:58.970 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:58.965+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:41:59.103 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:41:59.097+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:41:59.548 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:41:59.544+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:41:59.552 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:41:59.548+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:41:59.592 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:41:59.587+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:41:59.689 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:41:59.685+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:41:59.888 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:59.883+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:41:59.892 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:41:59.888+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:41:59.994 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:41:59.989+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:42:00.095 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:42:00.090+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:42:00.544 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:42:00.539+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:42:00.558 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:42:00.554+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:42:00.561 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:42:00.555+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:42:00.697 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:42:00.691+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:42:00.866 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:42:00.861+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:42:00.872 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:42:00.867+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:42:00.973 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:42:00.966+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:42:01.057 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:42:01.051+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:42:01.570 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:42:01.566+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:42:01.593 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:42:01.588+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:42:01.595 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:42:01.591+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:42:01.678 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:42:01.673+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:42:01.832 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:42:01.827+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:42:01.840 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:42:01.834+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:42:01.971 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:42:01.966+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:42:02.078 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:42:02.073+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:42:02.557 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:42:02.552+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:42:02.621 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:42:02.614+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:42:02.629 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:42:02.624+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:42:02.692 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:42:02.687+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:42:02.868 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:42:02.863+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:42:02.874 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:42:02.868+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:42:03.022 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:42:03.017+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:42:03.070 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:42:03.065+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:42:03.539 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:42:03.535+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:42:03.581 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:42:03.575+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:40:40.596805+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:42:03.637 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:42:03.631+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:42:03.695 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:42:03.691+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:42:03.835 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:42:03.830+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:42:03.842 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:42:03.836+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:42:04.007 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:42:04.001+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.914057+0000 front 2019-12-09T18:40:54.941674+0000 (oldest deadline 2019-12-09T18:41:37.497200+0000) 2019-12-09T18:42:04.039 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:42:04.034+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:42:04.540 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:42:04.536+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:42:04.603 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:42:04.598+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:48.584270+0000 front 2019-12-09T18:42:03.866516+0000 (oldest deadline 2019-12-09T18:41:31.896565+0000) 2019-12-09T18:42:04.606 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:42:04.601+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:42:04.654 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:42:04.649+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:42:05.021 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:42:05.015+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.144383+0000 front 2019-12-09T18:40:51.888180+0000 (oldest deadline 2019-12-09T18:41:31.863194+0000) 2019-12-09T18:42:05.227 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:42:05.220+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 51sec e293 v293) 2019-12-09T18:42:05.381 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:42:05.117+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:42:05.388 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:42:05.163+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=45 ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:42:05.504 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:42:05.500+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:42:05.620 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:42:05.616+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:42:05.628 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:42:05.623+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:53.296413+0000 front 2019-12-09T18:40:51.607565+0000 (oldest deadline 2019-12-09T18:41:31.640025+0000) 2019-12-09T18:42:06.307 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:42:06.287+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:42:06.368 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:42:06.290+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=45 ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:42:06.515 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:42:06.511+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:42:06.664 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:42:06.660+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:42:07.520 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:42:07.515+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:49.978340+0000 front 2019-12-09T18:40:49.981946+0000 (oldest deadline 2019-12-09T18:41:33.951750+0000) 2019-12-09T18:42:07.546 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:42:07.436+0000 1694f700 -1 osd.2 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:54.908986+0000 front 2019-12-09T18:40:54.890125+0000 (oldest deadline 2019-12-09T18:41:37.050370+0000) 2019-12-09T18:42:07.557 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:42:07.440+0000 1694f700 -1 osd.2 293 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=45 ondisk+retry+read+known_if_redirected e291) 2019-12-09T18:42:07.719 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:42:07.715+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:40:51.504551+0000 front 2019-12-09T18:40:51.506056+0000 (oldest deadline 2019-12-09T18:41:51.317865+0000) 2019-12-09T18:43:00.387 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:00.380+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:01.342 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:01.335+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:01.797 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:01.792+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:01.922 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:01.914+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:02.104 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:02.097+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:02.357 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:02.350+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:02.370 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:02.363+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:02.787 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:02.783+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:02.794 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:02.789+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:02.947 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:02.939+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:03.116 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:03.109+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:03.349 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:03.341+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:03.420 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:03.413+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:03.840 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:03.834+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:03.854 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:03.848+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:03.918 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:03.912+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:04.143 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:04.136+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:04.404 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:04.396+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:04.416 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:04.407+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:04.546 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:04.541+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:04.858 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:04.853+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:04.885 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:04.877+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:04.896 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:04.889+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:05.130 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:05.122+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:05.387 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:05.379+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:05.398 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:05.390+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:05.501 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:05.496+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:05.866 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:05.861+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:05.876 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:05.871+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:05.899 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:05.892+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:06.109 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:06.102+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:06.373 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:06.366+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:06.450 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:06.442+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:06.493 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:06.488+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:06.844 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:06.839+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:06.901 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:06.895+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:06.942 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:06.936+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:07.086 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:07.078+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:07.331 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:07.323+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:07.466 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:07.461+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:07.501 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:07.494+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:07.815 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:07.808+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:07.890 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:07.883+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:07.968 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:07.961+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:08.064 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:08.057+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:08.351 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:08.344+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:08.430 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:08.424+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:08.471 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:08.464+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:08.848 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:08.842+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:08.869 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:08.864+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:08.972 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:08.965+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:09.071 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:09.065+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:09.396 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:09.389+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:09.406 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:09.401+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:09.509 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:09.502+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:09.805 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:09.798+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:09.826 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:09.821+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:09.937 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:09.922+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:10.094 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:10.086+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:10.426 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:10.418+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:10.459 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:10.454+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:10.555 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:10.549+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:10.824 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:10.818+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:10.831 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:10.826+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:10.907 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:10.900+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:11.117 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:11.110+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:11.427 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:11.420+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:11.437 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:11.431+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:11.576 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:11.568+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:11.804 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:11.798+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:11.825 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:11.820+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:11.959 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:11.953+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:12.131 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:12.125+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:12.407 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:12.400+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:12.470 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:12.466+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:12.611 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:12.603+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:12.776 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:12.770+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:12.850 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:12.844+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:12.969 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:12.962+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:13.190 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:13.177+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:13.373 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:13.365+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:13.476 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:13.468+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:13.607 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:13.599+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:13.798 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:13.793+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:13.845 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:13.840+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:13.967 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:13.961+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:14.198 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:14.191+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:14.387 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:14.381+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:14.466 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:14.461+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:14.596 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:14.588+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:14.794 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:14.789+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:14.819 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:14.814+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:14.968 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:14.963+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:15.189 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:15.184+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:15.440 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:15.434+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:15.508 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:15.503+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:15.649 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:15.643+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:15.764 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:15.759+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:15.776 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:15.771+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:15.989 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:15.983+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:16.194 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:16.188+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:16.491 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:16.486+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:16.520 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:16.516+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:16.675 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:16.669+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:16.756 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:16.748+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:16.949 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:16.810+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:17.014 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:17.009+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:17.221 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:17.214+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:17.478 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:17.472+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:17.543 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:17.537+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:17.696 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:17.691+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:17.798 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:17.792+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:17.810 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:17.804+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:18.036 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:18.030+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:18.179 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:18.173+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:18.448 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:18.442+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:18.536 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:18.530+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:18.699 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:18.694+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:18.775 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:18.769+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:18.831 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:18.825+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:18.998 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:18.993+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:19.143 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:19.137+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:19.461 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:19.457+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:19.579 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:19.573+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:19.705 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:19.699+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:19.804 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:19.799+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:19.815 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:19.809+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:19.997 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:19.991+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:20.155 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:20.149+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:20.473 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:20.467+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:20.562 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:20.556+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:20.733 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:20.728+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:20.765 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:20.760+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:20.809 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:20.804+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:21.004 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:20.998+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:21.135 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:21.129+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:21.436 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:21.430+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:21.577 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:21.571+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:21.724 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:21.719+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:21.786 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:21.780+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:21.806 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:21.801+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:22.037 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:22.031+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:22.186 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:22.180+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:22.401 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:22.397+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:22.628 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:22.622+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:22.728 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:22.722+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:22.779 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:22.773+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:22.807 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:22.802+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:23.027 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:23.022+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:23.240 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:23.234+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:23.439 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:23.435+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:23.665 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:23.659+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:23.699 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:23.693+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:23.799 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:23.794+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:23.803 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:23.797+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:24.052 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:24.047+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:24.230 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:24.225+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:24.467 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:24.463+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:24.660 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:24.654+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:24.688 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:24.683+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:24.789 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:24.785+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:24.843 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:24.837+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:25.044 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:25.038+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:25.210 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:25.204+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:25.509 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:25.504+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:25.654 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:25.649+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:25.659 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:25.654+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:25.776 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:25.772+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:25.845 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:25.840+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:26.030 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:26.025+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:26.205 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:26.199+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:26.499 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:26.490+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:26.610 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:26.605+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:26.638 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:26.633+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:26.783 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:26.777+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:26.849 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:26.845+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:27.006 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:27.000+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:27.172 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:27.167+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:27.494 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:27.488+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:27.578 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:27.572+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:27.624 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:27.618+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:27.786 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:27.781+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:27.836 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:27.830+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:28.037 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:28.032+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:28.184 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:28.178+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:28.500 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:28.495+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:28.599 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:28.593+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:28.662 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:28.656+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:28.784 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:28.779+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:28.816 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:28.811+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:29.018 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:29.012+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:29.142 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:29.136+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:29.539 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:29.533+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:29.564 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:29.558+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:29.709 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:29.703+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:29.825 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:29.814+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:29.825 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:29.816+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:30.072 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:30.066+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:30.136 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:30.128+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:30.497 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:30.492+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:30.557 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:30.552+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:30.710 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:30.705+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:30.811 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:30.805+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:30.859 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:30.853+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:31.080 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:31.075+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:31.127 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:31.122+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:31.458 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:31.451+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:31.578 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:31.571+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:31.725 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:31.719+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:31.834 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:31.830+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:31.884 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:31.880+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:32.133 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:32.126+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:32.134 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:32.126+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:32.417 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:32.413+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:32.418 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:04:30.445 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:32.425 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:04:30.451 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:32.430 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:04:30.457 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:32.433 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:04:30.460 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:32.442 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:04:30.405 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:32.452 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:04:30.416 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:32.593 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:32.586+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:32.672 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:04:30.699 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:32.742 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:32.735+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:32.746 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:04:30.773 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:32.769 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:04:30.732 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:32.795 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:32.789+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:32.900 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:32.892+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:33.096 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:33.089+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:33.158 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:33.151+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:33.377 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:33.371+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:33.637 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:33.630+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:33.719 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:33.712+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:33.783 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:33.778+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:33.899 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:33.895+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:34.072 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:34.066+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:34.139 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:34.132+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:34.394 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:34.390+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:34.619 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:34.611+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:34.705 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:43:34.698+0000 1694f700 -1 osd.7 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.698898+0000 front 2019-12-09T18:42:20.102250+0000 (oldest deadline 2019-12-09T18:42:59.960677+0000) 2019-12-09T18:43:34.803 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:43:34.797+0000 1694f700 -1 osd.1 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:17.509978+0000 front 2019-12-09T18:42:17.558920+0000 (oldest deadline 2019-12-09T18:43:02.786728+0000) 2019-12-09T18:43:34.901 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:43:34.895+0000 1694f700 -1 osd.3 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.458421+0000 front 2019-12-09T18:42:16.143498+0000 (oldest deadline 2019-12-09T18:43:01.413480+0000) 2019-12-09T18:43:35.066 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:43:35.059+0000 1694f700 -1 osd.4 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.975532+0000 front 2019-12-09T18:42:18.825886+0000 (oldest deadline 2019-12-09T18:43:01.508513+0000) 2019-12-09T18:43:35.112 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:43:35.105+0000 1694f700 -1 osd.6 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:16.438150+0000 front 2019-12-09T18:42:16.471794+0000 (oldest deadline 2019-12-09T18:43:01.660189+0000) 2019-12-09T18:43:35.414 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:43:35.410+0000 1694f700 -1 osd.0 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.464328+0000 front 2019-12-09T18:42:18.448737+0000 (oldest deadline 2019-12-09T18:43:03.854858+0000) 2019-12-09T18:43:35.562 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:43:35.552+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 45sec e293 v293) 2019-12-09T18:43:35.663 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:43:35.656+0000 1694f700 -1 osd.5 293 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:42:18.824302+0000 front 2019-12-09T18:42:18.996079+0000 (oldest deadline 2019-12-09T18:43:01.690283+0000) 2019-12-09T18:43:40.764 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:04:38.790 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:40.773 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:04:38.800 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:40.787 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:04:38.750 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:40.800 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:04:38.826 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:40.801 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:04:38.828 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:40.814 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:04:38.778 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:40.831 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:04:38.858 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:40.837 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:04:38.863 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:43:40.869 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:04:38.832 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:44:11.002 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:10.975+0000 34274700 -1 osd.2 298 build_incremental_map_msg missing incremental map 298 2019-12-09T18:44:11.167 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:11.153+0000 34274700 -1 osd.2 298 build_incremental_map_msg missing incremental map 298 2019-12-09T18:44:11.212 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:11.170+0000 114ae700 -1 osd.2 298 build_incremental_map_msg missing incremental map 298 2019-12-09T18:44:34.459 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:34.454+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:34.882 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:34.877+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:34.893 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:34.888+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:34.963 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:34.958+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:35.470 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:35.464+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:35.486 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:35.481+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:35.587 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:35.582+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:35.864 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:35.858+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:35.935 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:35.930+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:35.993 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:35.986+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:36.471 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:36.466+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:36.491 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:36.485+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:36.607 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:36.602+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:36.911 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:36.906+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:36.919 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:36.914+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:36.964 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:36.959+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:37.435 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:37.428+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:37.488 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:37.482+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:37.580 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:37.575+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:37.878 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:37.871+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:37.894 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:37.889+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:37.936 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:37.931+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:38.454 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:38.449+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:38.469 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:38.463+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:38.596 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:38.591+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:38.836 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:38.830+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:38.922 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:38.908+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:38.937 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:38.930+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:39.498 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:39.487+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:39.515 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:39.509+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:39.577 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:39.572+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:39.868 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:39.862+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:39.869 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:39.863+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:39.905 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:39.900+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:40.518 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:40.513+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:40.531 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:40.525+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:40.612 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:40.602+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:40.828 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:40.823+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:40.873 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:40.864+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:40.875 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:40.870+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:41.140 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:41.135+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:41.520 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:41.514+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:41.567 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:41.562+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:41.596 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:41.591+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:41.815 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:41.810+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:41.857 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:41.852+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:41.927 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:41.922+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:42.103 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:42.097+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:42.549 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:42.543+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:42.549 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:42.539+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:42.630 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:42.626+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:42.813 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:42.809+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:42.857 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:42.852+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:42.977 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:42.972+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:43.120 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:43.114+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:43.516 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:43.510+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:43.592 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:43.586+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:43.642 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:43.637+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:43.842 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:43.837+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:43.864 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:43.859+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:43.979 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:43.973+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:44.147 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:44.141+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:44.506 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:44.502+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:44.601 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:44.594+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:44.636 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:44.631+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:44.844 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:44.839+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:44.886 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:44.881+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:44.990 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:44.986+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:45.174 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:45.167+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:45.469 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:45.464+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:45.617 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:45.613+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:45.647 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:45.642+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:45.867 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:45.852+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:45.872 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:45.868+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:45.959 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:45.953+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:46.199 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:46.194+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:46.434 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:46.429+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:46.583 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:46.580+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:46.658 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:46.654+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:46.853 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:46.846+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:46.890 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:46.884+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:46.962 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:46.956+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:47.225 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:47.213+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:47.415 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:47.410+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:47.576 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:47.569+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:47.646 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:47.639+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:47.874 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:47.869+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:47.880 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:47.874+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:48.013 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:48.006+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:48.269 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:48.260+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:44:48.269 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:48.264+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:48.407 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:48.402+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:48.551 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:48.546+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:48.641 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:48.634+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:48.842 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:48.835+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:48.844 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:48.838+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:49.035 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:49.028+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:49.222 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:49.218+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:44:49.226 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:49.222+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:49.413 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:49.408+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:49.518 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:49.512+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:49.602 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:49.595+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:49.803 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:49.797+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:49.813 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:49.809+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:50.079 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:50.072+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:50.226 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:50.219+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:44:50.229 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:50.222+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:50.443 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:50.438+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:50.543 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:50.539+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:50.654 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:50.648+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:50.769 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:50.762+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:50.799 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:50.794+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:51.123 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:51.117+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:51.270 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:51.263+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:44:51.272 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:51.267+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:51.403 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:51.397+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:51.501 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:51.496+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:51.625 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:51.618+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:51.769 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:51.764+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:51.787 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:51.781+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:52.106 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:52.100+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:52.249 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:52.241+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:44:52.252 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:52.245+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:52.426 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:52.422+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:52.496 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:52.491+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:52.610 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:52.604+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:52.767 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:52.762+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:52.834 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:52.827+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:53.070 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:53.063+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:53.253 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:53.245+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:44:53.256 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:53.249+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:53.389 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:53.384+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:53.459 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:53.454+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:53.576 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:53.569+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:53.733 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:53.728+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:53.855 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:53.848+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:54.062 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:54.055+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:54.296 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:54.291+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:44:54.303 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:54.297+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:54.364 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:54.358+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:54.467 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:54.462+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:54.557 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:54.550+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:54.734 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:54.729+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:54.842 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:54.836+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:55.106 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:55.100+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:55.283 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:55.275+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:44:55.286 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:55.279+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:55.369 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:55.364+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:55.481 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:55.475+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:55.559 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:55.553+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:55.780 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:55.775+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:55.894 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:55.888+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:56.145 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:56.138+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:56.295 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:56.290+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:44:56.300 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:56.295+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:56.404 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:56.397+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:56.437 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:56.432+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:56.547 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:56.541+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:56.788 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:56.783+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:56.913 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:56.907+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:57.194 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:57.188+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:57.345 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:57.340+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:44:57.351 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:57.345+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:57.389 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:57.383+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:57.420 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:57.414+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:57.548 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:57.542+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:57.830 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:57.825+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:57.926 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:57.920+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:58.201 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:58.195+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:58.357 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:58.352+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:58.375 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:58.370+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:58.383 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:58.377+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:44:58.390 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:58.382+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:58.593 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:58.587+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:58.810 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:58.805+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:58.940 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:58.933+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:44:59.203 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:44:59.197+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:44:59.316 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:44:59.312+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:44:59.345 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:59.339+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:44:59.348 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:44:59.341+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:44:59.357 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:44:59.352+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:44:59.597 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:44:59.590+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:44:59.831 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:44:59.826+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:44:59.973 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:44:59.966+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:00.196 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:00.189+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:00.355 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:00.350+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:00.370 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:00.365+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:00.371 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:00.363+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:00.374 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:00.367+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:00.639 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:00.632+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:00.880 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:00.870+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:01.012 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:01.005+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:01.198 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:01.192+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:01.335 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:01.330+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:01.358 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:01.353+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:01.365 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:01.359+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:01.367 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:01.361+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:01.669 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:01.662+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:01.835 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:01.831+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:01.992 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:01.986+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:02.221 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:02.214+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:02.318 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:02.314+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:02.322 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:02.318+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:02.346 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:02.342+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:02.353 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:02.349+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:02.713 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:02.706+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:02.806 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:02.796+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:03.034 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:03.028+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:03.208 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:03.202+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:03.294 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:03.286+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:03.296 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:03.290+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:03.302 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:03.298+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:03.333 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:03.328+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:03.684 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:03.678+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:03.798 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:03.792+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:04.023 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:04.017+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:04.254 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:04.248+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:04.305 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:04.299+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:04.336 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:04.331+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:04.340 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:04.336+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:04.345 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:04.338+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:04.665 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:04.658+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:04.804 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:04.798+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:05.037 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:05.032+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:05.229 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:05.223+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:05.301 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:05.295+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:05.334 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:05.329+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:05.391 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:05.383+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:05.394 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:05.387+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:05.666 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:05.659+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:05.769 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:05.764+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:06.029 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:06.023+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:06.249 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:06.244+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:06.326 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:06.321+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:06.331 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:06.326+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:06.387 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:06.382+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:06.394 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:06.388+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:06.685 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:06.678+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:06.815 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:06.811+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:07.017 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:07.010+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:07.282 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:07.275+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:07.320 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:07.314+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:07.323 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:07.316+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:07.382 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:07.378+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:07.388 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:07.383+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:07.734 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:07.725+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:07.813 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:07.808+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:08.061 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:08.055+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:08.284 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:08.278+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:08.284 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:08.280+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:08.401 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:08.397+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:08.405 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:08.401+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:08.416 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:08.312+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:08.697 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:08.691+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:08.768 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:08.763+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:09.040 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:09.035+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:09.268 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:09.263+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:09.282 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:09.276+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:09.336 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:09.331+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:09.451 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:09.443+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:09.453 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:09.450+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:09.735 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:09.731+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:09.748 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:09.742+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:10.010 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:10.004+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:10.299 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:10.295+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:10.303 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:10.298+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:10.309 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:10.304+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:10.416 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:10.410+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:10.418 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:10.413+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:10.730 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:10.725+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:10.753 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:10.745+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:10.977 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:10.971+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:10.990 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:45:10.983+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e298 v298) 2019-12-09T18:45:11.260 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:11.253+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:11.291 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:11.285+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:11.297 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:11.292+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:11.410 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:11.403+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:11.412 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:11.406+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:11.754 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:11.749+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:11.755 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:11.750+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:11.933 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:11.928+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:12.284 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:12.280+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:12.306 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:12.300+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:12.307 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:12.303+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:12.437 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:12.428+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:12.439 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:12.434+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:12.745 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:12.739+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:12.748 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:12.743+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:12.964 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:12.958+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:13.262 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:13.257+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:13.323 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:13.318+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:13.346 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:13.340+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:13.413 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:13.404+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:13.415 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:13.409+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:13.752 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:13.746+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:13.803 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:13.797+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:13.984 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:13.979+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:14.273 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:14.268+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:14.303 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:14.298+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:14.369 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:14.364+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:14.428 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:14.418+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:14.431 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:14.424+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:14.730 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:14.725+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:14.836 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:14.833+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:14.979 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:14.973+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:15.231 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:15.226+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:15.281 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:15.276+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:15.371 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:15.367+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:15.397 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:15.392+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:15.399 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:15.395+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:15.747 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:15.741+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:15.879 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:15.876+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:15.939 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:15.934+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:16.024 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:45:16.008+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e298 v298) 2019-12-09T18:45:16.208 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:16.205+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:16.328 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:16.322+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:16.369 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:16.366+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:16.374 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:16.370+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:16.414 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:16.410+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:16.774 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:16.769+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:16.894 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:16.890+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:16.901 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:16.896+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:17.166 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:17.162+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:17.312 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:17.306+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:17.334 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:17.327+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:17.336 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:17.331+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:17.444 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:17.440+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:17.769 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:17.763+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:17.929 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:17.925+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:17.947 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:17.942+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:18.173 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:18.169+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:18.326 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:18.321+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:18.373 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:18.368+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:18.381 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:18.371+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:18.429 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:18.426+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:18.738 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:18.732+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:18.909 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:18.904+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:18.967 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:18.961+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:19.140 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:19.134+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:19.344 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:19.341+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:19.349 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:19.344+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:19.358 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:19.349+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:19.416 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:19.412+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:19.701 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:19.695+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:19.875 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:19.871+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:19.946 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:19.941+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:20.185 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:45:20.181+0000 1694f700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.813313+0000 front 2019-12-09T18:43:50.656311+0000 (oldest deadline 2019-12-09T18:44:34.688172+0000) 2019-12-09T18:45:20.358 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:45:20.354+0000 1694f700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:50.709039+0000 front 2019-12-09T18:43:51.248749+0000 (oldest deadline 2019-12-09T18:44:34.792000+0000) 2019-12-09T18:45:20.394 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:20.388+0000 1694f700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:44:07.418117+0000 (oldest deadline 2019-12-09T18:44:47.418117+0000) 2019-12-09T18:45:20.394 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:20.390+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:20.396 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:20.391+0000 1694f700 -1 osd.2 298 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4530.0:120072 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e297) 2019-12-09T18:45:20.753 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:45:20.747+0000 1694f700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:51.052907+0000 front 2019-12-09T18:43:50.693491+0000 (oldest deadline 2019-12-09T18:44:34.725125+0000) 2019-12-09T18:45:20.905 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:45:20.902+0000 1694f700 -1 osd.3 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.879021+0000 front 2019-12-09T18:43:52.845924+0000 (oldest deadline 2019-12-09T18:44:33.934985+0000) 2019-12-09T18:45:20.996 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:45:20.991+0000 1694f700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:52.664833+0000 front 2019-12-09T18:43:52.717278+0000 (oldest deadline 2019-12-09T18:44:34.218951+0000) 2019-12-09T18:45:21.093 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:45:21.077+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e298 v298) 2019-12-09T18:45:21.399 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:45:21.395+0000 1694f700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:43:53.108608+0000 front 2019-12-09T18:43:53.110122+0000 (oldest deadline 2019-12-09T18:44:33.961065+0000) 2019-12-09T18:45:21.567 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:45:21.565+0000 39a7f700 -1 osd.2 299 build_incremental_map_msg missing incremental map 298 2019-12-09T18:47:14.022 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:14.014+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:14.498 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:14.492+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:14.721 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:14.712+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:14.997 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:14.990+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:15.257 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:15.251+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:15.316 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:15.309+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:15.386 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:15.380+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:15.531 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:15.523+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:15.680 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:15.673+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:15.998 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:15.992+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:16.294 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:16.282+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:16.369 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:16.363+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:16.396 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:16.391+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:16.521 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:16.515+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:16.683 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:16.678+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:16.996 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:16.988+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:17.257 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:17.249+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:17.351 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:17.345+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:17.382 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:17.377+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:17.485 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:17.479+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:17.700 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:17.692+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:17.991 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:17.986+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:18.292 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:18.285+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:18.380 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:18.373+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:18.405 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:18.400+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:18.485 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:18.477+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:18.700 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:18.694+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:19.005 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:18.999+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:19.261 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:19.253+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:19.370 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:19.363+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:19.418 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:19.414+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:19.462 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:19.456+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:19.728 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:19.722+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:19.964 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:19.958+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:20.337 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:20.330+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:20.368 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:20.361+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:20.407 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:20.402+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:20.498 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:20.491+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:20.725 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:20.720+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:20.924 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:20.917+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:21.354 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:21.346+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:21.389 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:21.382+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:21.413 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:21.408+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:21.466 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:21.458+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:21.747 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:21.742+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:21.966 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:21.959+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:22.340 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:22.334+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:22.409 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:22.403+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:22.420 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:22.415+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:22.440 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:22.433+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:22.789 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:22.785+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:23.004 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:22.998+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:23.379 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:23.372+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:23.390 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:23.381+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:23.400 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:23.393+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:23.472 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:23.466+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:23.777 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:23.771+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:24.027 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:24.020+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:24.416 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:24.408+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:24.427 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:24.420+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:24.448 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:24.441+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:24.491 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:24.487+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:24.789 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:24.784+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:25.079 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:25.073+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:25.396 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:25.389+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:25.429 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:25.423+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:25.470 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:25.465+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:25.508 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:25.501+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:25.788 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:25.782+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:26.093 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:26.086+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:26.405 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:26.398+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:26.468 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:26.461+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:26.487 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:26.482+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:26.546 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:26.539+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:26.767 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:26.763+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:27.141 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:27.132+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:27.405 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:27.398+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:27.450 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:27.445+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:27.483 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:27.475+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:27.513 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:27.505+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:27.764 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:27.759+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:28.132 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:28.125+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:28.373 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:28.366+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:28.474 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:28.468+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:28.488 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:28.481+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:28.549 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:28.542+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:28.760 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:28.755+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:29.135 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:29.128+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:29.371 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:29.364+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:29.442 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:29.435+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:29.504 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:29.494+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:29.518 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:29.509+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:29.801 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:29.796+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:30.169 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:30.162+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:30.365 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:30.355+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:30.402 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:30.397+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:30.477 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:30.470+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:30.524 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:30.517+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:30.819 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:30.814+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:31.161 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:31.141+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:31.358 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:31.352+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:31.399 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:31.392+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:31.495 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:31.488+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:31.552 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:31.546+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:31.872 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:31.866+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:32.200 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:32.194+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:32.383 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:32.375+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:32.393 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:32.388+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:32.512 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:32.505+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:32.535 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:32.529+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:32.836 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:32.831+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:33.194 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:33.187+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:33.340 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:33.332+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:33.415 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:33.410+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:33.492 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:33.483+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:33.716 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:33.498+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:33.891 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:33.885+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:34.217 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:34.209+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:34.335 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:34.328+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:34.453 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:34.448+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:34.457 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:34.450+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:34.526 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:34.519+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:34.928 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:34.923+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:35.232 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:35.224+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:35.299 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:35.288+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:35.443 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:35.436+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:35.456 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:35.451+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:35.481 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:35.474+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:35.909 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:35.904+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:36.212 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:36.205+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:36.342 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:36.335+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:36.422 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:36.418+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:36.437 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:36.429+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:36.495 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:36.487+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:36.921 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:36.914+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:37.216 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:37.208+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:37.358 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:37.351+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:37.407 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:37.403+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:37.434 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:37.427+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:37.511 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:37.504+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:37.950 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:37.945+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:38.170 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:38.163+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:38.349 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:38.342+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:38.365 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:38.360+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:38.468 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:38.461+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:38.560 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:38.553+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:38.923 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:38.918+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:39.032 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:08:37.058 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:39.037 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:08:37.063 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:39.049 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:08:37.076 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:39.053 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:08:37.016 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:39.058 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:08:37.085 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:39.059 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:08:37.022 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:39.128 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:39.123+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:39.294 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:08:37.321 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:39.304 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:08:37.267 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:39.332 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:08:37.358 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:47:39.340 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:39.336+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:39.356 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:39.351+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:39.444 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:39.440+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:39.568 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:39.560+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:39.889 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:39.886+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:40.085 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:40.078+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:40.314 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:40.308+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:40.362 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:40.359+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:40.471 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:40.466+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:40.609 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:40.604+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:40.877 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:40.873+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:41.047 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:41.040+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:41.333 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:41.323+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:41.367 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:41.363+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:41.509 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:41.479+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:41.631 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:41.625+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:41.929 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:41.924+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:42.009 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:42.003+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:42.380 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:42.373+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:42.399 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:42.394+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:42.492 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:42.486+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:42.645 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:42.639+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:42.897 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:42.894+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:42.980 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:42.974+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:43.381 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:43.376+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:43.390 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:43.379+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:43.472 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:43.467+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:43.630 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:43.624+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:43.912 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:43.907+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:44.005 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:43.999+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:44.361 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:44.355+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:44.418 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:44.414+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:44.504 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:44.499+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:44.639 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:44.632+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:44.959 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:44.954+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:47:45.021 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:47:45.013+0000 1694f700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:31.450960+0000 front 2019-12-09T18:46:31.426374+0000 (oldest deadline 2019-12-09T18:47:13.689832+0000) 2019-12-09T18:47:45.387 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:47:45.382+0000 1694f700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.298241+0000 front 2019-12-09T18:46:29.890535+0000 (oldest deadline 2019-12-09T18:47:14.754269+0000) 2019-12-09T18:47:45.424 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:47:45.419+0000 1694f700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.640248+0000 front 2019-12-09T18:46:30.687595+0000 (oldest deadline 2019-12-09T18:47:15.315950+0000) 2019-12-09T18:47:45.537 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:47:45.532+0000 1694f700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.443761+0000 front 2019-12-09T18:46:30.309694+0000 (oldest deadline 2019-12-09T18:47:13.736744+0000) 2019-12-09T18:47:45.569 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:47:45.566+0000 1694f700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:32.305300+0000 front 2019-12-09T18:46:30.298575+0000 (oldest deadline 2019-12-09T18:47:45.186185+0000) 2019-12-09T18:47:45.681 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:47:45.676+0000 1694f700 -1 osd.5 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.378776+0000 front 2019-12-09T18:46:30.336842+0000 (oldest deadline 2019-12-09T18:47:14.997429+0000) 2019-12-09T18:47:45.947 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:47:45.942+0000 1694f700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:46:30.516086+0000 front 2019-12-09T18:46:30.464891+0000 (oldest deadline 2019-12-09T18:47:14.550382+0000) 2019-12-09T18:48:40.933 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:40.927+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:41.908 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:41.901+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:42.929 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:42.923+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:43.769 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:43.764+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:43.902 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:43.896+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:43.932 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:43.925+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:44.681 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:48:44.671+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:48:44.819 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:44.812+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:44.871 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:44.865+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:44.979 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:44.974+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:45.685 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:48:45.679+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:48:45.798 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:45.793+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:45.883 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:45.876+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:46.029 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:46.021+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:46.145 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:48:46.140+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:48:46.724 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:48:46.718+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:48:46.773 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:46.767+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:46.901 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:46.895+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:47.050 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:47.044+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:47.070 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:48:47.063+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:48:47.190 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:48:47.185+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:48:47.742 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:48:47.736+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:48:47.762 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:47.756+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:47.906 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:47.899+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:48.023 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:48:48.019+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:48:48.031 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:48.025+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:48.241 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:48:48.235+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:48:48.717 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:48:48.710+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:48:48.752 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:48.747+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:48.942 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:48.935+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:48.990 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:48.985+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:49.059 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:48:49.055+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:48:49.217 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:48:49.211+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:48:49.698 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:48:49.692+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:48:49.774 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:49.768+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:49.967 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:49.961+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:49.985 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:49.979+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:50.029 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:48:50.024+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:48:50.203 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:48:50.198+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:48:50.667 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:48:50.661+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:48:50.791 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:50.786+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:50.939 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:50.933+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:50.949 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:50.942+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:51.018 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:48:51.013+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:48:51.204 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:48:51.199+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:48:51.716 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:48:51.710+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:48:51.841 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:51.836+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:51.897 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:51.891+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:51.953 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:51.946+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:52.034 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:48:52.028+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:48:52.101 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:48:52.098+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:48:52.216 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:48:52.213+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:48:52.726 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:48:52.719+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:48:52.872 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:52.862+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:52.874 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:52.870+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:52.942 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:52.936+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:53.073 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:48:53.069+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:48:53.076 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:48:53.072+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:48:53.261 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:48:53.257+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:48:53.703 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:48:53.694+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:48:53.854 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:53.847+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:53.889 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:53.886+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:53.920 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:53.915+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:54.039 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:48:54.034+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:48:54.061 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:48:54.056+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 18 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:48:54.294 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:48:54.289+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:48:54.742 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:48:54.736+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:48:54.900 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:54.895+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:54.932 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:54.927+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:54.933 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:54.929+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:55.031 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:48:55.027+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:48:55.109 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:48:55.103+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:48:55.344 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:48:55.340+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:48:55.731 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:48:55.726+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:48:55.875 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:55.869+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:55.937 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:55.928+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:55.983 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:55.978+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:56.049 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:48:56.045+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:48:56.124 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:48:56.119+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:48:56.325 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:48:56.320+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:48:56.767 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:48:56.762+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:48:56.846 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:56.841+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:56.939 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:56.933+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:56.964 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:56.960+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:57.044 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:48:57.040+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:48:57.097 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:48:57.092+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:48:57.208 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:09:55.235 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:48:57.240 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:09:55.267 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:48:57.268 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:09:55.294 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:48:57.272 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:09:55.299 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:48:57.283 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:09:55.246 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:48:57.285 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:09:55.248 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:48:57.290 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:48:57.287+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:48:57.363 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:09:55.390 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:48:57.374 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:09:55.400 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:48:57.412 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:09:55.375 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:48:57.778 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:48:57.773+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:48:57.847 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:57.843+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:57.928 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:57.923+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:57.938 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:57.933+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:58.092 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:48:58.086+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:48:58.092 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:48:58.089+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:48:58.349 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:48:58.339+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:48:58.825 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:48:58.821+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:48:58.830 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:58.826+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:58.900 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:58.897+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:58.970 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:58.965+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:48:59.055 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:48:59.051+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:48:59.125 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:48:59.122+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:48:59.131 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:48:59.125+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:48:59.392 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:48:59.386+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:48:59.822 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:48:59.817+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:48:59.828 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:48:59.821+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:48:59.911 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:48:59.906+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:48:59.944 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:48:59.939+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:00.014 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:00.007+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:00.171 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:00.164+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:00.174 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:00.167+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:00.403 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:00.397+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:00.817 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:00.810+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:00.851 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:00.846+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:00.894 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:00.889+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:00.962 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:00.955+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:01.032 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:01.027+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:01.133 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:01.129+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:01.140 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:01.133+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:01.370 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:01.365+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:01.808 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:01.803+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:01.847 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:01.842+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:01.935 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:01.930+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:01.978 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:01.973+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:02.046 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:02.042+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:02.117 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:02.110+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:02.119 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:02.113+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:02.365 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:02.353+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:02.814 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:02.809+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:02.816 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:02.811+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:02.898 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:02.894+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:02.990 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:02.985+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:03.027 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:03.019+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:03.097 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:03.089+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:03.099 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:03.093+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:03.400 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:03.396+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:03.779 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:03.774+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:03.834 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:03.829+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:03.900 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:03.895+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:04.012 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:04.006+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:04.033 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:04.027+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:04.147 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:04.140+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:04.149 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:04.143+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:04.407 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:04.402+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:04.865 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:04.736+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:04.874 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:04.867+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:04.887 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:04.881+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:04.999 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:04.993+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:05.009 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:05.003+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:05.158 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:05.150+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:05.160 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:05.154+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:05.440 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:05.434+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:05.786 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:05.781+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:05.891 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:05.885+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:05.923 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:05.917+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:05.968 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:05.962+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:06.017 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:06.011+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:06.123 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:06.115+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:06.128 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:06.119+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:06.479 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:06.475+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:06.807 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:06.795+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:06.931 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:06.925+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:06.937 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:06.932+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:06.976 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:06.971+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:07.054 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:07.048+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:07.120 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:07.111+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:07.135 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:07.117+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:07.521 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:07.516+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:07.848 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:07.843+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:07.902 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:07.897+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:07.979 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:07.975+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:07.983 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:07.978+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:08.043 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:08.038+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:08.136 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:08.132+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:08.153 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:08.138+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:08.499 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:08.488+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:08.835 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:08.830+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:08.928 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:08.924+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:08.994 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:08.989+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:09.023 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:09.018+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:09.037 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:09.031+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:09.132 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:09.124+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:09.133 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:09.128+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:09.459 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:09.455+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:09.796 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:09.791+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:09.897 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:09.893+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:09.965 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:09.960+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:09.991 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:09.986+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:10.044 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:10.038+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:10.138 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:10.134+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:10.147 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:10.138+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:10.483 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:10.478+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:10.788 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:10.784+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:10.869 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:10.864+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:10.986 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:10.981+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:11.019 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:11.014+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:11.021 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:11.015+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:11.118 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:11.113+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:11.128 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:11.122+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:11.447 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:11.442+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:11.748 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:11.742+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:11.837 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:11.832+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:11.979 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:11.972+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:12.026 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:12.019+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:12.053 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:12.048+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:12.094 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:12.086+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:12.096 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:12.090+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:12.208 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:49:12.203+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 41sec e309 v309) 2019-12-09T18:49:12.399 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:12.395+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:12.709 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:12.702+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:12.837 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:12.832+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:12.936 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:12.930+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:13.066 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:13.059+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:13.104 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:13.098+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:13.116 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:13.107+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:13.118 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:13.112+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:13.419 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:13.413+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:13.707 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:13.700+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:13.802 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:13.797+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:13.950 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:13.945+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:14.065 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:14.058+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:14.124 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:14.118+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:14.156 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:14.150+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:14.161 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:14.153+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:14.421 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:14.416+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:14.714 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:14.708+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:14.811 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:14.805+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:14.958 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:14.952+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:15.046 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:15.040+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:15.081 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:15.076+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:15.128 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:15.121+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:15.130 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:15.124+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:15.385 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:15.380+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:15.682 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:15.676+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:15.808 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:15.802+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:15.980 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:15.974+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:16.070 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:16.063+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:16.071 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:16.065+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:16.109 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:16.102+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:16.112 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:16.106+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:16.407 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:16.402+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:16.734 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:16.728+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:16.855 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:16.848+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:16.964 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:16.959+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:17.066 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:17.059+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:17.099 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:17.093+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:17.103 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:17.097+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:17.108 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:17.102+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:17.227 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:49:17.221+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 41sec e309 v309) 2019-12-09T18:49:17.432 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:17.426+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:17.724 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:17.718+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:17.867 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:17.862+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:18.006 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:18.001+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:18.069 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:18.062+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:18.076 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:18.070+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:18.122 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:18.114+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:18.124 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:18.118+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:18.407 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:18.403+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:18.735 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:18.729+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:18.845 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:18.841+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:18.974 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:18.969+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:19.045 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:19.038+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:19.065 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:19.059+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:19.178 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:19.169+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:19.188 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:19.176+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:19.452 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:19.444+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:19.730 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:19.723+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:19.849 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:19.844+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:20.010 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:20.003+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:20.023 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:20.017+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:20.031 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:20.025+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:20.215 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:20.211+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:20.222 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:20.216+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:20.490 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:20.485+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:20.736 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:20.730+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:20.809 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:20.805+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:21.012 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:21.006+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:21.051 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:21.044+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:21.055 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:21.047+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:21.263 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:21.256+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:21.265 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:21.259+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:21.484 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:21.477+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:21.783 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:21.777+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:21.786 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:21.780+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:22.038 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:22.032+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:22.058 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:22.053+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:22.088 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:22.082+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:22.248 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:49:22.242+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 41sec e309 v309) 2019-12-09T18:49:22.279 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:22.273+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:22.283 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:22.275+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:22.495 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:22.491+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:22.749 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:22.742+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:22.823 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:22.818+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:23.056 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:23.051+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:23.069 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:23.063+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:23.078 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:23.072+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:23.244 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:23.238+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:23.247 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:23.241+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:23.538 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:23.532+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:23.787 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:23.782+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:23.867 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:23.862+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:24.077 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:24.071+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:24.091 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:24.084+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:24.105 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:24.099+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:24.229 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:24.221+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:24.232 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:24.225+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:24.559 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:24.554+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:24.822 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:24.816+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:24.877 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:24.871+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:25.067 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:25.061+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:25.077 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:25.071+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:25.091 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:25.085+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:25.241 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:25.229+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:25.244 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:25.233+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:25.591 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:25.586+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:25.827 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:25.821+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:25.847 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:25.842+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:26.076 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:26.071+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:26.085 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:26.080+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:26.109 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:26.104+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:26.265 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:26.257+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:26.267 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:26.261+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:26.592 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:26.588+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:26.844 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:26.839+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:26.866 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:26.859+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:27.035 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:27.028+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:27.075 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:27.070+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:27.120 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:27.115+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:27.241 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:27.232+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:27.243 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:27.237+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:27.268 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:49:27.261+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 41sec e309 v309) 2019-12-09T18:49:27.575 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:27.570+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:27.898 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:27.892+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:27.904 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:27.898+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:27.998 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:27.991+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:28.098 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:28.092+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:28.104 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:28.100+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:28.232 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:28.227+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:28.239 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:28.233+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:28.564 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:28.559+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:28.894 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:28.888+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:28.950 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:28.944+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:28.996 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:28.989+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:29.070 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:29.065+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:29.096 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:29.091+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:29.250 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:29.242+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:29.253 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:29.246+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:29.557 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:29.552+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:29.890 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:29.884+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:29.932 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:29.925+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:29.955 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:29.949+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:30.113 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:30.107+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:30.116 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:30.111+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:30.289 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:30.278+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:30.289 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:30.282+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:30.534 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:30.529+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:30.899 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:30.892+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:30.937 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:30.931+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:30.939 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:30.933+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:31.145 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:31.138+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:31.162 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:31.156+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:31.296 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:31.288+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:31.299 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:31.292+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:31.500 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:49:31.495+0000 1694f700 -1 osd.3 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.715455+0000 front 2019-12-09T18:48:03.712316+0000 (oldest deadline 2019-12-09T18:48:45.399520+0000) 2019-12-09T18:49:31.916 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:49:31.910+0000 1694f700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:00.615078+0000 front 2019-12-09T18:48:00.610090+0000 (oldest deadline 2019-12-09T18:48:42.949347+0000) 2019-12-09T18:49:31.938 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:49:31.931+0000 1694f700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.312956+0000 front 2019-12-09T18:48:01.636402+0000 (oldest deadline 2019-12-09T18:48:43.613640+0000) 2019-12-09T18:49:31.959 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:49:31.952+0000 1694f700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:01.644340+0000 front 2019-12-09T18:48:00.902743+0000 (oldest deadline 2019-12-09T18:48:44.309476+0000) 2019-12-09T18:49:32.143 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:49:32.133+0000 1694f700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:03.421589+0000 front 2019-12-09T18:48:00.328347+0000 (oldest deadline 2019-12-09T18:48:40.007051+0000) 2019-12-09T18:49:32.167 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:49:32.162+0000 1694f700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:48:04.036871+0000 front 2019-12-09T18:48:01.623435+0000 (oldest deadline 2019-12-09T18:48:46.304840+0000) 2019-12-09T18:49:32.289 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:32.280+0000 1694f700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:48:18.331851+0000 (oldest deadline 2019-12-09T18:48:58.331851+0000) 2019-12-09T18:49:32.291 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:49:32.285+0000 1694f700 -1 osd.2 309 get_health_metrics reporting 28 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e308) 2019-12-09T18:49:32.340 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:49:32.335+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 41sec e309 v309) 2019-12-09T18:50:02.876 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:50:02.848+0000 35a77700 -1 osd.5 314 build_incremental_map_msg missing incremental map 314 2019-12-09T18:50:03.121 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:50:03.045+0000 33a73700 -1 osd.5 314 build_incremental_map_msg missing incremental map 314 2019-12-09T18:50:03.203 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:50:03.109+0000 39a7f700 -1 osd.5 314 build_incremental_map_msg missing incremental map 314 2019-12-09T18:50:03.303 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:50:03.144+0000 34274700 -1 osd.5 314 build_incremental_map_msg missing incremental map 314 2019-12-09T18:50:03.451 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:50:03.262+0000 36a79700 -1 osd.5 314 build_incremental_map_msg missing incremental map 314 2019-12-09T18:50:04.547 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:50:04.368+0000 3927e700 -1 osd.5 314 build_incremental_map_msg missing incremental map 314 2019-12-09T18:50:32.721 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:50:32.693+0000 1694f700 -1 osd.2 314 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=51 ondisk+retry+read+known_if_redirected e312) 2019-12-09T18:50:33.973 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:50:33.939+0000 1694f700 -1 osd.2 314 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=51 ondisk+retry+read+known_if_redirected e312) 2019-12-09T18:51:25.065 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:25.058+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:25.175 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:25.169+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:25.287 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:25.283+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:26.041 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:26.034+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:26.191 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:26.184+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:26.323 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:26.317+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:26.327 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:26.322+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:27.087 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:27.080+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:27.225 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:27.214+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:27.366 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:27.362+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:27.372 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:27.367+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:27.496 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:27.490+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:28.108 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:28.102+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:28.225 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:28.219+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:28.330 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:28.325+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:28.406 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:28.401+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:28.450 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:28.444+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:28.710 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:28.705+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:28.711 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:28.705+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:29.073 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:29.068+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:29.202 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:29.195+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:29.379 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:29.374+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:29.444 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:29.439+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:29.464 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:29.457+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:29.700 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:29.693+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:29.735 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:29.730+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:30.057 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:30.050+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:30.215 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:30.208+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:30.341 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:30.336+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:30.481 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:30.475+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:30.492 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:30.486+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:30.696 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:30.691+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:30.710 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:30.705+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:31.039 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:31.033+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:31.266 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:31.260+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:31.378 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:31.373+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:31.495 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:31.489+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:31.524 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:31.519+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:31.684 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:31.678+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:31.692 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:31.686+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:32.082 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:32.076+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:32.285 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:32.279+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:32.354 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:32.349+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:32.545 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:32.540+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:32.545 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:32.540+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:32.651 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:32.646+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:32.680 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:32.675+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:33.098 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:33.092+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:33.314 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:33.308+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:33.337 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:33.331+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:33.527 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:33.522+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:33.565 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:33.559+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:33.637 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:33.631+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:33.683 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:33.677+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:34.069 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:34.063+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:34.333 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:34.328+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:34.350 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:34.344+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:34.519 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:34.513+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:34.567 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:34.563+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:34.658 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:34.652+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:34.703 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:34.698+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:35.052 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:35.044+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:35.317 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:35.312+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:35.332 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:35.325+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:35.480 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:35.474+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:35.610 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:35.606+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:35.668 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:35.663+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:35.708 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:35.703+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:36.031 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:36.026+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:36.335 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:36.328+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:36.347 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:36.341+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:36.480 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:36.462+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:36.623 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:36.617+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:36.690 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:36.683+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:36.715 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:36.710+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:37.089 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:37.082+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:37.293 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:37.286+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:37.361 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:37.354+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:37.469 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:37.463+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:37.586 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:37.578+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:37.725 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:37.673+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:37.725 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:37.703+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:38.113 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:38.107+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:38.342 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:38.336+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:38.352 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:38.347+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:38.527 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:38.517+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:38.581 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:38.577+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:38.687 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:38.682+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:38.725 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:38.720+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:39.121 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:39.110+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:39.323 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:39.317+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:39.391 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:39.385+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:39.527 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:39.520+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:39.568 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:39.564+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:39.685 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:39.675+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:39.730 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:39.724+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:40.107 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:40.101+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:40.305 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:40.299+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:40.395 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:40.388+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:40.583 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:40.576+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:40.620 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:40.615+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:40.689 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:40.684+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:40.777 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:40.772+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:41.156 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:41.150+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:41.312 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:41.308+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:41.432 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:41.426+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:41.576 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:41.571+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:41.605 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:41.596+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:41.661 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:41.656+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:41.771 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:41.765+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:42.167 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:42.161+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:42.330 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:42.325+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:42.403 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:42.392+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:42.552 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:42.546+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:42.564 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:42.559+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:42.704 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:42.699+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:42.738 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:42.734+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:43.126 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:43.118+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:43.307 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:43.302+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:43.373 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:43.366+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:43.528 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:43.521+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:43.565 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:43.560+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:43.700 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:43.694+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:43.753 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:43.747+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:44.132 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:44.124+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:44.281 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:44.275+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:44.345 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:44.336+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:44.494 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:44.487+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:44.590 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:44.586+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:44.725 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:44.718+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:44.774 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:44.769+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:45.144 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:45.137+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:45.244 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:45.238+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:45.326 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:45.319+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:45.499 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:45.493+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:45.574 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:45.569+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:45.746 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:45.739+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:45.826 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:45.822+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:46.187 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:46.179+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:46.263 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:46.258+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:46.324 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:46.318+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:46.502 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:46.495+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:46.587 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:46.583+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:46.714 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:46.707+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:46.805 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:12:44.827 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:51:46.805 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:12:44.832 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:51:46.814 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:12:44.840 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:51:46.818 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:12:44.845 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:51:46.842 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:12:44.805 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:51:46.848 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:12:44.812 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:51:46.861 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:46.856+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:46.968 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:12:44.995 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:51:47.013 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:12:45.039 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:51:47.048 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:12:45.011 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:51:47.206 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:47.200+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:47.221 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:47.216+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:47.341 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:47.334+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:47.521 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:47.512+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:47.621 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:47.616+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:47.743 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:47.736+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:47.863 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:47.859+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:48.176 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:48.169+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:48.264 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:48.260+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:48.394 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:48.388+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:48.494 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:48.488+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:48.597 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:48.593+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:48.788 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:48.781+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:48.851 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:48.845+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:49.182 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:49.174+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:49.243 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:49.238+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:49.417 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:49.407+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:49.532 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:49.523+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:49.641 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:49.636+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:49.767 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:49.760+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:49.863 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:49.860+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:50.208 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:50.203+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:50.220 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:50.214+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:50.452 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:50.445+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:50.566 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:50.559+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:50.646 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:50.642+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:50.789 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:50.781+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:50.879 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:50.873+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:51.191 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:51.184+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:51.208 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:51.203+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:51.478 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:51.468+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:51.613 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:51.606+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:51.621 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:51.616+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:51.818 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:51.812+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:51.848 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:51.844+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:52.210 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:52.203+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:52.215 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:52.206+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:52.508 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:52.500+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:52.608 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:52.601+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:52.636 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:52.631+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:52.783 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:52.776+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:52.807 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:52.803+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:53.198 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:53.193+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:53.245 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:53.238+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:53.474 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:53.468+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:53.624 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:53.617+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:53.686 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:53.682+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:53.814 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:53.807+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:53.828 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:53.822+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:54.205 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:54.198+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:54.223 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:54.218+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:54.477 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:54.471+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:54.598 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:54.591+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:54.729 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:54.725+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:54.803 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:54.796+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:54.864 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:54.859+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:55.189 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:55.185+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:55.262 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:55.254+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:55.507 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:55.501+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:55.600 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:55.593+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:55.718 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:55.712+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:55.815 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:55.809+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:55.880 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:55.874+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:56.213 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:56.207+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:56.246 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:56.239+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:56.476 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:56.469+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:56.620 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:56.613+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:56.680 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:56.676+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:56.807 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:56.801+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:56.874 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:56.869+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:57.169 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:57.164+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:57.286 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:57.279+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:57.443 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:57.436+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:57.646 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:57.639+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:57.652 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:57.646+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:57.815 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:57.809+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:57.875 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:57.870+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:58.004 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:51:58.000+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 44sec e314 v314) 2019-12-09T18:51:58.172 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:58.164+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:58.259 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:58.251+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:58.470 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:58.463+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:58.677 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:58.673+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:58.679 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:58.673+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:58.785 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:58.779+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:58.917 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:58.910+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:51:59.162 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:51:59.157+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:51:59.306 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:51:59.299+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:51:59.472 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:51:59.465+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:51:59.668 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:51:59.662+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:51:59.714 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:51:59.708+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:51:59.757 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:51:59.749+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:51:59.956 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:51:59.951+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:52:00.130 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:52:00.124+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:52:00.356 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:52:00.349+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:52:00.487 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:52:00.476+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:52:00.665 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:52:00.658+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:52:00.697 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:52:00.693+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:52:00.759 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:52:00.752+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:52:00.967 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:52:00.961+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:52:01.168 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:52:01.162+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:52:01.364 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:52:01.357+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:52:01.530 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:52:01.523+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:52:01.634 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:52:01.627+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:52:01.735 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:52:01.729+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:52:02.210 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:52:01.739+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:52:02.211 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:52:02.015+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:52:02.211 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:52:02.148+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:52:02.393 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:52:02.386+0000 1694f700 -1 osd.6 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.929133+0000 front 2019-12-09T18:50:41.763579+0000 (oldest deadline 2019-12-09T18:51:24.642372+0000) 2019-12-09T18:52:02.567 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:52:02.559+0000 1694f700 -1 osd.5 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.349537+0000 front 2019-12-09T18:50:41.319412+0000 (oldest deadline 2019-12-09T18:51:24.762516+0000) 2019-12-09T18:52:02.670 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:52:02.663+0000 1694f700 -1 osd.4 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.644559+0000 front 2019-12-09T18:50:42.559236+0000 (oldest deadline 2019-12-09T18:51:27.029966+0000) 2019-12-09T18:52:02.709 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:52:02.705+0000 1694f700 -1 osd.3 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:41.690429+0000 front 2019-12-09T18:50:41.689133+0000 (oldest deadline 2019-12-09T18:51:24.351712+0000) 2019-12-09T18:52:02.742 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:52:02.736+0000 1694f700 -1 osd.7 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:43.718210+0000 front 2019-12-09T18:50:43.725790+0000 (oldest deadline 2019-12-09T18:51:28.398117+0000) 2019-12-09T18:52:02.988 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:52:02.982+0000 1694f700 -1 osd.1 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.023848+0000 front 2019-12-09T18:50:41.947568+0000 (oldest deadline 2019-12-09T18:51:27.780852+0000) 2019-12-09T18:52:03.214 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:52:03.124+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 44sec e314 v314) 2019-12-09T18:52:03.214 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:52:03.181+0000 1694f700 -1 osd.0 314 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:50:42.561289+0000 front 2019-12-09T18:50:42.289207+0000 (oldest deadline 2019-12-09T18:51:25.723269+0000) 2019-12-09T18:52:03.354 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:13:01.380 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:52:03.354 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:13:01.380 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:52:03.358 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:13:01.385 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:52:03.378 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:13:01.404 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:52:03.388 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:13:01.413 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:52:03.407 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:13:01.370 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:52:03.411 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:13:01.375 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:52:03.414 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:13:01.440 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:52:03.442 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:13:01.405 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:53:02.355 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:02.348+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:03.088 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:03.083+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:03.183 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:03.177+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:03.384 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:03.379+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:03.428 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:03.422+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:03.436 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:03.432+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:03.558 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:03.553+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:03.796 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:03.791+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:04.142 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:04.136+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:04.231 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:04.225+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:04.344 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:04.338+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:04.414 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:04.410+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:04.415 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:04.410+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:04.525 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:04.521+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:04.781 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:04.776+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:05.116 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:05.111+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:05.204 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:05.198+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:05.372 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:05.363+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:05.373 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:05.365+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:05.389 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:05.385+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:05.560 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:05.556+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:05.742 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:05.737+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:06.129 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:06.124+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:06.234 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:06.228+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:06.363 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:06.356+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:06.364 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:06.358+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:06.409 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:06.402+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:06.549 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:06.544+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:06.701 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:06.694+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:07.157 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:07.151+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:07.272 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:07.266+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:07.330 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:07.325+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:07.375 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:07.369+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:07.393 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:07.386+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:07.546 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:07.540+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:07.663 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:07.659+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:08.146 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:08.140+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:08.297 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:08.291+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:08.324 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:08.317+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:08.337 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:08.331+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:08.349 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:08.342+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:08.580 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:08.575+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:08.709 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:08.704+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:09.145 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:09.140+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:09.293 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:09.287+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:09.301 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:09.294+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:09.354 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:09.349+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:09.400 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:09.394+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:09.541 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:09.535+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:09.735 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:09.731+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:10.135 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:10.130+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:10.314 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:10.308+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:10.317 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:10.311+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:10.341 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:10.335+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:10.352 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:10.345+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:10.442 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:10.435+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:10.498 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:10.493+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:10.704 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:10.698+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:11.090 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:11.085+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:11.362 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:11.355+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:11.365 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:11.362+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:11.370 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:11.364+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:11.383 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:11.376+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:11.414 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:11.403+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:11.543 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:11.538+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:11.752 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:11.747+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:12.076 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:12.071+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:12.375 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:12.369+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:12.376 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:12.371+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:12.382 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:12.376+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:12.407 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:12.401+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:12.424 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:12.417+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:12.540 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:12.534+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:12.794 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:12.789+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:13.031 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:13.026+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:13.384 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:13.378+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:13.394 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:13.389+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:13.400 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:13.394+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:13.401 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:13.393+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:13.464 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:13.458+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:13.586 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:13.580+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:13.840 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:13.835+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:14.058 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:14.053+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:14.356 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:14.350+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:14.425 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:14.420+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:14.432 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:14.424+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:14.436 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:14.428+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:14.451 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:14.445+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:14.585 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:14.580+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:14.877 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:14.871+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:15.019 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:15.010+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:15.359 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:15.353+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:15.424 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:15.416+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:15.425 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:15.418+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:15.428 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:15.420+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:15.449 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:15.443+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:15.634 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:15.629+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:15.891 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:15.885+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:16.026 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:16.021+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:16.356 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:16.350+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:16.415 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:16.408+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:16.455 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:16.446+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:16.458 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:16.450+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:16.472 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:16.465+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:16.634 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:16.630+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:16.901 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:16.897+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:17.019 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:17.012+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:17.363 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:17.357+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:17.402 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:17.396+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:17.469 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:17.462+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:17.469 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:17.461+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:17.477 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:17.465+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:17.591 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:17.586+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:17.937 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:17.933+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:18.049 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:18.044+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:18.375 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:18.369+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:18.389 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:18.382+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:18.467 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:18.461+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:18.525 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:18.517+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:18.528 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:18.521+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:18.638 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:18.633+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:18.970 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:18.966+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:19.068 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:19.063+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:19.403 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:19.398+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:19.425 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:19.421+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:19.446 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:19.441+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:19.517 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:19.510+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:19.518 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:19.513+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:19.605 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:19.600+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:19.934 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:19.929+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:20.064 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:20.058+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:20.391 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:20.385+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:20.452 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:20.447+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:20.460 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:20.454+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:20.487 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:20.479+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:20.490 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:20.483+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:20.648 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:20.644+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:20.915 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:20.910+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:21.054 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:21.048+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:21.403 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:21.398+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:21.431 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:21.426+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:21.495 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:21.490+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:21.508 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:21.501+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:21.509 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:21.504+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:21.681 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:21.676+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:21.944 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:21.938+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:22.011 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:22.006+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:22.393 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:22.388+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:22.420 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:22.415+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:22.502 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:22.497+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:22.525 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:22.518+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:22.528 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:22.521+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:22.668 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:22.664+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:22.969 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:22.963+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:23.036 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:23.031+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:23.380 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:23.375+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:23.428 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:23.423+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:23.499 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:23.491+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:23.501 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:23.495+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:23.543 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:23.539+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:23.678 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:23.673+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:24.000 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:23.994+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:24.022 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:24.017+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:24.358 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:24.353+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:24.422 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:24.416+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:24.522 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:24.516+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:24.529 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:24.523+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:24.555 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:24.548+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:24.699 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:24.695+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:25.036 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:25.032+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:25.071 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:25.066+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:25.321 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:25.315+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:25.445 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:25.440+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:25.506 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:25.498+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:25.508 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:25.503+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:25.604 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:25.599+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:25.654 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:25.649+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:26.052 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:26.047+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:26.076 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:26.070+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:26.334 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:26.329+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:26.475 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:26.471+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:26.479 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:26.474+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:26.486 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:26.480+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:26.586 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:26.581+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:26.675 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:26.669+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:27.044 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:27.039+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:27.048 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:27.042+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:27.293 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:27.287+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:27.463 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:27.455+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:27.473 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:27.459+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:27.513 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:27.508+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:27.619 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:27.614+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:27.668 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:27.663+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:28.029 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:28.024+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:28.073 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:28.068+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:28.277 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:28.272+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:28.449 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:28.444+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:28.454 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:28.449+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:28.523 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:28.519+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:28.588 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:28.583+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:28.717 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:28.711+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:29.012 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:29.008+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:29.075 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:29.070+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:29.315 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:29.309+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:29.433 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:29.425+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:29.435 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:29.429+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:29.533 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:29.527+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:29.575 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:29.569+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:29.681 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:29.676+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:30.049 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:30.045+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:30.056 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:30.051+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:30.311 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:30.304+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:30.456 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:30.451+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:30.463 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:30.457+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:30.549 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:30.543+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:30.588 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:30.582+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:30.718 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:30.712+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:31.014 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:31.009+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:31.104 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:31.097+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:31.296 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:31.291+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:31.451 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:31.446+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:31.460 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:31.454+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:31.518 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:31.513+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:31.576 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:31.570+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:31.683 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:31.678+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:32.027 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:32.022+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:32.121 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:32.116+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:32.309 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:32.304+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:32.496 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:32.491+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:32.498 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:32.493+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:32.503 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:32.498+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:32.576 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:32.571+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:32.707 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:32.701+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:33.050 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:33.045+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:33.153 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:33.147+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:33.318 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:33.312+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:33.505 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:33.500+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:33.513 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:33.507+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:33.516 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:33.511+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:33.616 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:33.611+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:33.713 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:33.709+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:34.061 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:34.055+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:34.112 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:34.108+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:34.345 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:34.340+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:34.489 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:34.482+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:34.496 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:34.488+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:34.499 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:34.492+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:34.646 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:34.640+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:34.725 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:34.720+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:35.112 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:35.106+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:35.122 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:35.118+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:35.364 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:35.360+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:35.478 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:35.473+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:35.485 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:35.479+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:35.500 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:35.496+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:35.671 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:35.664+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:35.714 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:35.708+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:36.127 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:36.122+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:36.135 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:36.131+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:36.374 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:36.369+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:36.513 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:36.505+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:36.516 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:36.509+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:36.545 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:36.531+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:36.693 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:36.687+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:36.721 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:36.716+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:37.090 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:37.085+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:37.141 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:37.135+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:37.374 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:37.367+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:37.512 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:37.505+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:37.548 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:37.542+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:37.549 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:37.544+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:37.671 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:37.665+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:37.717 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:37.712+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:38.084 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:38.076+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:38.142 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:38.137+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:38.341 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:38.331+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:38.452 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:53:38.444+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e319 v319) 2019-12-09T18:53:38.518 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:38.512+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:38.533 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:38.526+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:38.534 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:38.530+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:38.637 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:38.631+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:38.706 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:38.700+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:39.087 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:39.083+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:39.192 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:39.188+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:39.389 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:39.382+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:39.551 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:39.544+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:39.874 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:39.552+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:39.875 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:39.627+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:39.875 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:39.550+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:39.875 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:39.681+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:40.050 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:40.045+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:40.232 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:40.227+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:40.402 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:40.396+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:40.564 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:40.554+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:40.565 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:40.561+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:40.570 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:40.564+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:40.637 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:40.631+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:40.666 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:40.661+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:41.067 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:41.062+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:41.273 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:41.267+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:41.429 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:41.421+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:41.552 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:41.545+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:41.554 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:41.548+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:41.608 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:41.602+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:41.619 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:41.613+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:41.712 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:41.707+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:42.103 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:42.097+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:42.308 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:42.303+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:42.468 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:42.461+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:42.524 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:42.518+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:42.527 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:42.522+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:42.594 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:42.587+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:42.650 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:42.644+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:53:42.699 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:53:42.695+0000 1694f700 -1 osd.1 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.854572+0000 front 2019-12-09T18:52:19.733833+0000 (oldest deadline 2019-12-09T18:53:03.254114+0000) 2019-12-09T18:53:43.064 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:53:43.060+0000 1694f700 -1 osd.3 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.020352+0000 front 2019-12-09T18:52:19.725966+0000 (oldest deadline 2019-12-09T18:53:02.739485+0000) 2019-12-09T18:53:43.304 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:53:43.300+0000 1694f700 -1 osd.0 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.726886+0000 front 2019-12-09T18:52:19.725844+0000 (oldest deadline 2019-12-09T18:53:03.463149+0000) 2019-12-09T18:53:43.429 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:53:43.424+0000 1694f700 -1 osd.7 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.841892+0000 front 2019-12-09T18:52:19.757427+0000 (oldest deadline 2019-12-09T18:53:02.313425+0000) 2019-12-09T18:53:43.530 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:53:43.522+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e319 v319) 2019-12-09T18:53:43.553 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:43.550+0000 1694f700 -1 osd.2 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:52:29.937524+0000 (oldest deadline 2019-12-09T18:53:09.937524+0000) 2019-12-09T18:53:43.559 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:53:43.553+0000 1694f700 -1 osd.2 319 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e318) 2019-12-09T18:53:43.599 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:53:43.591+0000 1694f700 -1 osd.4 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:19.933725+0000 front 2019-12-09T18:52:20.280006+0000 (oldest deadline 2019-12-09T18:53:03.414818+0000) 2019-12-09T18:53:43.666 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:53:43.653+0000 1694f700 -1 osd.6 319 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:52:18.969364+0000 front 2019-12-09T18:52:19.842602+0000 (oldest deadline 2019-12-09T18:53:02.225170+0000) 2019-12-09T18:54:46.155 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:54:45.894+0000 1694f700 -1 osd.2 324 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=54 ondisk+retry+read+known_if_redirected e323) 2019-12-09T18:55:39.611 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:39.604+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:40.667 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:40.660+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:41.311 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:41.304+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:41.347 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:41.340+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:41.695 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:41.689+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:42.076 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:42.071+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:42.288 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:42.281+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:42.308 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:42.301+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:42.320 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:42.315+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:42.341 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:42.336+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:42.345 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:42.338+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:42.708 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:42.701+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:43.120 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:43.115+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:43.297 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:43.290+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:43.321 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:43.314+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:43.339 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:43.332+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:43.343 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:43.336+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:43.361 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:43.357+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:43.730 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:43.723+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:44.107 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:44.101+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:44.266 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:44.260+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:44.294 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:44.289+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:44.335 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:44.327+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:44.376 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:44.371+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:44.384 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:44.378+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:44.751 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:44.744+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:45.118 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:45.113+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:45.263 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:45.259+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:45.302 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:45.295+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:45.341 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:45.335+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:45.427 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:45.423+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:45.431 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:45.424+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:45.779 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:45.770+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:46.162 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:46.157+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:46.289 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:46.284+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:46.320 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:46.314+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:46.344 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:46.337+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:46.385 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:46.380+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:46.476 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:46.469+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:46.737 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:46.731+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:47.132 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:47.127+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:47.284 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:47.277+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:47.311 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:47.306+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:47.349 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:16:45.373 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:47.351 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:16:45.377 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:47.361 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:16:45.387 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:47.364 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:16:45.390 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:47.367 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:47.360+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:47.371 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:16:45.334 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:47.379 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:47.374+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:47.380 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:16:45.343 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:47.460 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:47.454+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:47.570 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:16:45.596 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:47.628 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:16:45.655 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:47.673 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:16:45.636 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:55:47.774 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:47.768+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:48.139 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:48.134+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:48.241 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:48.234+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:48.277 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:48.273+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:48.385 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:48.378+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:48.401 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:48.396+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:48.487 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:48.481+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:48.728 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:48.721+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:49.164 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:49.159+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:49.240 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:49.236+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:49.269 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:49.262+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:49.371 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:49.364+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:49.421 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:49.417+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:49.457 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:49.450+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:49.723 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:49.716+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:50.195 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:50.189+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:50.225 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:50.219+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:50.252 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:50.247+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:50.405 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:50.400+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:50.442 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:50.437+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:50.462 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:50.456+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:50.736 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:50.729+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:51.183 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:51.176+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:51.279 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:51.273+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:51.304 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:51.298+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:51.432 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:51.427+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:51.444 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:51.435+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:51.480 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:51.474+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:51.782 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:51.776+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:52.149 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:52.143+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:52.302 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:52.297+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:52.316 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:52.311+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:52.458 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:52.454+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:52.467 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:52.462+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:52.482 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:52.478+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:52.797 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:52.791+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:53.183 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:53.177+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:53.297 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:53.291+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:53.298 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:53.292+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:53.432 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:53.427+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:53.451 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:53.444+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:53.472 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:53.467+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:53.831 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:53.825+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:54.218 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:54.213+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:54.267 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:54.260+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:54.310 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:54.304+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:54.429 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:54.424+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:54.470 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:54.465+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:54.495 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:54.490+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:54.825 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:54.819+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:55.248 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:55.243+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:55.302 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:55.296+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:55.354 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:55.349+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:55.423 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:55.417+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:55.457 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:55.450+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:55.468 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:55.461+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:55.834 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:55.828+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:56.218 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:56.213+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:56.281 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:56.276+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:56.336 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:56.328+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:56.380 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:56.374+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:56.469 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:56.463+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:56.479 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:56.474+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:56.863 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:56.857+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:57.204 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:57.200+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:57.292 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:57.286+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:57.341 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:57.335+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:57.389 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:57.384+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:57.476 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:57.470+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:57.507 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:57.501+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:57.846 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:57.838+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:58.186 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:58.181+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:58.305 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:58.300+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:58.331 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:58.326+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:58.382 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:58.376+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:58.440 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:58.434+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:58.528 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:58.523+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:58.799 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:58.794+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:55:59.150 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:55:59.145+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:55:59.291 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:55:59.286+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:55:59.331 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:55:59.325+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:55:59.364 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:55:59.359+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:55:59.429 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:55:59.409+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:55:59.567 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:55:59.562+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:55:59.838 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:55:59.833+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:56:00.136 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:56:00.131+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:56:00.300 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:56:00.295+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:56:00.365 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:56:00.359+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:56:00.392 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:56:00.387+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:56:00.417 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:56:00.411+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:56:00.541 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:56:00.537+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:56:00.810 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:56:00.805+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:56:01.185 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:56:01.179+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:56:01.332 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:56:01.326+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:56:01.350 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:56:01.346+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:56:01.377 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:56:01.371+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:56:01.423 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:56:01.417+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:56:01.577 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:56:01.571+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:56:01.779 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:56:01.773+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:56:02.218 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:56:02.213+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:56:02.349 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:56:02.343+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:56:02.367 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:56:02.361+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:56:02.375 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:56:02.370+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:56:02.424 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:56:02.419+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:56:02.628 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:56:02.622+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:56:02.776 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:56:02.770+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:56:03.211 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:56:03.206+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:56:03.341 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:56:03.335+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:56:03.385 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:56:03.380+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:56:03.391 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:56:03.385+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:56:03.437 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:56:03.431+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:56:03.684 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:56:03.678+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:56:03.774 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:56:03.768+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:56:04.201 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:56:04.197+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:56:04.379 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:56:04.374+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:56:04.380 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:56:04.374+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:56:04.398 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:56:04.392+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:56:04.403 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:56:04.397+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:56:04.690 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:56:04.686+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:56:04.756 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:56:04.748+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:56:05.228 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:56:05.223+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:56:05.380 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:56:05.375+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:56:05.383 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:56:05.378+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:56:05.394 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:56:05.389+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:56:05.397 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:56:05.392+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:56:05.712 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:56:05.706+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:56:05.768 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:56:05.763+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:56:06.199 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:56:06.194+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:56:06.356 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:56:06.350+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:56:06.403 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:56:06.398+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:56:06.425 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:56:06.419+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:56:06.452 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:56:06.446+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:56:06.703 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:56:06.697+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:56:06.760 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:56:06.755+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:56:07.189 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:56:07.185+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:56:07.337 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:56:07.331+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:56:07.372 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:56:07.366+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:56:07.454 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:56:07.449+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:56:07.476 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:56:07.469+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:56:07.674 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:56:07.669+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:56:07.722 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:56:07.715+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:56:08.218 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:56:08.213+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:56:08.342 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:56:08.336+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:56:08.354 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:56:08.348+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:56:08.451 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:56:08.447+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:56:08.494 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:56:08.489+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:56:08.673 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:56:08.670+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:56:08.740 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:56:08.734+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:56:09.177 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:56:09.174+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:56:09.373 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:56:09.367+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:56:09.399 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:56:09.392+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:56:09.491 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:56:09.487+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:56:09.534 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:56:09.527+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:56:09.691 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:56:09.688+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:56:09.775 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:56:09.768+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:56:10.198 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:56:10.195+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:56:10.418 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:56:10.412+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:56:10.426 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:56:10.420+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:56:10.540 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:56:10.536+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:56:10.557 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:56:10.550+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:56:10.724 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:56:10.720+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:56:10.807 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:56:10.800+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:56:11.209 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:56:11.206+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:56:11.432 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:56:11.425+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:56:11.458 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:56:11.451+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:56:11.546 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:56:11.539+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:56:11.554 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:56:11.550+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:56:11.729 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:56:11.724+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:56:11.852 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:56:11.845+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:56:12.168 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:56:12.164+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:56:12.420 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:56:12.413+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:56:12.456 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:56:12.447+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:56:12.581 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:56:12.574+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:56:12.594 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:56:12.590+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:56:12.688 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:56:12.684+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:56:12.814 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:56:12.806+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:56:13.197 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:56:13.194+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:56:13.387 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:56:13.381+0000 1694f700 -1 osd.4 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.840972+0000 front 2019-12-09T18:54:58.922948+0000 (oldest deadline 2019-12-09T18:55:41.113913+0000) 2019-12-09T18:56:13.468 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:56:13.461+0000 1694f700 -1 osd.6 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.157859+0000 front 2019-12-09T18:54:56.145787+0000 (oldest deadline 2019-12-09T18:55:41.420854+0000) 2019-12-09T18:56:13.596 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:56:13.592+0000 1694f700 -1 osd.1 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.999054+0000 front 2019-12-09T18:54:58.965079+0000 (oldest deadline 2019-12-09T18:55:41.841358+0000) 2019-12-09T18:56:13.615 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:56:13.608+0000 1694f700 -1 osd.7 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:57.594919+0000 front 2019-12-09T18:54:57.638218+0000 (oldest deadline 2019-12-09T18:55:40.691639+0000) 2019-12-09T18:56:13.709 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:56:13.705+0000 1694f700 -1 osd.3 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.460417+0000 front 2019-12-09T18:54:56.433623+0000 (oldest deadline 2019-12-09T18:55:41.449184+0000) 2019-12-09T18:56:13.775 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:56:13.768+0000 1694f700 -1 osd.5 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:58.738169+0000 front 2019-12-09T18:54:58.587753+0000 (oldest deadline 2019-12-09T18:55:39.050751+0000) 2019-12-09T18:56:14.149 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:56:14.144+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 41sec e324 v324) 2019-12-09T18:56:14.226 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:56:14.221+0000 1694f700 -1 osd.0 324 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:54:56.543892+0000 front 2019-12-09T18:54:56.542609+0000 (oldest deadline 2019-12-09T18:55:41.214793+0000) 2019-12-09T18:57:09.622 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:09.617+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:10.584 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:10.579+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:11.551 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:11.546+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:12.005 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:12.001+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:12.389 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:12.385+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:12.609 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:12.602+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:12.649 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:12.643+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:13.050 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:13.044+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:13.164 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:13.160+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:13.399 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:13.393+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:13.596 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:13.591+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:13.637 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:13.632+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:13.646 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:13.642+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:14.071 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:14.065+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:14.186 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:14.181+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:14.450 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:14.446+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:14.556 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:14.552+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:14.645 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:14.640+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:14.694 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:14.677+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:15.099 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:15.095+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:15.147 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:15.141+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:15.407 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:15.403+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:15.607 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:15.601+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:15.611 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:15.605+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:15.687 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:15.681+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:16.073 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:16.068+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:16.116 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:16.111+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:16.379 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:16.375+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:16.575 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:16.570+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:16.600 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:16.595+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:16.701 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:16.695+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:17.102 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:17.098+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:17.119 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:17.114+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:17.437 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:17.429+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:17.582 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:17.577+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:17.600 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:17.595+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:17.719 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:17.714+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:18.068 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:18.063+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:18.146 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:18.142+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:18.438 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:18.432+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:18.584 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:18.579+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:18.604 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:18.600+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:18.735 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:18.729+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:19.114 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:19.109+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:19.165 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:19.160+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:19.405 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:19.400+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:19.635 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:19.629+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:19.653 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:19.649+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:19.714 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:19.708+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:19.782 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:19.779+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:20.076 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:20.071+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:20.217 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:20.212+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:20.456 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:20.452+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:20.630 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:20.627+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:20.686 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:20.681+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:20.746 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:20.741+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:20.753 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:20.750+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:21.113 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:21.109+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:21.200 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:21.196+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:21.439 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:21.436+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:21.633 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:21.629+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:21.657 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:21.653+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:21.788 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:21.782+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:21.792 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:21.786+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:22.120 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:22.115+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:22.198 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:22.193+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:22.458 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:22.453+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:22.616 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:22.602+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:22.629 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:22.625+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:22.751 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:22.745+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:22.825 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:22.819+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:23.085 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:23.081+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:23.166 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:23.160+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:23.494 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:23.489+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:23.574 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:23.570+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:23.640 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:23.636+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:23.733 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:23.727+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:23.843 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:23.837+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:24.134 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:24.127+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:24.138 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:24.133+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:24.530 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:24.526+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:24.538 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:24.534+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:24.677 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:24.673+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:24.725 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:24.720+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:24.891 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:24.886+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:25.159 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:25.153+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:25.188 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:25.182+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:25.549 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:25.545+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:25.571 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:25.568+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:25.702 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:25.695+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:25.705 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:25.699+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:25.725 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:25.722+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:25.851 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:25.845+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:26.173 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:26.168+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:26.222 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:26.216+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:26.527 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:26.524+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:26.571 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:26.567+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:26.697 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:26.694+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:26.727 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:26.718+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:26.728 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:26.723+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:26.900 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:26.893+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:27.178 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:27.173+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:27.276 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:27.270+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:27.513 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:27.507+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:27.573 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:27.568+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:27.747 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:27.742+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:27.756 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:27.752+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:27.762 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:27.756+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:27.905 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:27.899+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:28.206 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:28.200+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:28.291 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:28.286+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:28.529 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:28.524+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:28.596 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:28.592+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:28.720 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:28.714+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:28.721 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:28.716+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:28.773 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:28.768+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:28.939 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:28.932+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:29.170 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:29.163+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:29.289 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:29.282+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:29.518 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:29.513+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:29.605 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:29.599+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:29.735 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:29.727+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:29.738 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:29.732+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:29.798 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:29.792+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:29.965 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:29.959+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:30.204 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:30.198+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:30.296 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:30.290+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:30.553 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:30.549+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:30.651 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:30.645+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:30.709 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:30.702+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:30.713 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:30.705+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:30.793 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:30.788+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:30.969 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:30.962+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:31.221 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:31.212+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:31.309 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:31.298+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:31.540 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:31.536+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:31.676 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:31.670+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:31.748 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:31.741+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:31.750 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:31.744+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:31.824 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:31.819+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:31.984 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:31.978+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:32.259 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:32.253+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:32.329 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:32.323+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:32.575 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:32.570+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:32.632 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:32.628+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:32.736 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:32.731+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:32.745 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:32.739+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:32.811 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:32.806+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:32.963 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:32.957+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:33.276 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:33.267+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:33.356 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:33.350+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:33.541 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:33.535+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:33.669 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:33.664+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:33.749 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:33.744+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:33.755 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:33.748+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:33.832 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:33.827+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:33.925 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:33.919+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:34.309 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:34.302+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:34.391 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:34.385+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:34.585 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:34.581+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:34.650 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:34.646+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:34.779 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:34.774+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:34.781 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:34.775+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:34.824 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:34.820+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:34.974 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:34.968+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:35.295 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:35.289+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:35.399 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:35.393+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:35.631 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:35.626+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:35.692 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:35.686+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:35.809 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:35.801+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:35.810 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:35.805+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:35.866 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:35.861+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:36.006 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:36.000+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:36.292 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:36.285+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:36.356 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:36.350+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:36.683 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:36.676+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:36.704 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:36.699+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:36.815 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:36.808+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:36.816 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:36.812+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:36.888 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:36.883+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:37.006 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:37.000+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:37.289 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:37.284+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:37.377 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:37.371+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:37.710 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:37.705+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:37.725 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:37.720+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:37.772 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:37.765+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:37.776 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:37.768+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:37.902 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:37.898+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:38.026 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:38.020+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:38.322 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:38.315+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:38.422 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:38.417+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:38.678 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:38.674+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:38.724 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:38.719+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:38.735 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:38.730+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:38.740 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:38.734+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:38.948 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:38.943+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:39.017 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:39.010+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:39.320 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:39.314+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:39.447 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:39.438+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:39.645 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:39.640+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:39.734 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:39.729+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:39.774 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:39.767+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:39.776 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:39.771+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:39.968 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:39.963+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:40.064 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:40.057+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:40.316 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:40.310+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:40.470 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:40.464+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:40.692 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:40.688+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:40.760 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:40.755+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:40.761 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:40.756+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:40.769 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:40.763+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:41.023 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:41.018+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:41.068 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:41.062+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:41.364 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:41.355+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:41.479 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:41.472+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:41.720 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:41.715+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:41.728 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:41.724+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:41.767 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:41.760+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:41.775 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:41.769+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:42.035 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:42.029+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:42.122 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:42.116+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:42.358 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:42.351+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:42.484 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:42.478+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:42.724 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:42.720+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:42.780 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:42.775+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:42.811 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:42.804+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:42.813 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:42.808+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:42.997 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:42.993+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:43.158 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:43.152+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:43.318 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:43.312+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:43.470 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:43.464+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:43.687 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:43.682+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:43.773 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:43.768+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:43.793 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:43.785+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:43.795 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:43.789+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:44.050 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:44.044+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:44.124 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:44.119+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:44.314 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:44.309+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:44.428 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:44.423+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:44.445 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:57:44.439+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e329 v329) 2019-12-09T18:57:44.666 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:44.662+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:44.763 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:44.757+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:44.769 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:44.763+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:44.788 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:44.782+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:45.074 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:45.069+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:45.127 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:45.121+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:45.318 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:45.313+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:45.414 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:45.409+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:45.706 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:45.700+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:45.769 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:45.763+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:45.810 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:45.805+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:45.815 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:45.809+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:46.085 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:46.080+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:46.122 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:46.117+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:46.315 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:46.310+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:46.397 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:46.391+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:46.665 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:46.660+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:46.765 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:46.760+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:46.804 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:46.800+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:46.810 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:46.805+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:47.131 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:47.127+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:47.157 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:47.152+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:47.353 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:47.347+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:47.355 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:47.350+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:47.650 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:47.645+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:47.765 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:47.760+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:47.769 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:47.761+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:47.771 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:47.765+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:48.184 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:48.179+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:48.186 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:48.182+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:48.352 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:48.347+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:48.408 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:48.403+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:48.613 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:48.608+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:48.800 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:48.795+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:48.817 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:48.813+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:48.824 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:48.818+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:49.169 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:49.165+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:49.226 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:49.222+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:49.337 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:49.333+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:49.407 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:49.402+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:49.465 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:57:49.459+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e329 v329) 2019-12-09T18:57:49.600 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:49.596+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:49.783 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:49.775+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:49.786 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:49.779+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:49.804 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:49.798+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:50.184 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:50.180+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:50.216 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:50.212+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:50.310 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:50.305+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:50.367 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:50.362+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:50.602 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:50.596+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:50.788 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:50.784+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:50.833 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:50.828+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:50.834 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:50.830+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:51.196 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:51.190+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:51.242 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:51.237+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:51.285 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:51.280+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:51.396 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:51.390+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:51.592 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:51.585+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:51.810 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:51.806+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:51.839 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:51.833+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:51.841 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:51.836+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:52.168 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:52.163+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:52.235 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:52.231+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:52.249 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:52.245+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:52.366 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:52.360+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:52.625 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:52.620+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:52.813 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:52.808+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:52.839 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:52.832+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:52.842 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:52.835+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:53.145 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:53.141+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:53.256 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:53.251+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:53.269 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:53.265+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:53.417 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:53.411+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:53.610 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:53.605+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:53.807 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:53.801+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:53.844 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:53.837+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:53.847 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:53.839+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:54.122 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:54.117+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:54.271 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:54.265+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:54.274 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:54.269+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:54.376 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:54.371+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:54.489 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:57:54.482+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e329 v329) 2019-12-09T18:57:54.645 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:54.641+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:54.781 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:54.777+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:54.896 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:54.892+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:54.909 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:54.895+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:55.161 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:55.157+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:55.255 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:55.250+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:55.281 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:55.276+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:55.390 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:55.385+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:55.623 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:55.617+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:55.785 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:55.779+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:55.864 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:55.859+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:55.870 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:55.864+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:56.122 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:56.117+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:56.287 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:56.282+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:56.329 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:56.323+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:56.383 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:56.372+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:56.589 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:56.585+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:56.833 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:56.828+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:56.859 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:56.852+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:56.861 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:56.855+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:57.148 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:57.143+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:57.266 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:57.261+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:57.328 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:57.322+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:57.377 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:57.372+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:57.551 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:57.547+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:57.808 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:57.803+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:57.876 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:57.868+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:57.878 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:57.872+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:58.125 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:58.121+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:58.267 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:58.262+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:58.366 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:58.360+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:58.413 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:58.407+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:58.537 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:58.532+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:58.800 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:58.795+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:57:58.906 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:58.898+0000 1694f700 -1 osd.2 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 ever on either front or back, first ping sent 2019-12-09T18:56:45.402881+0000 (oldest deadline 2019-12-09T18:57:25.402881+0000) 2019-12-09T18:57:58.913 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:57:58.903+0000 1694f700 -1 osd.2 329 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:57:59.165 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:57:59.161+0000 1694f700 -1 osd.3 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:30.891462+0000 front 2019-12-09T18:56:30.863720+0000 (oldest deadline 2019-12-09T18:57:13.582382+0000) 2019-12-09T18:57:59.277 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:57:59.272+0000 1694f700 -1 osd.4 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.805487+0000 front 2019-12-09T18:56:29.808897+0000 (oldest deadline 2019-12-09T18:57:11.776289+0000) 2019-12-09T18:57:59.399 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:57:59.393+0000 1694f700 -1 osd.6 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.594032+0000 front 2019-12-09T18:56:27.885886+0000 (oldest deadline 2019-12-09T18:57:11.166147+0000) 2019-12-09T18:57:59.459 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:57:59.454+0000 1694f700 -1 osd.7 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.805893+0000 front 2019-12-09T18:56:29.803170+0000 (oldest deadline 2019-12-09T18:57:12.863170+0000) 2019-12-09T18:57:59.550 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T18:57:59.546+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e329 v329) 2019-12-09T18:57:59.566 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:57:59.562+0000 1694f700 -1 osd.1 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:29.436024+0000 front 2019-12-09T18:56:29.434611+0000 (oldest deadline 2019-12-09T18:57:12.285710+0000) 2019-12-09T18:57:59.838 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:57:59.834+0000 1694f700 -1 osd.0 329 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T18:56:27.287547+0000 front 2019-12-09T18:56:29.819142+0000 (oldest deadline 2019-12-09T18:57:09.142625+0000) 2019-12-09T18:58:00.073 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:58:00.058+0000 1694f700 -1 osd.2 330 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4358.0:130671 7.c 7.4c46427c (undecoded) ondisk+retry+read+known_if_redirected e328) 2019-12-09T18:58:57.684 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T18:58:57.250+0000 1694f700 -1 osd.2 334 get_health_metrics reporting 26 slow ops, oldest is osd_op(client.4530.0:120099 7.c 7:3a0daaa6:::2019-12-09-18-a55fd90f-db62-40cd-9264-5916c91f1695.4358.631-a47cb22a28624be88843ef6efd1db7d7:head [append 0~516 in=516b] snapc 0=[] RETRY=44 ondisk+retry+write+known_if_redirected e333) 2019-12-09T18:59:49.207 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:59:49.204+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T18:59:50.241 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:59:50.237+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T18:59:50.362 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:59:50.353+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T18:59:51.248 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:59:51.244+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T18:59:51.394 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:59:51.387+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T18:59:52.256 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:59:52.253+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T18:59:52.361 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:59:52.355+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T18:59:52.989 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:59:52.982+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T18:59:53.143 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:59:53.140+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T18:59:53.293 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:59:53.291+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T18:59:53.344 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:59:53.338+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T18:59:53.456 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:59:53.451+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T18:59:53.565 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:59:53.559+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T18:59:53.603 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:59:53.597+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T18:59:53.948 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:59:53.942+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T18:59:54.183 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:59:54.179+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T18:59:54.297 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:59:54.293+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T18:59:54.300 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:59:54.295+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T18:59:54.445 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:59:54.440+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T18:59:54.612 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:59:54.606+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T18:59:54.619 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:59:54.611+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T18:59:54.952 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:59:54.944+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T18:59:55.229 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:59:55.224+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T18:59:55.299 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:59:55.292+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T18:59:55.327 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:59:55.322+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T18:59:55.417 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:59:55.413+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T18:59:55.598 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:59:55.591+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T18:59:55.606 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:59:55.600+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T18:59:55.954 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:59:55.947+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T18:59:56.224 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:59:56.220+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T18:59:56.335 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:59:56.328+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T18:59:56.341 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:59:56.336+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T18:59:56.402 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:59:56.397+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T18:59:56.635 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:59:56.624+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T18:59:56.654 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:59:56.648+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T18:59:56.983 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:59:56.976+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T18:59:57.130 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:20:55.157 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:59:57.136 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:20:55.163 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:59:57.145 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:20:55.171 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:59:57.148 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:20:55.175 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:59:57.162 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:20:55.125 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:59:57.174 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:20:55.135 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:59:57.245 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:59:57.240+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T18:59:57.357 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:59:57.352+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T18:59:57.365 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:59:57.359+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T18:59:57.373 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:59:57.368+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T18:59:57.381 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:20:55.408 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T18:59:57.387 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:20:55.414 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T18:59:57.446 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:20:55.409 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T18:59:57.600 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:59:57.593+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T18:59:57.662 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:59:57.656+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T18:59:57.969 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:59:57.959+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T18:59:58.220 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:59:58.215+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T18:59:58.352 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:59:58.341+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T18:59:58.372 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:59:58.368+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T18:59:58.396 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:59:58.391+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T18:59:58.577 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:59:58.571+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T18:59:58.628 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:59:58.621+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T18:59:58.937 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:59:58.931+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T18:59:59.244 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T18:59:59.239+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T18:59:59.334 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T18:59:59.327+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T18:59:59.349 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T18:59:59.343+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T18:59:59.411 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T18:59:59.406+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T18:59:59.596 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T18:59:59.589+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T18:59:59.631 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T18:59:59.623+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T18:59:59.905 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T18:59:59.898+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:00.217 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:00.208+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:00.295 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:00.289+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:00.366 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:00.362+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:00.421 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:00.416+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:00.596 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:00.590+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:00.617 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:00.609+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:00.924 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:00.918+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:01.173 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:01.169+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:01.337 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:01.330+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:01.344 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:01.340+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:01.403 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:01.399+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:01.611 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:01.604+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:01.644 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:01.637+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:01.925 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:01.918+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:02.218 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:02.214+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:02.351 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:02.347+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:02.376 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:02.369+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:02.406 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:02.401+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:02.641 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:02.633+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:02.643 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:02.635+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:02.927 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:02.920+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:03.211 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:03.206+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:03.317 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:03.312+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:03.338 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:03.331+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:03.435 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:03.429+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:03.612 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:03.606+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:03.656 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:03.645+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:03.921 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:03.914+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:04.178 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:04.171+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:04.348 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:04.343+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:04.373 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:04.367+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:04.425 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:04.420+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:04.657 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:04.650+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:04.670 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:04.662+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:04.900 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:04.893+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:05.190 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:05.186+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:05.315 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:05.309+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:05.369 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:05.362+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:05.413 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:05.408+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:05.674 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:05.668+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:05.725 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:05.718+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:05.927 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:05.921+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:06.243 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:06.238+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:06.334 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:06.330+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:06.375 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:06.369+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:06.455 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:06.451+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:06.682 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:06.675+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:06.708 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:06.702+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:06.928 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:06.922+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:07.264 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:07.258+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:07.371 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:07.366+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:07.385 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:07.379+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:07.501 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:07.497+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:07.693 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:07.686+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:07.734 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:07.727+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:07.947 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:07.940+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:08.265 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:08.257+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:08.374 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:08.367+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:08.415 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:08.409+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:08.545 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:08.537+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:08.712 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:08.705+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:08.789 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:08.780+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:08.936 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:08.930+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:09.225 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:09.220+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:09.355 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:09.349+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:09.469 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:09.462+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:09.565 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:09.561+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:09.713 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:09.705+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:09.791 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:09.784+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:09.935 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:09.928+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:10.231 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:10.226+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:10.353 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:10.346+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:10.442 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:10.437+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:10.614 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:10.609+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:10.698 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:10.691+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:10.834 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:10.827+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:10.978 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:10.971+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:11.283 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:11.278+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:11.314 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:11.307+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:11.407 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:11.401+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:11.598 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:11.592+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:11.698 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:11.692+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:11.869 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:11.863+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:11.982 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:11.972+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:12.265 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:12.259+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:12.298 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:12.292+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:12.384 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:12.380+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:12.577 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:12.572+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:12.689 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:12.683+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:12.917 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:12.910+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:12.961 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:12.954+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:13.303 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:13.297+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:13.306 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:13.300+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:13.411 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:13.406+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:13.592 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:13.586+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:13.657 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:13.650+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:13.920 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:13.913+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:13.950 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:13.942+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:14.292 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:14.285+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:14.356 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:14.350+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:14.404 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:14.399+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:14.625 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:14.620+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:14.655 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:14.647+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:14.896 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:14.889+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:14.972 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:14.966+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:15.343 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:15.336+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:15.407 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:15.402+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:15.437 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:15.431+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:15.647 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:15.643+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:15.680 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:15.675+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:15.898 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:15.893+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:15.977 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:15.971+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:16.346 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:16.341+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:16.395 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:16.389+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:16.415 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:16.410+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:16.626 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:16.621+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:16.657 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:16.652+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:16.858 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:16.853+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:17.004 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:16.998+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:17.381 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:17.374+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:17.390 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:17.385+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:17.450 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:17.446+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:17.592 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:17.586+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:17.631 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:17.626+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:17.852 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:17.846+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:18.042 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:18.036+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:18.367 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:18.361+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:18.434 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:18.428+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:18.435 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:18.429+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:18.640 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:18.635+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:18.649 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:18.643+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:18.860 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:18.854+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:19.064 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:19.058+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:19.413 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:19.408+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:19.416 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:19.411+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:19.487 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:19.482+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:19.637 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:19.633+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:19.660 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:19.656+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:19.823 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:19.816+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:20.054 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:20.048+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:20.065 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:00:20.060+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.121:6824/9952,v1:172.21.15.121:6825/9952] for 40sec e334 v334) 2019-12-09T19:00:20.086 INFO:tasks.ceph.osd.2.smithi121.stderr:*** Caught signal (Segmentation fault) ** 2019-12-09T19:00:20.087 INFO:tasks.ceph.osd.2.smithi121.stderr: in thread 124b0700 thread_name:msgr-worker-2 2019-12-09T19:00:20.385 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:20.378+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:20.403 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:20.396+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:20.498 INFO:tasks.ceph.osd.2.smithi121.stderr: ceph version 15.0.0-7900-g1351c81 (1351c819e1a9518cde4c8b12d645782009028360) octopus (dev) 2019-12-09T19:00:20.498 INFO:tasks.ceph.osd.2.smithi121.stderr: 1: (()+0xf5f0) [0xc09e5f0] 2019-12-09T19:00:20.498 INFO:tasks.ceph.osd.2.smithi121.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe8a9b1] 2019-12-09T19:00:20.498 INFO:tasks.ceph.osd.2.smithi121.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100d020] 2019-12-09T19:00:20.499 INFO:tasks.ceph.osd.2.smithi121.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1019dc3] 2019-12-09T19:00:20.499 INFO:tasks.ceph.osd.2.smithi121.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x101a040] 2019-12-09T19:00:20.499 INFO:tasks.ceph.osd.2.smithi121.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101a59d] 2019-12-09T19:00:20.499 INFO:tasks.ceph.osd.2.smithi121.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1003224] 2019-12-09T19:00:20.499 INFO:tasks.ceph.osd.2.smithi121.stderr: 8: (AsyncConnection::process()+0x794) [0xfdd874] 2019-12-09T19:00:20.499 INFO:tasks.ceph.osd.2.smithi121.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3dd55] 2019-12-09T19:00:20.499 INFO:tasks.ceph.osd.2.smithi121.stderr: 10: (()+0xd3b767) [0xe43767] 2019-12-09T19:00:20.500 INFO:tasks.ceph.osd.2.smithi121.stderr: 11: (()+0x121504f) [0x131d04f] 2019-12-09T19:00:20.500 INFO:tasks.ceph.osd.2.smithi121.stderr: 12: (()+0x7e65) [0xc096e65] 2019-12-09T19:00:20.500 INFO:tasks.ceph.osd.2.smithi121.stderr: 13: (clone()+0x6d) [0xd20e88d] 2019-12-09T19:00:20.518 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:20.513+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:20.651 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:20.647+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:20.693 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:20.687+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:20.746 INFO:tasks.ceph.osd.2.smithi121.stderr:2019-12-09T19:00:20.622+0000 124b0700 -1 *** Caught signal (Segmentation fault) ** 2019-12-09T19:00:20.746 INFO:tasks.ceph.osd.2.smithi121.stderr: in thread 124b0700 thread_name:msgr-worker-2 2019-12-09T19:00:20.747 INFO:tasks.ceph.osd.2.smithi121.stderr: 2019-12-09T19:00:20.747 INFO:tasks.ceph.osd.2.smithi121.stderr: ceph version 15.0.0-7900-g1351c81 (1351c819e1a9518cde4c8b12d645782009028360) octopus (dev) 2019-12-09T19:00:20.747 INFO:tasks.ceph.osd.2.smithi121.stderr: 1: (()+0xf5f0) [0xc09e5f0] 2019-12-09T19:00:20.747 INFO:tasks.ceph.osd.2.smithi121.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe8a9b1] 2019-12-09T19:00:20.747 INFO:tasks.ceph.osd.2.smithi121.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100d020] 2019-12-09T19:00:20.747 INFO:tasks.ceph.osd.2.smithi121.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1019dc3] 2019-12-09T19:00:20.747 INFO:tasks.ceph.osd.2.smithi121.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x101a040] 2019-12-09T19:00:20.748 INFO:tasks.ceph.osd.2.smithi121.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101a59d] 2019-12-09T19:00:20.748 INFO:tasks.ceph.osd.2.smithi121.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1003224] 2019-12-09T19:00:20.748 INFO:tasks.ceph.osd.2.smithi121.stderr: 8: (AsyncConnection::process()+0x794) [0xfdd874] 2019-12-09T19:00:20.748 INFO:tasks.ceph.osd.2.smithi121.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3dd55] 2019-12-09T19:00:20.748 INFO:tasks.ceph.osd.2.smithi121.stderr: 10: (()+0xd3b767) [0xe43767] 2019-12-09T19:00:20.748 INFO:tasks.ceph.osd.2.smithi121.stderr: 11: (()+0x121504f) [0x131d04f] 2019-12-09T19:00:20.748 INFO:tasks.ceph.osd.2.smithi121.stderr: 12: (()+0x7e65) [0xc096e65] 2019-12-09T19:00:20.749 INFO:tasks.ceph.osd.2.smithi121.stderr: 13: (clone()+0x6d) [0xd20e88d] 2019-12-09T19:00:20.749 INFO:tasks.ceph.osd.2.smithi121.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-09T19:00:20.759 INFO:tasks.ceph.osd.2.smithi121.stderr: 2019-12-09T19:00:20.869 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:20.864+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:21.092 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:21.080+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:21.362 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:21.355+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:21.381 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:21.376+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:21.523 INFO:tasks.ceph.osd.2.smithi121.stderr: -1247> 2019-12-09T19:00:20.622+0000 124b0700 -1 *** Caught signal (Segmentation fault) ** 2019-12-09T19:00:21.523 INFO:tasks.ceph.osd.2.smithi121.stderr: in thread 124b0700 thread_name:msgr-worker-2 2019-12-09T19:00:21.523 INFO:tasks.ceph.osd.2.smithi121.stderr: 2019-12-09T19:00:21.524 INFO:tasks.ceph.osd.2.smithi121.stderr: ceph version 15.0.0-7900-g1351c81 (1351c819e1a9518cde4c8b12d645782009028360) octopus (dev) 2019-12-09T19:00:21.524 INFO:tasks.ceph.osd.2.smithi121.stderr: 1: (()+0xf5f0) [0xc09e5f0] 2019-12-09T19:00:21.524 INFO:tasks.ceph.osd.2.smithi121.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe8a9b1] 2019-12-09T19:00:21.524 INFO:tasks.ceph.osd.2.smithi121.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100d020] 2019-12-09T19:00:21.524 INFO:tasks.ceph.osd.2.smithi121.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1019dc3] 2019-12-09T19:00:21.524 INFO:tasks.ceph.osd.2.smithi121.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x101a040] 2019-12-09T19:00:21.524 INFO:tasks.ceph.osd.2.smithi121.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101a59d] 2019-12-09T19:00:21.525 INFO:tasks.ceph.osd.2.smithi121.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1003224] 2019-12-09T19:00:21.525 INFO:tasks.ceph.osd.2.smithi121.stderr: 8: (AsyncConnection::process()+0x794) [0xfdd874] 2019-12-09T19:00:21.525 INFO:tasks.ceph.osd.2.smithi121.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3dd55] 2019-12-09T19:00:21.525 INFO:tasks.ceph.osd.2.smithi121.stderr: 10: (()+0xd3b767) [0xe43767] 2019-12-09T19:00:21.525 INFO:tasks.ceph.osd.2.smithi121.stderr: 11: (()+0x121504f) [0x131d04f] 2019-12-09T19:00:21.525 INFO:tasks.ceph.osd.2.smithi121.stderr: 12: (()+0x7e65) [0xc096e65] 2019-12-09T19:00:21.526 INFO:tasks.ceph.osd.2.smithi121.stderr: 13: (clone()+0x6d) [0xd20e88d] 2019-12-09T19:00:21.526 INFO:tasks.ceph.osd.2.smithi121.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-09T19:00:21.526 INFO:tasks.ceph.osd.2.smithi121.stderr: 2019-12-09T19:00:21.527 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:21.521+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:21.684 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:21.679+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:21.693 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:21.687+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:21.907 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:21.902+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:21.909 INFO:tasks.ceph.osd.2.smithi121.stderr: -1306> 2019-12-09T19:00:20.622+0000 124b0700 -1 *** Caught signal (Segmentation fault) ** 2019-12-09T19:00:21.910 INFO:tasks.ceph.osd.2.smithi121.stderr: in thread 124b0700 thread_name:msgr-worker-2 2019-12-09T19:00:21.910 INFO:tasks.ceph.osd.2.smithi121.stderr: 2019-12-09T19:00:21.910 INFO:tasks.ceph.osd.2.smithi121.stderr: ceph version 15.0.0-7900-g1351c81 (1351c819e1a9518cde4c8b12d645782009028360) octopus (dev) 2019-12-09T19:00:21.910 INFO:tasks.ceph.osd.2.smithi121.stderr: 1: (()+0xf5f0) [0xc09e5f0] 2019-12-09T19:00:21.910 INFO:tasks.ceph.osd.2.smithi121.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe8a9b1] 2019-12-09T19:00:21.910 INFO:tasks.ceph.osd.2.smithi121.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100d020] 2019-12-09T19:00:21.910 INFO:tasks.ceph.osd.2.smithi121.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1019dc3] 2019-12-09T19:00:21.911 INFO:tasks.ceph.osd.2.smithi121.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x101a040] 2019-12-09T19:00:21.911 INFO:tasks.ceph.osd.2.smithi121.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101a59d] 2019-12-09T19:00:21.911 INFO:tasks.ceph.osd.2.smithi121.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1003224] 2019-12-09T19:00:21.911 INFO:tasks.ceph.osd.2.smithi121.stderr: 8: (AsyncConnection::process()+0x794) [0xfdd874] 2019-12-09T19:00:21.911 INFO:tasks.ceph.osd.2.smithi121.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3dd55] 2019-12-09T19:00:21.911 INFO:tasks.ceph.osd.2.smithi121.stderr: 10: (()+0xd3b767) [0xe43767] 2019-12-09T19:00:21.911 INFO:tasks.ceph.osd.2.smithi121.stderr: 11: (()+0x121504f) [0x131d04f] 2019-12-09T19:00:21.912 INFO:tasks.ceph.osd.2.smithi121.stderr: 12: (()+0x7e65) [0xc096e65] 2019-12-09T19:00:21.912 INFO:tasks.ceph.osd.2.smithi121.stderr: 13: (clone()+0x6d) [0xd20e88d] 2019-12-09T19:00:21.912 INFO:tasks.ceph.osd.2.smithi121.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-09T19:00:21.912 INFO:tasks.ceph.osd.2.smithi121.stderr: 2019-12-09T19:00:22.105 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:22.099+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:22.387 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:22.382+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:22.411 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:22.405+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:22.497 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:22.491+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:22.648 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:22.642+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:22.651 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:22.646+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:22.901 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:22.896+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:23.105 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:23.100+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:23.373 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:23.368+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:23.391 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:23.385+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:23.456 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:23.447+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:23.612 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:23.606+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:23.700 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:00:23.693+0000 1694f700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801343+0000 front 2019-12-09T18:59:07.666341+0000 (oldest deadline 2019-12-09T18:59:53.383513+0000) 2019-12-09T19:00:23.950 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:00:23.944+0000 1694f700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.013406+0000 front 2019-12-09T18:59:08.690492+0000 (oldest deadline 2019-12-09T18:59:53.206763+0000) 2019-12-09T19:00:24.091 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:00:24.085+0000 1694f700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.850802+0000 front 2019-12-09T18:59:08.848955+0000 (oldest deadline 2019-12-09T18:59:52.728815+0000) 2019-12-09T19:00:24.370 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:00:24.364+0000 1694f700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:06.826904+0000 front 2019-12-09T18:59:06.837102+0000 (oldest deadline 2019-12-09T18:59:50.312225+0000) 2019-12-09T19:00:24.392 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:00:24.386+0000 1694f700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:07.017723+0000 front 2019-12-09T18:59:07.308279+0000 (oldest deadline 2019-12-09T18:59:52.293505+0000) 2019-12-09T19:00:24.430 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:00:24.420+0000 1694f700 -1 osd.0 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.011883+0000 front 2019-12-09T18:59:08.355150+0000 (oldest deadline 2019-12-09T18:59:53.090120+0000) 2019-12-09T19:00:24.578 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:00:24.574+0000 1694f700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.121:6828 osd.2 since back 2019-12-09T18:59:08.801933+0000 front 2019-12-09T18:59:08.803719+0000 (oldest deadline 2019-12-09T18:59:49.140441+0000) 2019-12-09T19:00:24.824 INFO:tasks.ceph.osd.2.smithi121.stderr:daemon-helper: command crashed with signal 11 2019-12-09T19:00:27.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2019-12-09T19:00:30.343 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:21:28.370 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:00:30.351 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:21:28.378 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:00:30.394 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:21:28.358 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:00:30.400 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:21:28.363 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:00:30.409 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:21:28.436 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:00:30.423 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:21:28.450 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:00:30.433 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:21:28.459 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:00:30.476 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:21:28.439 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:00:30.476 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:21:28.502 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:00:33.879 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2019-12-09T19:00:40.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~13s 2019-12-09T19:00:46.502 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~19s 2019-12-09T19:00:52.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~25s 2019-12-09T19:00:59.134 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~32s 2019-12-09T19:01:05.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~38s 2019-12-09T19:01:11.761 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~44s 2019-12-09T19:01:18.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~51s 2019-12-09T19:01:21.054 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:21.049+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:21.567 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:21.562+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:22.043 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:22.039+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:22.603 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:22.598+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:22.832 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:22.827+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:23.035 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:23.030+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:23.097 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:23.090+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:23.577 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:23.572+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:23.854 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:23.846+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:24.020 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:24.016+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:24.100 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:24.093+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:24.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~57s 2019-12-09T19:01:24.559 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:24.554+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:24.885 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:24.879+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:25.074 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:25.068+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:25.082 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:25.075+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:25.443 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:25.436+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:25.534 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:25.529+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:25.907 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:25.902+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:26.067 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:26.062+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:26.108 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:26.102+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:26.117 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:26.110+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:26.448 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:26.441+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:26.514 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:26.510+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:26.869 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:26.862+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:27.073 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:27.067+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:27.084 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:27.079+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:27.117 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:27.111+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:27.402 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:27.396+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:27.531 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:27.526+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:27.911 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:27.902+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:28.045 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:28.039+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:28.065 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:28.060+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:28.078 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:28.072+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:28.391 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:28.385+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:28.559 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:28.553+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:28.952 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:28.945+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:29.059 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:29.053+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:29.113 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:29.103+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:29.120 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:29.115+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:29.383 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:29.377+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:29.587 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:29.582+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:29.938 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:29.933+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:30.116 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:30.110+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:30.133 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:30.127+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:30.139 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:30.134+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:30.416 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:30.408+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:30.623 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:30.619+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:30.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~63s 2019-12-09T19:01:30.935 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:30.930+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:31.095 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:31.089+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:31.096 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:31.091+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:31.102 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:31.097+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:31.415 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:31.410+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:31.647 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:31.642+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:31.981 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:31.974+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:32.087 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:32.083+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:32.114 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:32.109+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:32.133 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:32.129+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:32.398 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:32.393+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:32.695 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:32.690+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:33.028 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:33.023+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:33.106 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:33.101+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:33.130 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:33.126+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:33.137 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:33.133+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:33.452 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:33.447+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:33.689 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:33.684+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:34.016 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:34.011+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:34.153 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:34.148+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:34.159 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:34.154+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:34.160 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:34.155+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:34.465 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:34.460+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:34.703 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:34.699+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:35.016 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:35.012+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:35.135 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:35.130+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:35.191 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:35.186+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:35.209 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:35.205+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:35.459 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:35.455+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:35.691 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:35.686+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:36.067 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:36.061+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:36.122 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:36.117+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:36.184 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:36.179+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:36.203 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:36.197+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:36.508 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:36.503+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:36.724 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:36.719+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:37.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~69s 2019-12-09T19:01:37.057 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:37.051+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:37.170 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:37.165+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:37.173 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:37.167+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:37.176 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:37.171+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:37.475 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:37.469+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:37.726 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:37.720+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:38.129 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:38.118+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:38.149 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:38.144+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:38.203 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:38.199+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:38.218 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:38.214+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:38.463 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:38.458+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:38.764 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:38.759+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:39.132 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:39.128+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:39.179 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:39.174+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:39.213 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:39.208+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:39.234 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:39.230+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:39.427 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:39.421+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:39.801 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:39.796+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:40.129 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:40.124+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:40.143 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:40.139+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:40.221 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:40.216+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:40.252 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:40.246+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:40.394 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:40.389+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:40.761 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:40.755+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:41.151 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:41.145+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:41.158 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:41.153+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:41.208 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:41.203+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:41.303 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:41.298+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:41.408 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:41.403+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:41.767 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:41.763+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:42.149 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:42.144+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:42.201 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:42.195+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:42.204 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:42.199+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:42.336 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:42.331+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:42.401 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:42.395+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:42.729 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:42.724+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:43.187 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:43.182+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:43.233 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:43.227+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:43.252 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:43.248+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:43.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~76s 2019-12-09T19:01:43.370 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:43.365+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:43.409 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:43.404+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:43.726 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:43.711+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:44.220 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:44.215+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:44.220 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:44.214+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:44.236 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:44.231+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:44.388 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:44.381+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:44.463 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:44.455+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:44.758 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:44.753+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:45.246 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:45.242+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:45.258 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:45.254+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:45.259 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:45.254+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:45.383 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:45.379+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:45.479 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:45.473+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:45.763 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:45.758+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:46.218 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:46.213+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:46.227 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:46.221+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:46.227 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:46.221+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:46.379 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:46.375+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:46.460 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:46.454+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:46.737 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:46.733+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:47.181 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:47.177+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:47.228 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:47.224+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:47.241 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:47.236+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:47.355 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:47.350+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:47.478 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:47.474+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:47.750 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:47.744+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:48.181 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:48.176+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:48.228 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:48.224+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:48.280 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:48.275+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:48.399 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:48.395+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:48.451 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:48.444+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:48.770 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:48.766+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:49.201 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:49.195+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:49.233 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:49.222+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:49.277 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:49.273+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:49.397 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:49.390+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:49.505 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:49.499+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:49.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~82s 2019-12-09T19:01:49.740 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:01:49.735+0000 1694f700 -1 osd.1 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974459+0000 front 2019-12-09T19:00:41.322698+0000 (oldest deadline 2019-12-09T19:01:20.779750+0000) 2019-12-09T19:01:50.226 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:01:50.220+0000 1694f700 -1 osd.0 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.971741+0000 front 2019-12-09T19:00:38.877186+0000 (oldest deadline 2019-12-09T19:01:20.781108+0000) 2019-12-09T19:01:50.246 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:01:50.240+0000 1694f700 -1 osd.3 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.974069+0000 front 2019-12-09T19:00:40.890186+0000 (oldest deadline 2019-12-09T19:01:22.238112+0000) 2019-12-09T19:01:50.265 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:01:50.259+0000 1694f700 -1 osd.7 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:43.886548+0000 front 2019-12-09T19:00:39.523075+0000 (oldest deadline 2019-12-09T19:01:25.172193+0000) 2019-12-09T19:01:50.354 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:01:50.348+0000 1694f700 -1 osd.6 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.888772+0000 front 2019-12-09T19:00:40.114054+0000 (oldest deadline 2019-12-09T19:01:22.831096+0000) 2019-12-09T19:01:50.503 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:01:50.497+0000 1694f700 -1 osd.4 336 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:00:40.280903+0000 front 2019-12-09T19:00:40.283104+0000 (oldest deadline 2019-12-09T19:01:25.308936+0000) 2019-12-09T19:01:55.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~88s 2019-12-09T19:02:02.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~95s 2019-12-09T19:02:08.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~101s 2019-12-09T19:02:14.905 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~107s 2019-12-09T19:02:21.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~114s 2019-12-09T19:02:27.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~120s 2019-12-09T19:02:33.842 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~126s 2019-12-09T19:02:40.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~133s 2019-12-09T19:02:46.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~139s 2019-12-09T19:02:52.790 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~145s 2019-12-09T19:02:59.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~152s 2019-12-09T19:03:05.417 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~158s 2019-12-09T19:03:11.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~164s 2019-12-09T19:03:18.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~170s 2019-12-09T19:03:24.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~177s 2019-12-09T19:03:30.670 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~183s 2019-12-09T19:03:36.986 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~189s 2019-12-09T19:03:37.862 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:37.856+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:38.551 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:38.546+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:38.877 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:38.873+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:39.192 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:39.188+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:39.601 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:39.595+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:39.851 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:39.844+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:40.228 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:40.223+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:40.567 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:40.561+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:40.640 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:40.636+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:40.845 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:40.838+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:40.965 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:40.959+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:41.205 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:41.200+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:41.564 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:41.560+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:41.638 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:41.634+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:41.816 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:41.809+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:41.978 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:41.972+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:42.190 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:42.184+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:42.570 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:42.563+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:42.588 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:42.583+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:42.606 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:42.601+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:42.819 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:42.814+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:42.955 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:42.948+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:43.166 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:43.161+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:43.298 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~196s 2019-12-09T19:03:43.555 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:43.551+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:43.559 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:43.553+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:43.589 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:43.583+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:43.872 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:43.867+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:44.003 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:43.997+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:44.161 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:44.155+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:44.557 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:44.548+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:44.567 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:44.558+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:44.622 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:44.617+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:44.835 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:44.831+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:44.987 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:44.981+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:45.176 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:45.169+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:45.536 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:45.529+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:45.558 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:45.553+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:45.640 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:45.635+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:45.792 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:45.785+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:45.960 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:45.952+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:46.200 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:46.194+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:46.542 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:46.538+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:46.550 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:46.544+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:46.683 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:46.678+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:46.770 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:46.765+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:46.966 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:46.961+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:47.237 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:47.226+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:47.568 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:47.562+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:47.582 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:47.576+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:47.706 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:47.701+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:47.798 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:47.794+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:47.969 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:47.964+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:48.216 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:48.211+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:48.569 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:48.561+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:48.601 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:48.591+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:48.705 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:48.700+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:48.813 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:48.806+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:48.995 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:48.989+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:49.209 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:49.203+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:49.558 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:49.553+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:49.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~202s 2019-12-09T19:03:49.613 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:49.609+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:49.731 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:49.727+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:49.859 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:49.854+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:50.037 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:50.032+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:50.224 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:50.217+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:50.603 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:50.598+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:50.612 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:50.607+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:50.778 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:50.773+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:50.845 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:50.840+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:51.061 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:51.055+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:51.215 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:51.209+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:51.580 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:51.574+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:51.644 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:51.640+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:51.799 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:51.794+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:51.843 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:51.833+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:52.089 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:52.084+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:52.249 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:52.240+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:52.595 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:52.589+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:52.625 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:52.619+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:52.800 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:52.796+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:52.883 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:52.879+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:53.124 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:53.118+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:53.225 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:53.220+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:53.566 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:53.560+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:53.588 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:53.584+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:53.779 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:53.774+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:53.855 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:53.849+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:54.112 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:54.089+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:54.199 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:54.193+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:54.601 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:54.595+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:54.639 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:54.633+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:54.781 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:54.773+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:54.862 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:54.856+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:55.121 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:55.116+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:55.158 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:55.152+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:55.596 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:55.590+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:55.606 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:55.601+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:55.753 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:55.748+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:55.850 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:55.844+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:55.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~208s 2019-12-09T19:03:56.108 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:56.102+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:56.167 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:56.161+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:56.570 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:56.565+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:56.595 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:56.589+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:56.751 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:56.746+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:56.858 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:56.853+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:57.129 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:57.122+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:57.151 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:57.145+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:57.592 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:57.588+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:57.647 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:57.641+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:57.757 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:57.752+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:57.831 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:57.825+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:58.150 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:58.143+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:58.189 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:58.184+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:58.591 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:58.587+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:58.675 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:58.668+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:58.778 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:58.774+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:03:58.789 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:58.785+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:59.180 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:03:59.174+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:03:59.195 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:03:59.191+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:03:59.566 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:03:59.562+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:03:59.689 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:03:59.683+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:03:59.773 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:03:59.769+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:03:59.791 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:03:59.788+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:04:00.166 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:04:00.160+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:04:00.220 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:04:00.215+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:04:00.601 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:04:00.597+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:04:00.680 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:04:00.675+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:04:00.769 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:04:00.764+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:04:00.805 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:04:00.800+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:04:01.142 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:04:01.136+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:04:01.251 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:04:01.246+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:04:01.522 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:24:59.549 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:01.527 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:24:59.554 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:01.616 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:24:59.579 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:01.618 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:24:59.581 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:01.624 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:04:01.619+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:04:01.647 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:24:59.674 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:01.651 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:24:59.678 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:01.716 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:04:01.711+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:04:01.747 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:04:01.741+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:04:01.812 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:04:01.807+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:04:01.825 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:24:59.788 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:01.901 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:24:59.928 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:01.966 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:24:59.993 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:02.173 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:04:02.167+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:04:02.234 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~215s 2019-12-09T19:04:02.282 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:04:02.277+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:04:02.589 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:04:02.583+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:04:02.750 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:04:02.745+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:04:02.773 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:04:02.764+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:04:02.841 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:04:02.836+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:04:03.214 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:04:03.209+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:04:03.290 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:04:03.286+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:04:03.600 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:04:03.595+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:04:03.789 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:04:03.783+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:04:03.802 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:04:03.797+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:04:03.816 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:04:03.811+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:04:04.175 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:04:04.171+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:04:04.292 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:04:04.287+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:04:04.584 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:04:04.579+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:04:04.773 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:04:04.769+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:04:04.781 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:04:04.776+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:04:04.806 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:04:04.801+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:04:05.226 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:04:05.220+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:04:05.291 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:04:05.286+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:04:05.551 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:04:05.547+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:04:05.774 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:04:05.768+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:04:05.812 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:04:05.807+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:04:05.814 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:04:05.809+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:04:06.241 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:04:06.236+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:04:06.311 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:04:06.307+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:04:06.511 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:04:06.506+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:04:06.792 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:04:06.787+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:04:06.805 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:04:06.800+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:04:06.825 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:04:06.819+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:04:07.292 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:04:07.286+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:04:07.299 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:04:07.294+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:04:07.560 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:04:07.555+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:04:07.766 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:04:07.761+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:04:07.779 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:04:07.775+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:04:07.810 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:04:07.806+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:04:08.268 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:04:08.262+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:04:08.339 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:04:08.333+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:04:08.545 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~221s 2019-12-09T19:04:08.608 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:04:08.603+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:04:08.769 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:04:08.765+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:04:08.773 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:04:08.768+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:04:08.832 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:04:08.826+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:04:09.299 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:04:09.294+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:04:09.340 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:04:09.335+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:04:09.617 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:04:09.614+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:04:09.742 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:04:09.737+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:04:09.749 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:04:09.745+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:04:09.870 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:04:09.865+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:04:10.312 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:04:10.307+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:04:10.348 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:04:10.343+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:04:10.643 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:04:10.637+0000 1694f700 -1 osd.3 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.730670+0000 front 2019-12-09T19:02:55.367120+0000 (oldest deadline 2019-12-09T19:03:38.095766+0000) 2019-12-09T19:04:10.733 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:04:10.728+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:04:10.791 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:04:10.785+0000 1694f700 -1 osd.6 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.678753+0000 front 2019-12-09T19:02:56.629468+0000 (oldest deadline 2019-12-09T19:03:42.506020+0000) 2019-12-09T19:04:10.834 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:04:10.829+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:04:11.282 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:04:11.278+0000 1694f700 -1 osd.7 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.297356+0000 front 2019-12-09T19:02:54.830766+0000 (oldest deadline 2019-12-09T19:03:38.898522+0000) 2019-12-09T19:04:11.397 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:04:11.391+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 42sec e341 v341) 2019-12-09T19:04:11.399 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:04:11.395+0000 1694f700 -1 osd.4 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.273692+0000 front 2019-12-09T19:02:55.297496+0000 (oldest deadline 2019-12-09T19:03:40.847562+0000) 2019-12-09T19:04:11.742 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:04:11.737+0000 1694f700 -1 osd.0 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:55.167306+0000 front 2019-12-09T19:02:55.166686+0000 (oldest deadline 2019-12-09T19:03:37.234825+0000) 2019-12-09T19:04:11.826 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:04:11.823+0000 1694f700 -1 osd.1 341 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:02:56.176424+0000 front 2019-12-09T19:02:55.497526+0000 (oldest deadline 2019-12-09T19:03:40.188852+0000) 2019-12-09T19:04:12.390 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:25:10.417 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:12.398 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:25:10.425 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:12.403 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:25:10.366 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:12.406 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:25:10.433 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:12.408 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:25:10.372 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:12.410 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:25:10.437 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:12.437 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:25:10.464 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:12.442 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:25:10.469 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:12.446 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:25:10.410 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:04:14.860 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~227s 2019-12-09T19:04:21.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~234s 2019-12-09T19:04:27.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~240s 2019-12-09T19:04:33.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~246s 2019-12-09T19:04:40.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~253s 2019-12-09T19:04:46.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~259s 2019-12-09T19:04:52.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~265s 2019-12-09T19:04:59.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~271s 2019-12-09T19:05:05.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~278s 2019-12-09T19:05:11.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~284s 2019-12-09T19:05:17.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~290s 2019-12-09T19:05:24.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~297s 2019-12-09T19:05:30.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~303s 2019-12-09T19:05:30.616 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2019-12-09T19:05:30.616 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa/tasks/daemonwatchdog.py", line 38, in _run self.watch() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa/tasks/daemonwatchdog.py", line 114, in watch self.bark() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa/tasks/daemonwatchdog.py", line 54, in bark for mount in self.ctx.mounts.values(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/config.py", line 253, in __getattr__ raise AttributeError(name) AttributeError: mounts 2019-12-09T19:05:53.729 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:05:53.726+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:05:54.541 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:05:54.537+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:05:54.779 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:05:54.777+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:05:55.100 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:05:55.090+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:05:55.534 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:05:55.530+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:05:55.565 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:05:55.562+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:05:55.818 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:05:55.815+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:05:56.120 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:05:56.113+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:05:56.544 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:05:56.541+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:05:56.598 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:05:56.595+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:05:56.819 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:05:56.816+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:05:57.128 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:05:57.122+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:05:57.551 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:05:57.548+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:05:57.605 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:05:57.603+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:05:57.854 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:05:57.851+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:05:58.087 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:05:58.082+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:05:58.333 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:05:58.328+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:05:58.517 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:05:58.514+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:05:58.620 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:05:58.615+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:05:58.860 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:05:58.856+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:05:59.022 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:05:59.015+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:05:59.129 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:05:59.125+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:05:59.315 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:05:59.310+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:05:59.570 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:05:59.565+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:05:59.580 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:05:59.577+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:05:59.857 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:05:59.853+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:00.046 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:00.041+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:00.132 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:00.127+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:00.356 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:00.351+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:00.572 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:00.568+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:00.617 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:00.613+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:00.907 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:00.903+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:01.018 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:01.013+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:01.151 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:01.148+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:01.361 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:01.349+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:01.594 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:01.589+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:01.632 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:01.628+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:01.912 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:01.907+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:02.052 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:02.047+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:02.142 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:02.137+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:02.388 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:02.380+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:02.620 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:02.615+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:02.657 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:02.652+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:02.872 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:02.868+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:03.038 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:03.033+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:03.101 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:03.097+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:03.392 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:03.387+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:03.593 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:03.589+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:03.642 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:03.637+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:03.917 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:03.912+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:04.087 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:04.082+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:04.117 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:04.112+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:04.365 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:04.360+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:04.586 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:04.581+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:04.621 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:04.617+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:04.875 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:04.870+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:05.095 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:05.089+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:05.129 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:05.124+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:05.360 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:05.355+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:05.604 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:05.600+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:05.633 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:05.626+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:05.861 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:05.856+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:06.114 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:06.109+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:06.139 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:06.134+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:06.381 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:06.376+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:06.569 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:06.563+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:06.669 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:06.664+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:06.895 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:06.891+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:07.101 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:07.095+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:07.152 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:07.147+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:07.386 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:07.381+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:07.613 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:07.608+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:07.715 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:07.711+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:07.857 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:07.852+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:08.055 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:08.049+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:08.110 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:08.106+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:08.378 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:08.373+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:08.655 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:08.650+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:08.695 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:08.690+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:08.820 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:08.814+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:09.094 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:09.089+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:09.143 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:09.138+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:09.390 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:09.384+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:09.657 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:09.652+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:09.673 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:09.669+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:09.829 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:09.824+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:10.132 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:10.127+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:10.192 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:10.188+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:10.357 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:10.352+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:10.643 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:10.638+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:10.657 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:10.652+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:10.868 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:10.864+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:11.153 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:11.148+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:11.178 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:11.173+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:11.404 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:11.398+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:11.665 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:11.660+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:11.694 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:11.689+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:11.921 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:11.917+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:12.141 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:12.137+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:12.159 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:12.154+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:12.391 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:12.385+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:12.690 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:12.685+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:12.721 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:12.712+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:12.954 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:12.949+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:13.164 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:13.159+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:13.205 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:13.201+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:13.354 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:13.348+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:13.665 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:13.660+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:13.695 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:13.690+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:13.970 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:13.966+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:14.132 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:14.126+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:14.195 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:14.188+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:14.310 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:14.303+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:14.633 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:14.628+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:14.748 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:14.742+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:15.020 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:15.015+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:15.136 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:15.129+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:15.158 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:15.152+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:15.329 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:15.322+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:15.611 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:15.606+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:15.726 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:15.721+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:16.007 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:16.002+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:16.142 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:16.136+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:16.169 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:16.163+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:16.346 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:16.341+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:16.616 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:16.610+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:16.694 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:16.690+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:17.044 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:17.040+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:17.178 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:17.172+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:17.193 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:17.186+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:17.363 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:17.357+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:17.575 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:17.570+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:17.721 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:17.716+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:18.064 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:18.060+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:18.179 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:18.173+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:18.204 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:18.198+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:18.335 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:18.329+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:18.588 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:18.583+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:18.675 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:18.670+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:19.068 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:19.063+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:19.197 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:19.190+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:19.230 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:19.225+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:19.350 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:19.343+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:19.600 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:19.596+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:19.629 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:19.623+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:20.037 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:20.032+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:20.173 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:20.166+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:20.187 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:20.181+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:20.319 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:20.313+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:20.643 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:20.639+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:20.672 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:20.668+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:21.025 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:21.021+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:21.157 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:21.151+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:21.232 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:21.225+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:21.308 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:21.302+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:21.617 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:21.613+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:21.695 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:21.689+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:22.028 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:22.024+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:22.117 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:22.111+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:22.191 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:22.186+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:22.321 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:22.316+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:22.614 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:22.609+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:22.688 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:22.684+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:23.059 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:23.055+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:23.107 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:23.102+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:23.228 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:23.223+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:23.288 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:23.283+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:23.629 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:23.624+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:23.653 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:23.648+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:24.018 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:24.014+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:24.112 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:24.105+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:24.197 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:24.191+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:24.266 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:24.260+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:24.620 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:24.616+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:24.640 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:24.636+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:25.024 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:25.018+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:25.158 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:25.153+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:25.219 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:25.213+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:25.317 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:25.311+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:25.587 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:25.582+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:25.625 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:25.620+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:25.987 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:25.983+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:26.136 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:26.130+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:26.188 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:26.182+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:26.289 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:26.283+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:26.565 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:26.560+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:26.611 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:26.606+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:26.865 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:06:26.861+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e348 v348) 2019-12-09T19:06:26.991 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:26.987+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:27.185 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:27.179+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:27.237 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:27.226+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:27.302 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:27.296+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:27.595 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:27.590+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:27.638 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:27.633+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:27.994 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:27.990+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:28.191 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:28.185+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:28.214 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:28.208+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:28.315 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:28.308+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:28.560 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:28.555+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:28.669 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:28.665+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:28.961 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:28.955+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:29.154 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:29.148+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:29.214 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:29.207+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:29.297 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:29.290+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:29.596 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:29.592+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:29.670 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:29.666+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:29.945 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:29.939+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:30.130 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:30.124+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:30.227 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:30.221+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:30.268 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:30.263+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:30.603 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:30.599+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:30.637 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:30.632+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:30.975 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:30.970+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:31.169 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:06:31.163+0000 1694f700 -1 osd.6 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:14.543991+0000 front 2019-12-09T19:05:14.413062+0000 (oldest deadline 2019-12-09T19:05:58.468159+0000) 2019-12-09T19:06:31.232 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:06:31.227+0000 1694f700 -1 osd.7 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:13.355320+0000 front 2019-12-09T19:05:14.543127+0000 (oldest deadline 2019-12-09T19:05:54.662050+0000) 2019-12-09T19:06:31.237 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:06:31.231+0000 1694f700 -1 osd.4 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:12.677723+0000 front 2019-12-09T19:05:12.282394+0000 (oldest deadline 2019-12-09T19:05:57.484814+0000) 2019-12-09T19:06:31.584 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:06:31.580+0000 1694f700 -1 osd.3 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.947299+0000 front 2019-12-09T19:05:14.084994+0000 (oldest deadline 2019-12-09T19:05:53.894335+0000) 2019-12-09T19:06:31.598 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:06:31.594+0000 1694f700 -1 osd.1 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:10.604026+0000 front 2019-12-09T19:05:10.565125+0000 (oldest deadline 2019-12-09T19:05:55.203398+0000) 2019-12-09T19:06:31.953 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:06:31.949+0000 1694f700 -1 osd.0 348 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:05:09.946129+0000 front 2019-12-09T19:05:09.900518+0000 (oldest deadline 2019-12-09T19:05:53.653139+0000) 2019-12-09T19:06:31.955 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:06:31.948+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e348 v348) 2019-12-09T19:08:15.322 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:15.318+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:16.037 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:16.032+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:16.312 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:16.307+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:17.032 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:17.027+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:17.318 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:17.313+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:17.638 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:29:15.665 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:17.648 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:29:15.675 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:17.652 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:29:15.615 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:17.653 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:29:15.679 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:17.655 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:29:15.682 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:17.665 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:29:15.628 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:17.706 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:17.701+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:17.904 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:29:15.931 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:17.904 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:29:15.931 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:17.991 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:29:15.955 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:18.021 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:18.016+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:18.061 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:18.056+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:18.310 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:18.305+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:18.352 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:18.348+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:18.685 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:18.679+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:19.026 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:19.020+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:19.051 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:19.045+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:19.292 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:19.286+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:19.379 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:19.374+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:19.695 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:19.688+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:20.078 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:20.071+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:20.095 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:20.090+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:20.264 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:20.260+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:20.371 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:20.367+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:20.745 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:20.739+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:20.844 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:20.840+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:21.084 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:21.078+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:21.088 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:21.081+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:21.232 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:21.228+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:21.418 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:21.414+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:21.740 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:21.733+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:21.894 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:21.890+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:22.091 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:22.085+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:22.104 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:22.098+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:22.242 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:22.239+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:22.446 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:22.443+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:22.785 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:22.778+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:22.868 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:22.864+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:23.065 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:23.059+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:23.076 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:23.071+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:23.230 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:23.226+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:23.431 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:23.426+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:23.781 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:23.775+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:23.881 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:23.873+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:24.053 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:24.046+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:24.070 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:24.062+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:24.245 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:24.241+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:24.449 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:24.446+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:24.781 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:24.777+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:24.858 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:24.855+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:25.055 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:25.049+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:25.094 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:25.088+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:25.220 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:25.216+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:25.461 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:25.458+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:25.833 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:25.827+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:25.909 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:25.905+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:26.100 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:26.095+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:26.109 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:26.095+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:26.173 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:26.170+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:26.462 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:26.459+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:26.857 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:26.851+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:26.874 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:26.870+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:27.145 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:27.138+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:27.146 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:27.141+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:27.187 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:27.183+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:27.506 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:27.502+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:27.842 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:27.836+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:27.863 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:27.859+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:28.113 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:28.107+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:28.127 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:28.122+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:28.154 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:28.149+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:28.547 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:28.544+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:28.891 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:28.887+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:28.916 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:28.911+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:29.109 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:29.104+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:29.117 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:29.112+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:29.168 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:29.164+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:29.602 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:29.597+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:29.889 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:29.885+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:29.935 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:29.930+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:30.092 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:30.088+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:30.116 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:30.110+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:30.220 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:30.215+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:30.620 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:30.615+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:30.867 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:30.863+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:30.938 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:30.933+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:31.075 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:31.070+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:31.125 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:31.121+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:31.226 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:31.222+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:31.660 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:31.655+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:31.897 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:31.892+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:31.911 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:31.906+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:32.125 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:32.120+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:32.140 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:32.136+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:32.202 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:32.197+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:32.699 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:32.695+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:32.858 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:32.853+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:32.953 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:32.949+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:33.148 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:33.143+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:33.172 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:33.166+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:33.238 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:33.233+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:33.718 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:33.714+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:33.865 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:33.860+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:34.002 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:33.993+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:34.176 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:34.171+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:34.189 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:34.184+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:34.287 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:34.282+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:34.712 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:34.707+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:34.852 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:34.846+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:35.028 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:35.023+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:35.186 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:35.180+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:35.197 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:35.193+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:35.241 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:35.236+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:35.725 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:35.720+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:35.886 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:35.881+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:36.015 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:36.010+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:36.159 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:36.153+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:36.219 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:36.215+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:36.243 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:36.238+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:36.701 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:36.697+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:36.936 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:36.931+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:37.011 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:37.006+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:37.150 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:37.145+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:37.211 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:37.205+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:37.234 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:37.228+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:37.696 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:37.691+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:37.896 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:37.892+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:38.010 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:38.006+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:38.174 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:38.168+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:38.201 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:38.196+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:38.253 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:38.248+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:38.677 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:38.671+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:38.921 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:38.916+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:39.035 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:39.030+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:39.132 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:39.127+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:39.197 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:39.191+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:39.211 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:39.206+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:39.710 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:39.705+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:39.897 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:39.892+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:40.000 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:39.995+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:40.155 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:40.151+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:40.185 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:40.180+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:40.249 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:40.243+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:40.706 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:40.701+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:40.917 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:40.912+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:41.037 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:41.032+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:41.136 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:41.131+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:41.209 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:41.203+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:41.245 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:41.239+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:41.715 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:41.709+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:41.949 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:41.944+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:42.085 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:42.081+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:42.117 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:42.113+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:42.178 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:42.173+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:42.285 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:42.280+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:42.703 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:42.697+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:42.984 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:42.979+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:43.101 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:43.096+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:43.107 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:43.103+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:43.223 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:43.218+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:43.322 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:43.316+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:43.755 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:43.750+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:43.991 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:43.986+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:44.081 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:44.076+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:44.127 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:44.122+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:44.231 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:44.227+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:44.295 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:44.289+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:44.805 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:44.800+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:44.981 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:44.975+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:45.108 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:45.102+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:45.155 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:45.151+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:45.238 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:45.234+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:45.308 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:45.301+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:45.772 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:45.766+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:46.008 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:46.002+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:46.083 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:46.072+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:46.211 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:46.206+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:46.273 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:46.269+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:46.346 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:46.341+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:46.732 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:46.727+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:47.019 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:47.013+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:47.078 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:47.072+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:47.228 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:47.222+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:47.273 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:47.268+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:47.306 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:47.301+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:47.479 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:08:47.475+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 41sec e353 v353) 2019-12-09T19:08:47.700 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:47.695+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:47.974 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:47.968+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:48.099 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:48.093+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:48.190 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:48.185+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:48.276 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:48.272+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:48.298 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:48.291+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:48.694 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:48.690+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:48.970 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:48.965+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:49.149 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:49.143+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:49.212 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:49.208+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:49.270 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:49.265+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:49.335 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:49.329+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:49.740 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:49.736+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:49.995 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:49.990+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:50.170 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:50.165+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:50.191 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:50.186+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:50.278 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:50.273+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:50.304 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:50.298+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:50.780 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:50.776+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:51.030 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:51.025+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:51.150 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:51.145+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:51.195 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:51.188+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:51.293 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:51.288+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:51.337 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:51.330+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:51.808 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:08:51.803+0000 1694f700 -1 osd.3 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.687321+0000 front 2019-12-09T19:07:33.063595+0000 (oldest deadline 2019-12-09T19:08:18.343573+0000) 2019-12-09T19:08:52.028 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:08:52.023+0000 1694f700 -1 osd.7 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:34.550983+0000 front 2019-12-09T19:07:33.686386+0000 (oldest deadline 2019-12-09T19:08:17.434635+0000) 2019-12-09T19:08:52.144 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:08:52.137+0000 1694f700 -1 osd.0 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:35.114712+0000 front 2019-12-09T19:07:37.623089+0000 (oldest deadline 2019-12-09T19:08:20.535466+0000) 2019-12-09T19:08:52.172 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:08:52.167+0000 1694f700 -1 osd.6 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:32.562172+0000 front 2019-12-09T19:07:33.098767+0000 (oldest deadline 2019-12-09T19:08:15.194196+0000) 2019-12-09T19:08:52.292 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:08:52.287+0000 1694f700 -1 osd.1 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.688655+0000 front 2019-12-09T19:07:35.268577+0000 (oldest deadline 2019-12-09T19:08:15.010868+0000) 2019-12-09T19:08:52.304 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:08:52.297+0000 1694f700 -1 osd.4 353 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:07:33.716714+0000 front 2019-12-09T19:07:34.337374+0000 (oldest deadline 2019-12-09T19:08:17.165346+0000) 2019-12-09T19:08:52.656 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:08:52.653+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 41sec e353 v353) 2019-12-09T19:08:52.781 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:29:50.808 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:52.824 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:29:50.851 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:52.836 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:29:50.799 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:52.837 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:29:50.863 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:52.838 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:29:50.865 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:52.850 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:29:50.813 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:52.886 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:29:50.913 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:52.896 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:29:50.859 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:08:52.898 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:29:50.925 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:10:33.370 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:33.363+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:34.329 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:34.324+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:34.554 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:34.548+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:35.300 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:35.295+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:35.591 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:35.585+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:35.701 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:35.695+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:36.073 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:36.068+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:36.254 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:36.248+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:36.338 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:36.332+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:36.574 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:36.570+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:36.703 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:36.697+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:37.056 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:37.051+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:37.309 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:37.304+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:37.372 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:37.362+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:37.580 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:37.576+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:37.711 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:37.707+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:38.044 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:38.038+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:38.337 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:38.332+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:38.364 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:38.359+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:38.627 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:38.623+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:38.758 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:38.752+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:38.897 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:38.890+0000 1694f700 -1 osd.7 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:39.063 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:39.058+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:39.329 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:39.323+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:39.398 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:39.392+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:39.649 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:39.645+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:39.769 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:39.763+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:39.860 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:39.854+0000 1694f700 -1 osd.7 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:40.069 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:40.065+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:40.321 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:40.316+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:40.350 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:40.345+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:40.624 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:40.619+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:40.747 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:40.740+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:40.837 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:40.832+0000 1694f700 -1 osd.7 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:41.098 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:41.093+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:41.315 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:41.310+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:41.324 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:41.318+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:41.608 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:41.603+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:41.788 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:41.783+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:41.872 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:41.863+0000 1694f700 -1 osd.7 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:42.143 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:42.138+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:42.272 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:42.268+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:42.330 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:42.323+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:42.607 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:42.602+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:42.833 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:42.826+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:42.891 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:42.885+0000 1694f700 -1 osd.7 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:43.139 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:43.136+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:43.283 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:43.277+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:43.298 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:43.294+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:43.641 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:43.637+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:43.867 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:43.859+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:43.898 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:43.892+0000 1694f700 -1 osd.7 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:44.144 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:44.140+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:44.285 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:44.280+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:44.307 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:44.302+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:44.684 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:44.677+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:44.904 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:44.898+0000 1694f700 -1 osd.7 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:44.912 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:44.906+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:45.142 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:45.137+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:45.319 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:45.314+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:45.363 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:45.357+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:45.663 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:45.659+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:45.881 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:45.875+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:45.924 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:45.918+0000 1694f700 -1 osd.7 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:46.161 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:46.156+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:46.302 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:46.297+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:46.382 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:46.376+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:46.679 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:46.673+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:46.910 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:46.904+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:46.926 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:46.921+0000 1694f700 -1 osd.7 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:47.202 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:47.198+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:47.287 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:47.283+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:47.369 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:47.362+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:47.676 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:47.672+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:47.944 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:47.938+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:47.968 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:47.963+0000 1694f700 -1 osd.7 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:48.200 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:48.196+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:48.293 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:48.289+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:48.363 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:48.356+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:48.684 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:48.668+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:48.898 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:48.893+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:48.994 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:48.989+0000 1694f700 -1 osd.7 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:49.187 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:49.183+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:49.335 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:49.332+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:49.366 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:49.360+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:49.704 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:49.701+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:49.953 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:49.947+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:49.955 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:49.949+0000 1694f700 -1 osd.7 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:50.149 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:50.146+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:50.303 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:50.299+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:50.332 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:50.327+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:50.728 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:50.725+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:50.927 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:50.920+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:50.941 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:50.935+0000 1694f700 -1 osd.7 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:51.202 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:51.199+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:51.291 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:51.289+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:51.341 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:51.336+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:51.734 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:51.731+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:51.951 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:51.944+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:51.995 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:51.986+0000 1694f700 -1 osd.7 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:52.162 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:52.158+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:52.323 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:52.320+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:52.341 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:52.335+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:52.756 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:52.753+0000 1694f700 -1 osd.1 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:52.909 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:52.903+0000 1694f700 -1 osd.4 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:52.973 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:52.967+0000 1694f700 -1 osd.7 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:53.179 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:53.176+0000 1694f700 -1 osd.3 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:53.352 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:53.347+0000 1694f700 -1 osd.6 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:53.373 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:53.371+0000 1694f700 -1 osd.0 359 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:53.902 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:53.897+0000 1694f700 -1 osd.4 360 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:53.993 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:53.980+0000 1694f700 -1 osd.7 360 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:53.996 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:53.862+0000 1694f700 -1 osd.1 360 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:54.269 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:54.241+0000 1694f700 -1 osd.3 360 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:54.316 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:54.311+0000 1694f700 -1 osd.6 360 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:54.380 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:54.377+0000 1694f700 -1 osd.0 360 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:54.983 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:54.978+0000 1694f700 -1 osd.4 361 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:55.025 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:55.020+0000 1694f700 -1 osd.7 361 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:55.072 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:55.031+0000 1694f700 -1 osd.1 361 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:55.277 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:55.245+0000 1694f700 -1 osd.3 361 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:55.333 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:55.324+0000 1694f700 -1 osd.6 361 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:55.398 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:55.395+0000 1694f700 -1 osd.0 361 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:56.056 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:56.051+0000 1694f700 -1 osd.7 362 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:56.069 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:56.066+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:56.255 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:56.160+0000 1694f700 -1 osd.4 362 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:56.325 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:56.317+0000 1694f700 -1 osd.3 362 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:56.377 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:56.372+0000 1694f700 -1 osd.6 362 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:56.389 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:56.385+0000 1694f700 -1 osd.0 362 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:57.043 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:57.037+0000 1694f700 -1 osd.7 363 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:57.103 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:57.098+0000 1694f700 -1 osd.1 362 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:57.230 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:57.188+0000 1694f700 -1 osd.4 363 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:57.325 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:57.316+0000 1694f700 -1 osd.3 363 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:57.349 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:57.343+0000 1694f700 -1 osd.6 363 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:57.350 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:57.347+0000 1694f700 -1 osd.0 363 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:58.112 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:58.106+0000 1694f700 -1 osd.7 364 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:58.234 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:58.229+0000 1694f700 -1 osd.4 364 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:58.285 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:58.175+0000 1694f700 -1 osd.1 364 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:58.361 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:58.345+0000 1694f700 -1 osd.3 364 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:10:58.385 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:58.377+0000 1694f700 -1 osd.0 364 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:58.400 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:58.384+0000 1694f700 -1 osd.6 364 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:59.107 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:10:59.102+0000 1694f700 -1 osd.7 364 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:10:59.159 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:10:59.156+0000 1694f700 -1 osd.1 364 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:10:59.204 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:10:59.199+0000 1694f700 -1 osd.4 364 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:10:59.372 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:10:59.368+0000 1694f700 -1 osd.6 364 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:10:59.398 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:10:59.395+0000 1694f700 -1 osd.0 364 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:10:59.410 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:10:59.406+0000 1694f700 -1 osd.3 364 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:11:00.162 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:11:00.128+0000 1694f700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:11:00.225 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:11:00.216+0000 1694f700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:11:00.275 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:11:00.225+0000 1694f700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:11:00.381 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:11:00.377+0000 1694f700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:11:00.440 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:00.434+0000 1694f700 -1 osd.3 365 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:11:00.447 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:11:00.411+0000 1694f700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:11:01.229 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:11:01.219+0000 1694f700 -1 osd.7 366 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:11:01.298 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:11:01.243+0000 1694f700 -1 osd.4 366 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:11:01.348 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:11:01.344+0000 1694f700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:11:01.366 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:11:01.362+0000 1694f700 -1 osd.0 366 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:11:01.589 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:11:01.554+0000 1694f700 -1 osd.6 366 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:11:01.695 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:01.662+0000 1694f700 -1 osd.3 366 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:11:02.220 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:11:02.216+0000 1694f700 -1 osd.4 366 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:11:02.260 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:11:02.256+0000 1694f700 -1 osd.7 366 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:11:02.377 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:11:02.371+0000 1694f700 -1 osd.1 366 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:11:02.417 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:11:02.414+0000 1694f700 -1 osd.0 366 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:11:02.571 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:11:02.567+0000 1694f700 -1 osd.6 366 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:11:02.681 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:02.670+0000 1694f700 -1 osd.3 366 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:11:03.241 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:11:03.237+0000 1694f700 -1 osd.7 366 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:11:03.244 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:11:03.239+0000 1694f700 -1 osd.4 366 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:11:03.390 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:11:03.386+0000 1694f700 -1 osd.0 366 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:11:03.477 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:11:03.472+0000 1694f700 -1 osd.1 367 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:11:03.572 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:11:03.568+0000 1694f700 -1 osd.6 367 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:11:03.717 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:03.708+0000 1694f700 -1 osd.3 367 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:11:04.208 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:11:04.204+0000 1694f700 -1 osd.7 367 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:11:04.273 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:11:04.269+0000 1694f700 -1 osd.4 367 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:11:04.416 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:11:04.412+0000 1694f700 -1 osd.0 367 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:11:04.652 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:11:04.612+0000 1694f700 -1 osd.6 368 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:11:04.748 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:11:04.717+0000 1694f700 -1 osd.1 368 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:11:04.832 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:04.770+0000 1694f700 -1 osd.3 368 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:11:05.240 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:11:05.235+0000 1694f700 -1 osd.7 368 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:11:05.299 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:11:05.294+0000 1694f700 -1 osd.4 368 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:11:05.476 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:11:05.472+0000 1694f700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:11:05.760 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:11:05.747+0000 1694f700 -1 osd.6 369 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:11:05.851 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:11:05.827+0000 1694f700 -1 osd.1 369 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:11:05.968 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:05.861+0000 1694f700 -1 osd.3 369 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:11:06.233 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:11:06.229+0000 1694f700 -1 osd.7 369 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:11:06.281 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:11:06.276+0000 1694f700 -1 osd.4 369 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:11:06.448 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:11:06.436+0000 1694f700 -1 osd.0 369 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:11:06.845 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:11:06.834+0000 1694f700 -1 osd.6 370 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:11:06.921 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:11:06.917+0000 1694f700 -1 osd.1 370 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:11:06.987 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:06.971+0000 1694f700 -1 osd.3 370 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:11:07.234 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:11:07.229+0000 1694f700 -1 osd.4 370 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:11:07.242 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:11:07.232+0000 1694f700 -1 osd.7 370 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:11:07.436 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:11:07.432+0000 1694f700 -1 osd.0 370 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:11:07.889 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:11:07.885+0000 1694f700 -1 osd.6 370 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:11:07.974 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:11:07.970+0000 1694f700 -1 osd.1 370 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:11:07.984 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:07.979+0000 1694f700 -1 osd.3 370 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:11:08.193 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:11:08.187+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e359 v359) 2019-12-09T19:11:08.194 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:11:08.190+0000 1694f700 -1 osd.7 370 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:11:08.221 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:11:08.215+0000 1694f700 -1 osd.4 370 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:11:08.574 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:11:08.505+0000 1694f700 -1 osd.0 371 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:11:08.897 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:11:08.892+0000 1694f700 -1 osd.6 371 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:11:08.990 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:11:08.984+0000 1694f700 -1 osd.1 370 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:11:09.073 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:09.069+0000 1694f700 -1 osd.3 371 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:11:09.210 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:11:09.203+0000 1694f700 -1 osd.7 370 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:11:09.233 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:11:09.228+0000 1694f700 -1 osd.4 371 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:11:09.718 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:11:09.638+0000 1694f700 -1 osd.0 372 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:11:09.927 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:11:09.923+0000 1694f700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:11:10.015 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:11:10.011+0000 1694f700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:11:10.218 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:10.199+0000 1694f700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:11:10.224 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:11:10.214+0000 1694f700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:11:10.251 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:11:10.245+0000 1694f700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:11:10.661 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:11:10.657+0000 1694f700 -1 osd.0 372 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:11:11.049 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:11:10.985+0000 1694f700 -1 osd.6 373 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:11:11.088 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:11:11.073+0000 1694f700 -1 osd.1 373 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:11:11.184 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:11.179+0000 1694f700 -1 osd.3 373 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:11:11.252 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:11:11.246+0000 1694f700 -1 osd.7 373 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:11:11.278 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:11:11.275+0000 1694f700 -1 osd.4 373 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:11:11.619 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:11:11.616+0000 1694f700 -1 osd.0 373 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:11:12.086 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:11:12.081+0000 1694f700 -1 osd.1 374 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:11:12.108 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:11:12.095+0000 1694f700 -1 osd.6 374 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:11:12.203 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:12.199+0000 1694f700 -1 osd.3 374 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:11:12.288 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:11:12.281+0000 1694f700 -1 osd.4 373 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:11:12.337 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:11:12.332+0000 1694f700 -1 osd.7 374 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.109661+0000 front 2019-12-09T19:09:52.922835+0000 (oldest deadline 2019-12-09T19:10:37.904025+0000) 2019-12-09T19:11:12.585 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:11:12.581+0000 1694f700 -1 osd.0 374 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:11:13.087 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:11:13.081+0000 1694f700 -1 osd.1 375 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.195044+0000 front 2019-12-09T19:09:50.269636+0000 (oldest deadline 2019-12-09T19:10:34.142166+0000) 2019-12-09T19:11:13.238 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:11:13.232+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e359 v359) 2019-12-09T19:11:13.249 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:13.245+0000 1694f700 -1 osd.3 375 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.933687+0000 front 2019-12-09T19:09:50.922255+0000 (oldest deadline 2019-12-09T19:10:35.571449+0000) 2019-12-09T19:11:13.256 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:11:13.247+0000 1694f700 -1 osd.4 375 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:50.940656+0000 front 2019-12-09T19:09:50.913922+0000 (oldest deadline 2019-12-09T19:10:34.975608+0000) 2019-12-09T19:11:13.261 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:11:13.235+0000 1694f700 -1 osd.6 375 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:53.106488+0000 front 2019-12-09T19:09:53.121141+0000 (oldest deadline 2019-12-09T19:10:35.842818+0000) 2019-12-09T19:11:13.541 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:11:13.536+0000 1694f700 -1 osd.0 375 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:09:47.384033+0000 front 2019-12-09T19:09:53.127638+0000 (oldest deadline 2019-12-09T19:10:33.098405+0000) 2019-12-09T19:11:45.197 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:45.188+0000 1694f700 -1 osd.3 387 get_health_metrics reporting 22 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:11:46.184 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:46.178+0000 1694f700 -1 osd.3 387 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:11:47.205 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:47.199+0000 1694f700 -1 osd.3 387 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:11:48.183 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:48.177+0000 1694f700 -1 osd.3 387 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:11:48.244 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:32:46.270 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:11:48.259 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:32:46.286 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:11:48.277 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:32:46.304 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:11:48.278 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:32:46.241 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:11:48.281 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:32:46.308 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:11:48.309 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:32:46.272 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:11:48.553 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:32:46.579 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:11:48.576 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:32:46.603 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:11:48.616 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:32:46.580 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:11:49.158 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:49.154+0000 1694f700 -1 osd.3 387 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:11:50.210 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:50.206+0000 1694f700 -1 osd.3 387 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:11:51.227 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:51.223+0000 1694f700 -1 osd.3 387 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:11:52.229 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:52.225+0000 1694f700 -1 osd.3 387 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:11:53.234 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:53.229+0000 1694f700 -1 osd.3 387 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:11:54.240 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:54.236+0000 1694f700 -1 osd.3 387 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:11:55.247 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:55.241+0000 1694f700 -1 osd.3 387 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:11:56.246 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:56.241+0000 1694f700 -1 osd.3 387 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:11:57.212 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:57.207+0000 1694f700 -1 osd.3 387 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:11:58.235 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:58.229+0000 1694f700 -1 osd.3 387 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:11:59.488 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:11:59.439+0000 1694f700 -1 osd.3 388 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:12:00.498 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:12:00.493+0000 1694f700 -1 osd.3 388 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:12:01.507 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:12:01.500+0000 1694f700 -1 osd.3 389 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:12:02.550 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:12:02.547+0000 1694f700 -1 osd.3 389 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:12:03.669 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:12:03.610+0000 1694f700 -1 osd.3 391 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:12:04.591 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:12:04.587+0000 1694f700 -1 osd.3 391 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:12:05.593 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:12:05.590+0000 1694f700 -1 osd.3 392 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:12:06.689 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:12:06.673+0000 1694f700 -1 osd.3 393 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:12:07.666 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:12:07.660+0000 1694f700 -1 osd.3 394 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:12:08.693 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:12:08.688+0000 1694f700 -1 osd.3 394 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:12:09.729 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:12:09.725+0000 1694f700 -1 osd.3 395 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:12:10.685 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:12:10.680+0000 1694f700 -1 osd.3 395 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:12:11.689 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:12:11.685+0000 1694f700 -1 osd.3 396 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4530.0:120119 7.c 7.6555b05c (undecoded) ondisk+retry+write+known_if_redirected e376) 2019-12-09T19:13:08.467 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:08.461+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:09.449 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:09.444+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:10.001 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:09.996+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:10.422 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:10.416+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:10.537 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:10.531+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:11.001 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:10.993+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:11.420 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:11.414+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:11.477 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:11.471+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:11.518 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:11.514+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:11.845 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:11.841+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:11.881 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:11.876+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:11.969 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:11.965+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:12.389 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:12.383+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:12.489 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:12.483+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:12.508 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:12.504+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:12.846 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:12.841+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:12.899 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:12.893+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:12.933 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:12.928+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:13.413 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:13.407+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:13.469 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:13.463+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:13.509 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:13.505+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:13.843 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:13.838+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:13.902 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:13.896+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:13.906 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:13.902+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:14.375 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:14.369+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:14.495 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:14.488+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:14.513 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:14.510+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:14.897 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:14.893+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:14.903 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:14.900+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:14.924 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:14.918+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:15.417 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:15.409+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:15.454 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:15.447+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:15.519 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:15.515+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:15.903 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:15.900+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:15.930 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:15.926+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:15.957 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:15.950+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:16.413 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:16.406+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:16.441 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:16.435+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:16.491 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:16.488+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:16.942 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:16.938+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:16.948 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:16.945+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:16.985 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:16.978+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:17.370 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:17.364+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:17.457 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:17.455+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:17.458 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:17.452+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:17.942 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:17.939+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:17.967 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:17.964+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:17.997 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:17.991+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:18.419 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:18.413+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:18.429 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:18.423+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:18.495 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:18.491+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:18.968 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:18.965+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:18.980 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:18.974+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:19.036 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:19.029+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:19.436 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:19.428+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:19.474 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:19.466+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:19.535 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:19.531+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:19.928 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:19.924+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:20.023 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:20.019+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:20.039 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:20.033+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:20.390 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:20.384+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:20.460 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:20.454+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:20.525 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:20.521+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:20.938 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:20.933+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:20.999 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:20.994+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:21.058 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:21.050+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:21.374 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:21.367+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:21.489 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:21.483+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:21.512 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:21.507+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:21.978 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:21.973+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:22.031 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:22.026+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:22.062 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:22.056+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:22.332 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:22.325+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:22.528 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:22.521+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:22.548 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:22.543+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:23.010 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:23.006+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:23.070 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:23.066+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:23.106 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:23.100+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:23.344 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:23.338+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:23.485 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:23.480+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:23.541 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:23.536+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:24.039 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:24.034+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:24.046 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:24.042+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:24.137 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:24.130+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:24.373 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:24.368+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:24.515 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:24.509+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:24.554 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:24.549+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:25.018 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:25.013+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:25.086 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:25.080+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:25.127 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:25.121+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:25.374 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:25.368+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:25.562 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:25.556+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:25.565 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:25.561+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:26.001 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:25.996+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:26.051 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:26.046+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:26.101 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:26.095+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:26.410 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:26.404+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:26.573 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:26.567+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:26.575 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:26.571+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:27.017 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:27.013+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:27.024 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:27.019+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:27.109 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:27.103+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:27.415 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:27.409+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:27.569 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:27.563+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:27.571 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:27.565+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:27.986 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:27.981+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:28.022 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:28.018+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:28.134 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:28.127+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:28.398 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:28.391+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:28.539 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:28.532+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:28.569 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:28.564+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:28.983 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:28.980+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:29.047 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:29.043+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:29.153 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:29.147+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:29.450 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:29.444+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:29.541 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:29.536+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:29.559 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:29.552+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:30.038 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:30.033+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:30.092 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:30.087+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:30.150 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:30.144+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:30.472 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:30.465+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:30.505 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:30.501+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:30.612 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:30.607+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:31.004 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:30.998+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:31.124 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:31.119+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:31.177 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:31.173+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:31.440 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:31.435+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:31.545 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:31.539+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:31.627 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:31.622+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:31.994 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:31.987+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:32.093 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:32.089+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:32.169 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:32.164+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:32.432 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:32.427+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:32.568 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:32.563+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:32.646 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:32.640+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:32.979 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:32.973+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:33.050 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:33.045+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:33.134 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:33.129+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:33.387 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:33.382+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:33.569 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:33.564+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:33.632 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:33.627+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:33.940 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:33.936+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:34.073 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:34.068+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:34.163 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:34.158+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:34.404 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:34.400+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:34.605 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:34.601+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:34.612 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:34.607+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:34.991 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:34.987+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:35.098 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:35.095+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:35.208 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:35.203+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:35.371 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:35.366+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:35.626 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:35.622+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:35.668 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:35.663+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:35.953 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:35.949+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:36.077 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:36.069+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:36.238 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:36.233+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:36.368 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:36.361+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:36.665 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:36.661+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:36.714 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:36.709+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:36.978 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:36.972+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:37.074 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:37.069+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:37.284 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:37.279+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:37.411 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:37.406+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:37.716 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:37.711+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:37.723 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:37.718+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:37.978 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:37.974+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:38.102 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:38.097+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:38.300 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:38.295+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:38.462 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:38.457+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:38.720 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:38.715+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:38.766 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:38.761+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:38.936 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:38.929+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:39.147 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:39.143+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:39.310 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:39.305+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:39.489 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:39.484+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:39.586 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:13:39.581+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e398 v398) 2019-12-09T19:13:39.736 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:39.730+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:39.765 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:39.760+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:39.939 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:39.934+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:40.171 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:40.167+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:40.351 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:40.346+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:40.532 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:40.528+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:40.731 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:40.726+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:40.812 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:40.808+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:40.946 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:40.942+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:41.153 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:41.148+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:41.336 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:41.330+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:41.506 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:41.500+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:41.712 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:41.707+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:41.792 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:41.787+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:41.944 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:41.939+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:42.168 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:42.163+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:42.354 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:42.349+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:42.480 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:42.475+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:42.711 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:42.706+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:42.755 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:42.750+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:42.906 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:42.901+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:43.199 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:43.193+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:43.380 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:43.374+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:43.478 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:43.473+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:43.738 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:43.734+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:43.759 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:43.752+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:43.947 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:43.942+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:44.197 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:44.192+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:44.425 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:44.420+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:44.474 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:44.469+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:44.600 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:13:44.596+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e398 v398) 2019-12-09T19:13:44.786 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:44.781+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:44.787 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:44.782+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:44.973 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:44.968+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:45.242 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:45.238+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:45.402 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:45.398+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:45.494 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:45.489+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:45.772 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:45.767+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:45.797 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:45.792+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:45.966 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:45.961+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:46.206 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:46.201+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:46.404 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:46.396+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:46.460 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:46.455+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:46.794 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:46.789+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:46.815 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:46.809+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:46.984 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:46.979+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:47.200 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:47.195+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:47.425 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:47.418+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:47.503 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:47.497+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:47.811 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:47.806+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:47.832 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:47.826+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:47.981 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:47.977+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:48.226 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:48.221+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:48.425 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:48.419+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:48.532 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:48.526+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:48.864 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:48.860+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:13:48.873 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:13:48.867+0000 1694f700 -1 osd.6 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:27.933933+0000 front 2019-12-09T19:12:25.183735+0000 (oldest deadline 2019-12-09T19:13:07.711182+0000) 2019-12-09T19:13:48.990 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:13:48.985+0000 1694f700 -1 osd.3 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:24.319030+0000 front 2019-12-09T19:12:23.218543+0000 (oldest deadline 2019-12-09T19:13:09.094029+0000) 2019-12-09T19:13:49.272 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:13:49.267+0000 1694f700 -1 osd.0 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.525330+0000 front 2019-12-09T19:12:26.475370+0000 (oldest deadline 2019-12-09T19:13:11.610106+0000) 2019-12-09T19:13:49.440 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:13:49.434+0000 1694f700 -1 osd.7 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.981828+0000 front 2019-12-09T19:12:26.515044+0000 (oldest deadline 2019-12-09T19:13:11.816247+0000) 2019-12-09T19:13:49.506 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:13:49.499+0000 1694f700 -1 osd.4 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:26.687745+0000 front 2019-12-09T19:12:27.075293+0000 (oldest deadline 2019-12-09T19:13:11.256987+0000) 2019-12-09T19:13:49.678 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:13:49.669+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e398 v398) 2019-12-09T19:13:49.866 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:13:49.863+0000 1694f700 -1 osd.1 398 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:12:25.968512+0000 front 2019-12-09T19:12:25.954917+0000 (oldest deadline 2019-12-09T19:13:09.940054+0000) 2019-12-09T19:14:39.729 INFO:tasks.ceph.osd.5.smithi132.stderr:==00:09:35:09.112 10194== Warning: unimplemented fcntl command: 1036 2019-12-09T19:14:39.782 INFO:tasks.ceph.osd.5.smithi132.stderr:==00:09:35:09.164 10194== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:44.551 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:36:42.578 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:44.558 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:36:42.585 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:44.566 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:36:42.529 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:44.568 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:36:42.595 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:44.573 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:36:42.600 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:44.576 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:36:42.539 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:44.843 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:36:42.870 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:44.851 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:36:42.814 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:44.978 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:36:43.005 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:15:46.606 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:15:46.603+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:15:46.678 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:15:46.674+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:15:47.310 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:15:47.303+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:15:47.614 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:15:47.609+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:15:47.682 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:15:47.676+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:15:47.699 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:15:47.694+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:15:47.788 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:15:47.783+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:15:48.087 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:15:48.082+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:15:48.313 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:15:48.307+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:15:48.641 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:15:48.636+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:15:48.703 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:15:48.699+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:15:48.726 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:15:48.718+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:15:48.768 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:15:48.762+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:15:49.113 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:15:49.108+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:15:49.317 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:15:49.311+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:15:49.693 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:15:49.688+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:15:49.703 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:15:49.698+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:15:49.743 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:15:49.737+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:15:49.808 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:15:49.802+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:15:50.152 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:15:50.148+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:15:50.301 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:15:50.292+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:15:50.722 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:15:50.715+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:15:50.723 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:15:50.717+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:15:50.731 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:15:50.725+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:15:50.826 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:15:50.818+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:15:51.201 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:15:51.197+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:15:51.354 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:15:51.348+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:15:51.693 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:15:51.688+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:15:51.755 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:15:51.749+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:15:51.770 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:15:51.766+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:15:51.849 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:15:51.843+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:15:52.207 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:15:52.202+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:15:52.359 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:15:52.353+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:15:52.689 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:15:52.684+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:15:52.727 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:15:52.722+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:15:52.760 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:15:52.753+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:15:52.866 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:15:52.861+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:15:53.225 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:15:53.220+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:15:53.324 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:15:53.317+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:15:53.713 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:15:53.708+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:15:53.729 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:15:53.724+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:15:53.739 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:15:53.735+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:15:53.871 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:15:53.864+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:15:54.251 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:15:54.246+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:15:54.361 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:15:54.354+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:15:54.681 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:15:54.675+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:15:54.705 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:15:54.700+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:15:54.793 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:15:54.786+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:15:54.875 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:15:54.868+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:15:55.221 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:15:55.216+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:15:55.378 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:15:55.372+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:15:55.671 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:15:55.666+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:15:55.713 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:15:55.707+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:15:55.802 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:15:55.797+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:15:55.855 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:15:55.849+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:15:56.255 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:15:56.250+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:15:56.335 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:15:56.328+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:15:56.627 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:15:56.622+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:15:56.717 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:15:56.710+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:15:56.808 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:15:56.804+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:15:56.833 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:15:56.827+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:15:57.227 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:15:57.223+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:15:57.320 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:15:57.313+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:15:57.659 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:15:57.653+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:15:57.764 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:15:57.757+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:15:57.829 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:15:57.824+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:15:57.862 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:15:57.856+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:15:58.239 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:15:58.235+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:15:58.317 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:15:58.310+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:15:58.702 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:15:58.698+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:15:58.765 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:15:58.753+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:15:58.813 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:15:58.809+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:15:58.843 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:15:58.837+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:15:59.210 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:15:59.205+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:15:59.341 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:15:59.335+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:15:59.669 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:15:59.665+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:15:59.722 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:15:59.716+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:15:59.810 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:15:59.804+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:15:59.815 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:15:59.810+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:00.172 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:00.165+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:00.299 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:00.293+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:00.663 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:00.658+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:00.753 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:00.742+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:00.842 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:00.834+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:00.846 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:16:00.840+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:16:01.148 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:01.142+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:01.289 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:01.283+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:01.672 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:01.667+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:01.739 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:01.733+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:01.833 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:16:01.828+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:16:01.875 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:01.870+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:02.169 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:02.165+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:02.253 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:02.248+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:02.709 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:02.704+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:02.716 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:02.711+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:02.811 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:16:02.807+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:16:02.844 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:02.840+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:03.144 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:03.139+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:03.273 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:03.267+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:03.669 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:03.664+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:03.679 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:03.674+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:03.846 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:16:03.841+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:16:03.879 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:03.873+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:04.103 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:04.098+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:04.325 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:04.315+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:04.641 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:04.635+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:04.650 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:04.645+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:04.806 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:16:04.801+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:16:04.859 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:04.854+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:05.142 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:05.137+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:05.333 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:05.329+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:05.614 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:05.609+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:05.677 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:05.672+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:05.770 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:16:05.764+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:16:05.899 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:05.895+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:06.126 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:06.121+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:06.345 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:06.341+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:06.634 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:06.629+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:06.672 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:06.667+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:06.752 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:16:06.747+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:16:06.866 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:06.861+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:07.180 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:07.175+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:07.380 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:07.375+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:07.627 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:07.622+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:07.666 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:07.662+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:07.749 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:16:07.743+0000 1694f700 -1 osd.4 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:02.325239+0000 front 2019-12-09T19:15:02.307972+0000 (oldest deadline 2019-12-09T19:15:47.468199+0000) 2019-12-09T19:16:07.904 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:07.897+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:08.223 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:08.218+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:08.418 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:08.412+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:08.621 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:08.615+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:08.635 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:08.631+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:08.916 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:08.911+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:09.212 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:09.207+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:09.431 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:09.425+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:09.648 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:09.642+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:09.664 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:09.659+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:09.957 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:09.953+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:10.235 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:10.227+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:10.457 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:10.452+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:10.637 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:10.632+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:10.679 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:10.674+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:10.990 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:10.986+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:11.213 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:11.204+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:11.423 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:11.418+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:11.621 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:11.615+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:11.643 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:11.638+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:12.012 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:12.006+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:12.200 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:12.194+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:12.388 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:12.383+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:12.657 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:12.653+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:12.687 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:12.683+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:12.992 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:12.988+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:13.197 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:13.192+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:13.398 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:13.392+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:13.641 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:13.636+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:13.681 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:13.676+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:13.952 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:13.947+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:14.174 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:14.169+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:14.426 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:14.419+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:14.662 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:14.657+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:14.691 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:14.686+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:14.958 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:14.953+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:15.163 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:15.158+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:15.409 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:15.402+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:15.635 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:15.629+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:15.674 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:15.670+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:15.938 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:15.934+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:16.193 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:16.189+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:16.443 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:16.439+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:16.593 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:16.589+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:16.656 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:16.651+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:16.977 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:16.972+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:17.205 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:17.200+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:17.484 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:17.477+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:17.605 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:17.600+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:17.623 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:17.617+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:17.990 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:17.985+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:18.208 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:18.203+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:18.524 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:18.518+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:18.646 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:18.641+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:18.654 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:18.649+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:18.997 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:18.993+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:19.229 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:19.224+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:19.511 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:19.505+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:19.663 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:19.659+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:19.703 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:19.697+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:20.030 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:20.025+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:20.244 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:20.239+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:20.322 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:16:20.319+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e409 v409) 2019-12-09T19:16:20.561 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:20.554+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:20.619 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:20.614+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:20.713 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:20.707+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:21.070 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:21.065+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:21.221 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:21.217+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:21.594 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:21.588+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:21.600 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:21.595+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:21.718 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:21.711+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:22.076 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:22.070+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:22.242 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:22.237+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:22.568 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:22.563+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:22.601 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:22.595+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:22.693 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:22.687+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:23.057 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:23.052+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:23.295 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:23.291+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:23.596 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:23.590+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:23.597 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:23.591+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:23.722 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:23.715+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:24.039 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:24.034+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:24.256 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:24.251+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:24.571 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:24.567+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:24.587 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:24.582+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:24.729 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:24.723+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:25.059 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:25.055+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:25.260 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:25.255+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:25.343 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:16:25.339+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e409 v409) 2019-12-09T19:16:25.566 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:25.562+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:25.575 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:25.569+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:25.740 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:25.734+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:26.014 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:26.010+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:26.260 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:26.255+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:26.561 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:26.557+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:26.598 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:26.592+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:26.726 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:26.719+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:27.009 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:27.005+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:27.234 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:27.229+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:27.571 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:27.566+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:27.574 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:27.568+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:27.693 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:27.687+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:27.999 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:27.995+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:28.281 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:28.271+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:28.591 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:28.585+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:28.603 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:28.597+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:28.692 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:28.687+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:29.031 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:29.027+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:29.231 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:29.226+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:29.559 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:29.554+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:29.643 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:16:29.637+0000 1694f700 -1 osd.7 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.264103+0000 front 2019-12-09T19:15:04.311186+0000 (oldest deadline 2019-12-09T19:15:46.359286+0000) 2019-12-09T19:16:29.661 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:16:29.654+0000 1694f700 -1 osd.6 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.173420+0000 front 2019-12-09T19:15:05.161309+0000 (oldest deadline 2019-12-09T19:15:46.948652+0000) 2019-12-09T19:16:30.034 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:16:30.030+0000 1694f700 -1 osd.1 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.545398+0000 front 2019-12-09T19:15:04.309983+0000 (oldest deadline 2019-12-09T19:15:46.125057+0000) 2019-12-09T19:16:30.204 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:16:30.199+0000 1694f700 -1 osd.3 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:03.269568+0000 front 2019-12-09T19:15:02.584295+0000 (oldest deadline 2019-12-09T19:15:47.670019+0000) 2019-12-09T19:16:30.425 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:16:30.417+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e409 v409) 2019-12-09T19:16:30.520 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:16:30.515+0000 1694f700 -1 osd.0 409 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:15:05.109604+0000 front 2019-12-09T19:15:06.387165+0000 (oldest deadline 2019-12-09T19:15:46.041837+0000) 2019-12-09T19:16:36.568 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:16:36.560+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 2 pgs recovery_unfound (PG_DAMAGED) 2019-12-09T19:17:15.741 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:38:13.765 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:15.774 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:38:13.801 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:15.802 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:38:13.829 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:15.805 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:38:13.832 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:15.852 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:38:13.815 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:15.860 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:38:13.887 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:15.862 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:38:13.825 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:15.899 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:38:13.926 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:16.031 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:38:13.994 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:19.682 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:17:19.455+0000 33a73700 -1 osd.0 413 build_incremental_map_msg missing incremental map 413 2019-12-09T19:17:19.799 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:17:19.607+0000 34a75700 -1 osd.0 413 build_incremental_map_msg missing incremental map 413 2019-12-09T19:17:19.809 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:17:19.656+0000 34274700 -1 osd.0 413 build_incremental_map_msg missing incremental map 413 2019-12-09T19:17:19.950 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:17:19.680+0000 35276700 -1 osd.0 413 build_incremental_map_msg missing incremental map 413 2019-12-09T19:17:19.966 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:17:19.754+0000 37a7b700 -1 osd.0 413 build_incremental_map_msg missing incremental map 413 2019-12-09T19:17:31.153 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:38:29.180 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:31.157 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:38:29.184 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:31.204 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:38:29.167 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:31.212 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:38:29.238 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:31.212 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:38:29.175 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:31.221 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:38:29.247 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:31.227 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:38:29.254 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:31.283 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:38:29.309 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:17:31.309 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:38:29.272 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:18:07.239 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:07.235+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:08.034 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:18:08.026+0000 1694f700 -1 osd.1 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.070178+0000 front 2019-12-09T19:17:41.912272+0000 (oldest deadline 2019-12-09T19:18:07.150873+0000) 2019-12-09T19:18:08.221 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:08.217+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:08.996 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:18:08.992+0000 1694f700 -1 osd.1 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.070178+0000 front 2019-12-09T19:17:41.912272+0000 (oldest deadline 2019-12-09T19:18:07.150873+0000) 2019-12-09T19:18:09.201 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:09.198+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:10.021 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:18:10.017+0000 1694f700 -1 osd.1 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.070178+0000 front 2019-12-09T19:17:41.912272+0000 (oldest deadline 2019-12-09T19:18:07.150873+0000) 2019-12-09T19:18:10.097 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:10.094+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:10.242 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:10.238+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:11.031 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:18:11.027+0000 1694f700 -1 osd.1 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.070178+0000 front 2019-12-09T19:17:41.912272+0000 (oldest deadline 2019-12-09T19:18:07.150873+0000) 2019-12-09T19:18:11.151 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:11.147+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:11.248 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:11.244+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:12.006 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:18:12.001+0000 1694f700 -1 osd.1 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.070178+0000 front 2019-12-09T19:17:41.912272+0000 (oldest deadline 2019-12-09T19:18:07.150873+0000) 2019-12-09T19:18:12.123 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:12.119+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:12.269 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:12.265+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:13.047 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:18:13.043+0000 1694f700 -1 osd.1 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.070178+0000 front 2019-12-09T19:17:41.912272+0000 (oldest deadline 2019-12-09T19:18:07.150873+0000) 2019-12-09T19:18:13.082 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:13.078+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:13.245 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:13.241+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:14.072 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:14.066+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:14.078 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:18:14.073+0000 1694f700 -1 osd.1 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.070178+0000 front 2019-12-09T19:17:41.912272+0000 (oldest deadline 2019-12-09T19:18:07.150873+0000) 2019-12-09T19:18:14.216 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:14.209+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:15.049 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:15.044+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:15.094 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:18:15.090+0000 1694f700 -1 osd.1 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.070178+0000 front 2019-12-09T19:17:41.912272+0000 (oldest deadline 2019-12-09T19:18:07.150873+0000) 2019-12-09T19:18:15.217 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:15.213+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:16.041 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:16.037+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:16.096 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:18:16.092+0000 1694f700 -1 osd.1 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.070178+0000 front 2019-12-09T19:17:41.912272+0000 (oldest deadline 2019-12-09T19:18:07.150873+0000) 2019-12-09T19:18:16.252 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:16.247+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:17.075 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:17.071+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:17.081 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:18:17.076+0000 1694f700 -1 osd.1 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.070178+0000 front 2019-12-09T19:17:41.912272+0000 (oldest deadline 2019-12-09T19:18:07.150873+0000) 2019-12-09T19:18:17.266 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:17.261+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:18.075 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:18:18.070+0000 1694f700 -1 osd.1 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.070178+0000 front 2019-12-09T19:17:41.912272+0000 (oldest deadline 2019-12-09T19:18:07.150873+0000) 2019-12-09T19:18:18.116 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:18.112+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:18.282 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:18.277+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:19.033 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:18:19.028+0000 1694f700 -1 osd.1 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.070178+0000 front 2019-12-09T19:17:41.912272+0000 (oldest deadline 2019-12-09T19:18:07.150873+0000) 2019-12-09T19:18:19.133 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:19.128+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:19.290 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:19.285+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:19.964 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:19.957+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:20.001 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:18:19.997+0000 1694f700 -1 osd.1 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.070178+0000 front 2019-12-09T19:17:41.912272+0000 (oldest deadline 2019-12-09T19:18:07.150873+0000) 2019-12-09T19:18:20.118 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:20.113+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:20.307 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:20.302+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:20.950 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:20.944+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:21.005 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:18:21.000+0000 1694f700 -1 osd.1 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.070178+0000 front 2019-12-09T19:17:41.912272+0000 (oldest deadline 2019-12-09T19:18:07.150873+0000) 2019-12-09T19:18:21.111 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:21.102+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:21.278 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:21.273+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:21.916 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:21.910+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:21.965 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:18:21.960+0000 1694f700 -1 osd.1 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.070178+0000 front 2019-12-09T19:17:41.912272+0000 (oldest deadline 2019-12-09T19:18:07.150873+0000) 2019-12-09T19:18:22.071 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:22.066+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:22.259 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:22.254+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:22.900 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:22.894+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:22.943 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:18:22.939+0000 1694f700 -1 osd.1 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.070178+0000 front 2019-12-09T19:17:41.912272+0000 (oldest deadline 2019-12-09T19:18:07.150873+0000) 2019-12-09T19:18:23.110 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:23.105+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:23.240 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:23.235+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:23.890 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:23.884+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:24.095 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:24.091+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:24.208 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:24.204+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:24.934 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:24.928+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:25.053 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:25.048+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:25.214 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:25.210+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:25.933 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:25.926+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:26.044 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:26.038+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:26.155 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:26.148+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:26.265 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:26.259+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:26.595 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:26.589+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:26.905 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:26.899+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:27.013 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:27.007+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:27.206 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:27.201+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:27.234 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:27.230+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:27.639 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:27.630+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:27.949 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:27.943+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:27.970 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:27.965+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:28.226 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:28.221+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:28.259 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:28.253+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:28.628 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:28.622+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:28.925 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:28.919+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:28.926 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:28.921+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:29.205 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:29.200+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:29.294 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:29.289+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:29.655 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:29.648+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:29.883 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:29.878+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:29.969 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:29.963+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:30.240 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:30.235+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:30.313 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:30.305+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:30.673 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:30.667+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:30.904 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:30.899+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:31.019 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:31.013+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:31.213 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:31.204+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:31.359 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:31.352+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:31.707 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:31.695+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:31.919 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:31.914+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:32.068 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:32.061+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:32.192 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:32.185+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:32.350 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:32.345+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:32.687 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:32.680+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:32.879 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:32.875+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:33.106 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:33.101+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:33.226 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:33.221+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:33.407 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:33.401+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:33.693 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:33.688+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:33.849 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:33.844+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:34.108 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:34.103+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:34.206 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:34.201+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:34.372 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:34.368+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:34.744 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:34.738+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:34.877 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:34.871+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:35.124 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:35.119+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:35.225 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:35.220+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:35.360 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:35.355+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:35.792 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:35.787+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:35.870 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:35.865+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:36.162 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:36.156+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:36.210 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:36.205+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:36.334 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:36.329+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:36.838 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:36.833+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:36.883 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:36.878+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:37.163 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:37.157+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:37.253 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:37.248+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:37.379 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:37.373+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:37.874 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:37.868+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:37.900 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:37.895+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:38.133 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:38.127+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:38.210 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:38.205+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:38.342 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:38.337+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:38.840 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:38.835+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:38.892 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:38.887+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:39.088 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:39.082+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:39.255 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:39.245+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:39.385 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:39.374+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:39.856 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:39.851+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:39.865 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:39.860+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:40.060 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:40.054+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:40.245 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:40.239+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:40.429 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:40.424+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:40.871 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:40.866+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:40.915 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:40.911+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:41.058 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:41.051+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:41.274 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:41.269+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:41.298 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:18:41.294+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 31sec e420 v420) 2019-12-09T19:18:41.451 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:41.446+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:41.876 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:41.871+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:41.918 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:41.913+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:42.078 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:42.073+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:42.251 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:42.246+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:42.411 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:42.406+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:42.900 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:42.894+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:42.909 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:42.904+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:43.041 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:43.036+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:43.218 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:43.213+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:43.428 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:43.423+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:43.867 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:43.861+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:43.907 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:43.902+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:44.018 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:44.013+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:44.257 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:44.252+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:44.394 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:44.388+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:44.865 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:44.857+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:44.890 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:44.885+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:45.055 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:45.050+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:45.236 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:45.231+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:45.380 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:45.376+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:45.906 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:45.901+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:45.913 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:45.908+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:46.085 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:46.080+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:46.231 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:46.226+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:46.314 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:18:46.308+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 31sec e420 v420) 2019-12-09T19:18:46.413 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:46.409+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:46.870 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:46.864+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:46.900 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:46.895+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:47.134 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:47.129+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:47.275 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:47.270+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:47.411 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:47.406+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:47.856 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:47.851+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:47.872 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:47.866+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:48.134 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:48.129+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:48.315 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:48.311+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:48.392 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:48.387+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:48.832 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:48.827+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:48.880 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:48.875+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:49.149 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:49.144+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:49.363 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:49.357+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:49.413 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:49.404+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:49.790 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:49.785+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:49.887 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:49.882+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:50.193 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:50.187+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:50.383 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:50.377+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:50.395 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:50.389+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:50.801 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:50.795+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:50.858 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:50.853+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:51.244 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:51.238+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:51.329 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:18:51.324+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 31sec e420 v420) 2019-12-09T19:18:51.350 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:51.345+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:51.416 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:51.410+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:51.812 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:51.806+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:51.847 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:51.842+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:52.254 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:52.247+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:52.395 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:52.390+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:52.412 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:52.406+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:52.818 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:52.812+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:52.853 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:52.848+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:53.209 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:53.203+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:53.384 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:53.378+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:53.439 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:53.435+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:53.788 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:53.782+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:53.821 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:53.816+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:54.184 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:54.177+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:54.351 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:54.345+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:54.462 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:54.457+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:54.784 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:54.779+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:54.785 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:54.778+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:55.170 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:55.163+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:55.350 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:55.339+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:55.453 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:55.448+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:55.785 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:55.780+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:55.814 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:55.807+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:56.221 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:56.216+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:56.353 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:18:56.347+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 31sec e420 v420) 2019-12-09T19:18:56.356 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:56.351+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:56.501 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:56.497+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:56.808 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:56.802+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:56.820 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:56.816+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:57.254 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:57.248+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:57.316 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:57.310+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:57.484 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:57.479+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:57.830 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:57.825+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:57.850 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:57.844+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:58.254 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:58.248+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:58.355 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:58.350+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:58.506 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:58.501+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:58.837 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:58.832+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:58.888 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:58.882+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:18:59.280 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:18:59.273+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:18:59.403 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:18:59.397+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:18:59.504 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:18:59.499+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:18:59.869 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:18:59.864+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:18:59.907 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:18:59.900+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:19:00.250 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:19:00.244+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:19:00.446 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:19:00.441+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:19:00.500 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:19:00.495+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:19:00.877 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:19:00.871+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:19:00.903 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:19:00.891+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:19:01.227 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:19:01.221+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:19:01.367 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:19:01.362+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 31sec e420 v420) 2019-12-09T19:19:01.428 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:19:01.422+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:19:01.501 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:19:01.496+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:19:01.844 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:19:01.838+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:19:01.929 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:19:01.924+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:19:02.252 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:19:02.246+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:19:02.390 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:19:02.384+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:19:02.536 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:19:02.531+0000 1694f700 -1 osd.0 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.797659+0000 front 2019-12-09T19:17:22.321985+0000 (oldest deadline 2019-12-09T19:18:07.137093+0000) 2019-12-09T19:19:02.844 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:19:02.838+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:19:02.933 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:19:02.928+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:19:03.243 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:19:03.238+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:19:03.443 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:19:03.433+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:19:03.818 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:19:03.812+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:19:03.910 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:19:03.905+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:19:04.279 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:19:04.272+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:19:04.407 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:19:04.401+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:19:04.781 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:19:04.774+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:19:04.909 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:19:04.893+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:19:05.323 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:19:05.316+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:19:05.367 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:19:05.360+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:19:05.818 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:19:05.812+0000 1694f700 -1 osd.4 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:41.104153+0000 front 2019-12-09T19:17:41.101587+0000 (oldest deadline 2019-12-09T19:18:25.763642+0000) 2019-12-09T19:19:05.855 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:19:05.850+0000 1694f700 -1 osd.3 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:40.055076+0000 front 2019-12-09T19:17:41.607971+0000 (oldest deadline 2019-12-09T19:18:09.875775+0000) 2019-12-09T19:19:06.329 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:19:06.323+0000 1694f700 -1 osd.7 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:42.431716+0000 front 2019-12-09T19:17:42.371739+0000 (oldest deadline 2019-12-09T19:18:25.855644+0000) 2019-12-09T19:19:06.371 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:19:06.365+0000 1694f700 -1 osd.6 420 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:17:39.122670+0000 front 2019-12-09T19:17:40.437186+0000 (oldest deadline 2019-12-09T19:18:19.068566+0000) 2019-12-09T19:19:06.522 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:19:06.509+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 31sec e420 v420) 2019-12-09T19:19:13.093 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:19:13.086+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T19:19:21.564 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:19:21.547+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 2 pgs recovery_unfound (PG_DAMAGED) 2019-12-09T19:19:46.890 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:40:44.917 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:19:46.903 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:40:44.930 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:19:46.916 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:40:44.879 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:19:46.918 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:40:44.945 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:19:46.923 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:40:44.949 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:19:46.926 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:40:44.889 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:19:47.095 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:40:45.123 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:19:47.113 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:40:45.140 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:19:47.123 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:40:45.087 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:20:53.812 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:20:53.805+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:20:54.452 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:20:54.446+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:20:54.549 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:20:54.544+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:20:54.827 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:20:54.821+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:20:54.970 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:20:54.965+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:20:55.479 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:20:55.472+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:20:55.543 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:20:55.538+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:20:55.854 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:20:55.848+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:20:55.935 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:20:55.930+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:20:56.458 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:20:56.450+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:20:56.576 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:20:56.571+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:20:56.849 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:20:56.843+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:20:56.947 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:20:56.942+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:20:57.413 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:20:57.407+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:20:57.613 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:20:57.608+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:20:57.894 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:20:57.887+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:20:57.918 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:20:57.913+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:20:58.156 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:20:58.150+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:20:58.461 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:20:58.456+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:20:58.649 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:20:58.645+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:20:58.865 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:20:58.859+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:20:58.902 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:20:58.898+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:20:58.965 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:20:58.958+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:20:59.131 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:20:59.126+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:20:59.497 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:20:59.490+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:20:59.625 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:20:59.621+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:20:59.867 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:20:59.860+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:20:59.901 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:20:59.896+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:20:59.983 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:20:59.978+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:00.130 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:00.125+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:00.525 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:00.519+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:00.613 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:00.608+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:00.861 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:00.855+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:00.920 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:00.915+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:00.988 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:00.981+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:01.167 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:01.161+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:01.482 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:01.477+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:01.592 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:01.588+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:01.841 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:01.835+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:01.917 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:01.912+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:01.991 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:01.984+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:02.188 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:02.183+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:02.470 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:02.465+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:02.564 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:02.559+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:02.876 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:02.869+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:02.965 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:02.960+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:02.975 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:02.969+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:03.177 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:03.171+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:03.485 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:03.479+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:03.552 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:03.548+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:03.927 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:03.921+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:03.949 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:03.944+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:03.961 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:03.958+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:04.198 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:04.195+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:04.498 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:04.492+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:04.606 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:04.601+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:04.910 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:04.904+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:04.949 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:04.944+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:04.959 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:04.955+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:05.217 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:05.213+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:05.462 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:05.457+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:05.658 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:05.654+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:05.862 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:05.857+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:05.928 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:05.923+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:05.987 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:05.983+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:06.199 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:06.194+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:06.492 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:06.487+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:06.638 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:06.633+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:06.831 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:06.826+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:06.951 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:06.945+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:06.981 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:06.975+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:07.215 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:07.210+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:07.462 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:07.457+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:07.597 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:07.592+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:07.869 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:07.863+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:07.926 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:07.921+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:07.939 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:07.933+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:08.224 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:08.219+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:08.453 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:08.448+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:08.577 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:08.571+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:08.919 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:08.914+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:08.938 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:08.933+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:08.949 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:08.945+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:09.214 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:09.209+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:09.438 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:09.433+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:09.564 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:09.559+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:09.902 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:09.897+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:09.934 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:09.929+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:09.950 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:09.945+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:10.181 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:10.176+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:10.454 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:10.449+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:10.597 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:10.593+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:10.900 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:10.894+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:10.961 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:10.956+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:10.987 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:10.982+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:11.173 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:11.167+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:11.501 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:11.495+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:11.625 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:11.620+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:11.935 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:11.929+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:11.962 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:11.957+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:11.992 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:11.987+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:12.221 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:12.216+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:12.467 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:12.461+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:12.658 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:12.654+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:12.943 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:12.938+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:12.970 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:12.964+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:13.009 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:13.004+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:13.262 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:13.257+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:13.498 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:13.493+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:13.615 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:13.610+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:13.934 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:13.929+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:13.956 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:13.951+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:13.974 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:13.969+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:14.297 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:14.292+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:14.507 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:14.501+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:14.621 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:14.617+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:14.933 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:14.929+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:14.963 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:14.959+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:14.982 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:14.977+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:15.301 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:15.296+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:15.546 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:15.541+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:15.651 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:15.648+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:15.925 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:15.920+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:15.960 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:15.955+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:15.974 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:15.970+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:16.294 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:16.289+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:16.556 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:16.551+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:16.664 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:16.657+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:16.921 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:16.916+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:16.924 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:16.918+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:16.946 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:16.941+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:17.329 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:17.325+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:17.578 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:17.572+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:17.628 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:17.618+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:17.890 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:17.885+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:17.894 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:17.889+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:17.912 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:17.907+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:18.318 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:18.314+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:18.589 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:18.582+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:18.619 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:18.615+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:18.858 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:18.854+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:18.894 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:18.888+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:18.914 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:18.909+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:19.336 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:19.332+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:19.576 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:19.571+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:19.625 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:19.621+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:19.845 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:19.840+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:19.890 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:19.885+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:19.928 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:19.924+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:20.296 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:20.291+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:20.596 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:20.591+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:20.676 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:20.672+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:20.812 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:20.807+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:20.941 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:20.937+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:20.942 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:20.936+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:21.293 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:21.289+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:21.594 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:21.587+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:21.639 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:21.635+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:21.814 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:21.803+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:21.928 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:21.922+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:21.938 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:21.933+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:22.273 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:22.268+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:22.603 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:22.596+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:22.626 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:22.621+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:22.865 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:22.858+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:22.908 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:22.902+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:22.969 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:22.965+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:23.282 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:23.279+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:23.602 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:23.596+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:23.620 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:23.616+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:23.886 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:23.879+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:23.910 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:23.904+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:24.013 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:24.009+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:24.281 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:24.277+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:24.637 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:24.631+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:24.641 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:24.637+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:24.921 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:24.915+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:24.933 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:24.927+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:24.990 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:24.985+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:25.335 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:25.330+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:25.608 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:25.603+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:25.657 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:25.651+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:25.923 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:25.916+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:25.957 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:25.953+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:25.988 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:25.981+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:26.322 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:26.317+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:26.640 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:26.636+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:26.686 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:26.679+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:26.944 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:26.938+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:26.949 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:26.943+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:27.006 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:27.001+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:27.033 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:21:27.030+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e430 v430) 2019-12-09T19:21:27.289 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:27.285+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:27.625 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:27.621+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:27.663 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:27.657+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:27.924 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:27.918+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:27.992 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:27.986+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:28.058 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:28.053+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:28.309 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:28.304+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:28.589 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:28.584+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:28.626 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:28.619+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:28.901 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:28.895+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:28.946 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:28.940+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:29.056 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:29.047+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:29.305 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:29.301+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:29.605 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:29.600+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:29.669 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:29.663+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:29.937 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:29.931+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:29.949 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:29.942+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:30.069 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:30.064+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:30.344 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:30.339+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:30.562 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:30.558+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:30.718 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:30.711+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:30.939 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:30.932+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:30.955 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:30.948+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:31.099 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:31.094+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:31.358 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:31.354+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:31.580 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:31.575+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:31.735 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:31.729+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:31.958 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:31.952+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:31.971 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:31.965+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:32.051 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:21:32.048+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e430 v430) 2019-12-09T19:21:32.110 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:32.106+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:32.368 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:32.363+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:32.566 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:32.561+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:32.729 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:32.723+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:32.928 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:32.921+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:32.962 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:32.956+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:33.138 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:33.133+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:33.402 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:33.398+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:33.528 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:33.523+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:33.755 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:33.749+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:33.906 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:33.900+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:33.919 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:33.913+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:34.116 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:34.101+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:34.415 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:34.409+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:34.517 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:34.513+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:34.754 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:34.749+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:34.951 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:34.946+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:34.967 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:34.961+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:35.058 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:35.054+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:35.374 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:35.369+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:35.498 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:35.494+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:35.798 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:35.792+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:35.996 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:35.989+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:36.008 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:36.002+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:36.047 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:36.042+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:36.397 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:21:36.393+0000 1694f700 -1 osd.0 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:12.783985+0000 front 2019-12-09T19:20:12.884165+0000 (oldest deadline 2019-12-09T19:20:57.529178+0000) 2019-12-09T19:21:36.486 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:21:36.481+0000 1694f700 -1 osd.3 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:15.703438+0000 front 2019-12-09T19:20:12.318857+0000 (oldest deadline 2019-12-09T19:20:54.305578+0000) 2019-12-09T19:21:36.850 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:21:36.843+0000 1694f700 -1 osd.4 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.364938+0000 front 2019-12-09T19:20:11.564524+0000 (oldest deadline 2019-12-09T19:20:54.065249+0000) 2019-12-09T19:21:36.976 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:21:36.970+0000 1694f700 -1 osd.7 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:13.551232+0000 front 2019-12-09T19:20:13.553603+0000 (oldest deadline 2019-12-09T19:20:58.044724+0000) 2019-12-09T19:21:36.984 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:21:36.979+0000 1694f700 -1 osd.6 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:11.563344+0000 front 2019-12-09T19:20:11.565054+0000 (oldest deadline 2019-12-09T19:20:52.861267+0000) 2019-12-09T19:21:37.010 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:21:37.005+0000 1694f700 -1 osd.1 430 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:20:10.858078+0000 front 2019-12-09T19:20:10.860379+0000 (oldest deadline 2019-12-09T19:20:54.763743+0000) 2019-12-09T19:21:37.126 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:21:37.120+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e430 v430) 2019-12-09T19:21:43.344 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:21:43.341+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T19:21:52.168 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:21:52.159+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 2 pgs recovery_unfound (PG_DAMAGED) 2019-12-09T19:22:27.687 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:22:27.571+0000 3b282700 -1 osd.5 435 build_incremental_map_msg missing incremental map 435 2019-12-09T19:22:27.701 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:22:27.578+0000 33a73700 -1 osd.5 435 build_incremental_map_msg missing incremental map 435 2019-12-09T19:22:27.739 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:22:27.605+0000 3b282700 -1 osd.5 435 build_incremental_map_msg missing incremental map 435 2019-12-09T19:22:27.930 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:22:27.750+0000 114ae700 -1 osd.5 435 build_incremental_map_msg missing incremental map 435 2019-12-09T19:22:28.018 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:22:27.777+0000 38a7d700 -1 osd.5 435 build_incremental_map_msg missing incremental map 435 2019-12-09T19:22:28.213 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:22:27.902+0000 34274700 -1 osd.5 435 build_incremental_map_msg missing incremental map 435 2019-12-09T19:22:29.119 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:22:29.111+0000 35276700 -1 osd.5 435 build_incremental_map_msg missing incremental map 435 2019-12-09T19:23:33.536 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:33.531+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:34.511 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:34.504+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:34.518 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:34.512+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:35.168 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:35.163+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:35.544 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:35.539+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:35.557 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:35.550+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:35.649 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:35.643+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:36.121 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:36.116+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:36.519 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:36.513+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:36.548 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:36.542+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:36.626 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:36.620+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:37.127 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:37.123+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:37.511 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:37.502+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:37.572 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:37.565+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:37.622 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:37.617+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:37.914 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:37.909+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:38.174 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:38.169+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:38.469 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:38.465+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:38.564 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:38.559+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:38.651 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:38.646+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:38.925 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:38.921+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:38.929 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:38.924+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:39.191 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:39.187+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:39.503 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:39.498+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:39.524 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:39.518+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:39.621 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:39.616+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:39.895 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:39.890+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:39.922 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:39.918+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:40.198 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:40.193+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:40.498 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:40.493+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:40.503 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:40.497+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:40.641 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:40.636+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:40.881 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:40.877+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:40.919 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:40.915+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:41.207 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:41.201+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:41.458 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:41.453+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:41.547 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:41.542+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:41.670 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:41.665+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:41.896 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:41.891+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:41.905 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:41.901+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:42.220 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:42.214+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:42.466 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:42.460+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:42.593 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:42.587+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:42.667 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:42.661+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:42.912 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:42.907+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:42.960 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:42.954+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:43.271 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:43.266+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:43.433 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:43.428+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:43.590 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:43.586+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:43.704 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:43.695+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:43.748 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:44:41.775 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:23:43.763 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:44:41.790 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:23:43.776 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:44:41.739 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:23:43.782 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:44:41.745 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:23:43.783 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:44:41.811 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:23:43.792 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:44:41.819 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:23:43.946 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:43.939+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:44.002 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:43.998+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:44.059 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:44:42.022 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:23:44.101 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:44:42.128 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:23:44.107 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:44:42.134 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:23:44.268 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:44.262+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:44.472 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:44.467+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:44.561 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:44.557+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:44.700 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:44.695+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:44.917 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:44.913+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:45.006 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:45.003+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:45.272 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:45.268+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:45.473 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:45.468+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:45.581 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:45.576+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:45.741 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:45.733+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:45.909 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:45.904+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:46.045 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:46.041+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:46.228 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:46.223+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:46.458 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:46.449+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:46.625 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:46.620+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:46.709 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:46.704+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:46.895 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:46.890+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:47.037 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:47.032+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:47.284 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:47.279+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:47.434 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:47.421+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:47.660 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:47.655+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:47.715 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:47.709+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:47.900 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:47.895+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:47.998 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:47.993+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:48.282 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:48.277+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:48.473 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:48.467+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:48.692 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:48.687+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:48.709 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:48.704+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:48.935 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:48.930+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:49.036 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:49.032+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:49.327 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:49.322+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:49.435 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:49.430+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:49.726 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:49.715+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:49.742 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:49.738+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:49.913 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:49.908+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:50.057 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:50.053+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:50.331 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:50.326+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:50.471 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:50.466+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:50.683 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:50.677+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:50.711 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:50.707+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:50.925 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:50.914+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:51.065 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:51.060+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:51.315 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:51.310+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:51.517 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:51.512+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:51.679 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:51.674+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:51.728 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:51.723+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:51.899 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:51.894+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:52.042 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:52.038+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:52.305 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:52.300+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:52.527 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:52.521+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:52.689 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:52.685+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:52.755 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:52.749+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:52.925 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:52.919+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:53.098 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:53.093+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:53.318 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:53.312+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:53.505 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:53.498+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:53.650 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:53.645+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:53.767 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:53.759+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:53.921 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:53.916+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:54.079 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:54.074+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:54.337 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:54.330+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:54.467 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:54.457+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:54.651 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:54.646+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:54.719 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:54.712+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:54.964 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:54.958+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:55.062 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:55.057+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:55.359 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:55.354+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:55.499 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:55.493+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:55.624 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:55.619+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:55.712 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:55.706+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:55.919 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:55.914+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:56.088 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:56.083+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:56.343 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:56.338+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:56.541 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:56.535+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:56.670 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:56.666+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:56.674 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:56.667+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:56.963 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:56.958+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:57.087 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:57.082+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:57.339 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:57.332+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:57.519 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:57.513+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:57.709 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:57.704+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:57.714 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:57.709+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:57.921 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:57.916+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:58.077 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:58.070+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:58.339 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:58.333+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:58.506 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:58.500+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:58.742 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:58.736+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:58.758 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:58.754+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:58.904 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:58.900+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:23:59.100 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:23:59.095+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:23:59.352 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:23:59.346+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:23:59.521 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:23:59.514+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:23:59.705 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:23:59.698+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:23:59.760 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:23:59.756+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:23:59.930 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:23:59.925+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:00.090 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:00.085+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:00.398 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:00.392+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:00.546 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:00.540+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:00.708 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:00.702+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:00.737 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:00.732+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:00.915 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:00.911+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:01.093 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:01.089+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:01.426 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:01.359+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:01.567 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:01.561+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:01.711 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:01.705+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:01.718 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:01.714+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:01.886 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:01.881+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:02.147 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:02.142+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:02.410 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:02.401+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:02.603 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:02.596+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:02.719 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:02.716+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:02.720 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:02.714+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:02.912 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:02.908+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:03.198 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:03.193+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:03.366 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:03.360+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:03.595 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:03.588+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:03.689 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:03.683+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:03.720 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:03.714+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:03.901 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:03.896+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:04.180 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:04.175+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:04.380 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:04.373+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:04.617 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:04.611+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:04.675 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:04.670+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:04.735 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:04.729+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:04.930 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:04.926+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:05.218 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:05.213+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:05.340 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:05.335+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:05.632 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:05.626+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:05.654 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:05.649+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:05.775 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:05.769+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:05.945 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:05.941+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:06.205 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:06.201+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:06.346 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:06.340+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:06.637 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:06.631+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:06.697 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:06.693+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:06.818 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:06.812+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:06.907 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:06.902+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:07.169 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:07.165+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:07.392 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:07.385+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:07.625 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:24:07.621+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e442 v442) 2019-12-09T19:24:07.685 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:07.678+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:07.732 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:07.729+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:07.779 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:07.773+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:07.922 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:07.918+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:08.188 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:08.184+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:08.402 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:08.396+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:08.685 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:08.679+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:08.716 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:08.711+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:08.821 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:08.815+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:08.971 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:08.966+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:09.177 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:09.173+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:09.393 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:09.386+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:09.656 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:09.649+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:09.770 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:09.765+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:09.779 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:09.772+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:09.932 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:09.927+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:10.155 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:10.150+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:10.423 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:10.416+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:10.623 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:10.617+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:10.753 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:10.749+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:10.776 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:10.769+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:10.939 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:10.934+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:11.193 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:11.188+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:11.425 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:11.418+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:11.576 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:11.570+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:11.706 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:11.702+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:11.814 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:11.808+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:11.985 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:11.980+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:12.190 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:12.185+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:12.381 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:12.375+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:12.592 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:12.586+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:12.728 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:12.725+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:12.770 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:24:12.766+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e442 v442) 2019-12-09T19:24:12.849 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:12.844+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:12.987 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:12.985+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:13.222 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:13.220+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:13.357 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:13.352+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:13.615 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:13.609+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:13.758 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:13.754+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:13.819 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:13.813+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:13.948 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:13.945+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:14.190 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:14.187+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:14.347 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:14.343+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:14.583 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:14.577+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:14.772 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:14.767+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:14.826 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:14.821+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:14.942 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:14.939+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:15.245 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:15.242+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:15.321 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:15.317+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:15.609 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:15.603+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:15.815 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:15.813+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:15.834 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:15.829+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:15.903 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:15.899+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:16.230 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:16.226+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:16.336 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:16.332+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:16.568 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:16.562+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:16.780 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:16.777+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:16.804 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:16.799+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:16.882 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:16.878+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:17.254 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:17.251+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:17.382 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:17.376+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:17.543 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:17.536+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:17.784 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:17.778+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:17.789 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:24:17.784+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e442 v442) 2019-12-09T19:24:17.791 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:17.787+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:17.869 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:17.865+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:18.279 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:18.275+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:18.378 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:18.373+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:18.560 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:18.554+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:18.742 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:18.737+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:18.793 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:18.789+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:18.917 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:18.914+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:19.330 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:19.326+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:19.426 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:19.420+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:19.564 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:19.559+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:19.758 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:19.754+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:19.790 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:19.785+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:19.946 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:19.942+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:20.316 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:20.310+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:20.383 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:20.378+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:20.602 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:20.597+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:20.751 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:20.747+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:20.823 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:20.818+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:20.938 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:20.933+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:21.341 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:21.337+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:21.345 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:21.340+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:21.635 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:21.630+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:21.784 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:21.779+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:21.847 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:21.842+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:21.972 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:24:21.967+0000 1694f700 -1 osd.1 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.880810+0000 front 2019-12-09T19:22:53.882655+0000 (oldest deadline 2019-12-09T19:23:37.154067+0000) 2019-12-09T19:24:22.310 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:24:22.305+0000 1694f700 -1 osd.7 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:49.096277+0000 front 2019-12-09T19:22:52.172541+0000 (oldest deadline 2019-12-09T19:23:34.280040+0000) 2019-12-09T19:24:22.343 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:24:22.339+0000 1694f700 -1 osd.3 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:54.692410+0000 front 2019-12-09T19:22:54.761863+0000 (oldest deadline 2019-12-09T19:23:38.419891+0000) 2019-12-09T19:24:22.671 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:24:22.666+0000 1694f700 -1 osd.4 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:50.485673+0000 front 2019-12-09T19:22:50.487631+0000 (oldest deadline 2019-12-09T19:23:33.889331+0000) 2019-12-09T19:24:22.781 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:24:22.776+0000 1694f700 -1 osd.0 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:51.292533+0000 front 2019-12-09T19:22:53.904927+0000 (oldest deadline 2019-12-09T19:23:33.182426+0000) 2019-12-09T19:24:22.855 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:24:22.841+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e442 v442) 2019-12-09T19:24:22.889 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:24:22.885+0000 1694f700 -1 osd.6 442 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:22:53.381990+0000 front 2019-12-09T19:22:53.349577+0000 (oldest deadline 2019-12-09T19:23:35.596991+0000) 2019-12-09T19:24:29.609 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:24:29.600+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T19:24:37.932 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:24:37.923+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 2 pgs recovery_unfound (PG_DAMAGED) 2019-12-09T19:24:57.426 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:24:57.422+0000 39a7f700 -1 osd.5 442 build_incremental_map_msg missing incremental map 435 2019-12-09T19:25:38.369 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:46:36.396 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:25:38.376 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:46:36.403 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:25:38.388 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:46:36.351 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:25:38.393 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:46:36.356 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:25:38.394 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:46:36.421 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:25:38.395 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:46:36.422 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:25:38.534 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:46:36.561 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:25:38.535 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:46:36.498 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:25:38.575 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:46:36.602 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:26:05.839 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:05.835+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:06.829 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:06.824+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:06.864 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:06.857+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:07.014 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:07.007+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:07.572 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:07.567+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:07.799 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:07.795+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:07.818 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:07.808+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:07.906 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:07.902+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:08.006 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:08.002+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:08.507 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:08.503+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:08.587 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:08.583+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:08.801 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:08.796+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:08.829 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:08.824+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:08.885 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:08.880+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:08.992 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:08.985+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:09.467 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:09.462+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:09.628 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:09.623+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:09.808 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:09.804+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:09.865 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:09.861+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:09.905 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:09.898+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:09.959 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:09.953+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:10.518 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:10.514+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:10.584 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:10.580+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:10.830 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:10.825+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:10.911 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:10.904+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:10.938 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:10.932+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:10.947 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:10.942+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:11.492 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:11.488+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:11.614 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:11.608+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:11.879 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:11.874+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:11.906 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:11.900+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:11.928 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:11.922+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:11.966 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:11.961+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:12.455 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:12.449+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:12.623 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:12.617+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:12.863 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:12.859+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:12.931 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:12.928+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:12.941 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:12.937+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:12.956 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:12.950+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:13.429 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:13.424+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:13.583 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:13.579+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:13.856 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:13.851+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:13.915 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:13.911+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:13.958 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:13.953+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:13.975 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:13.970+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:14.445 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:14.439+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:14.571 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:14.567+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:14.830 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:14.827+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:14.950 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:14.945+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:14.970 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:14.965+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:14.977 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:14.971+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:15.459 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:15.453+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:15.599 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:15.593+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:15.817 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:15.813+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:15.933 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:15.928+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:15.956 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:15.951+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:15.976 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:15.970+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:16.467 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:16.462+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:16.643 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:16.638+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:16.783 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:16.780+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:16.931 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:16.926+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:16.944 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:16.939+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:17.020 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:17.015+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:17.480 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:17.474+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:17.653 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:17.647+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:17.744 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:17.740+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:17.903 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:17.899+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:17.932 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:17.926+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:18.048 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:18.043+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:18.457 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:18.452+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:18.696 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:18.691+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:18.752 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:18.748+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:18.929 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:18.924+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:18.951 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:18.946+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:19.034 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:19.029+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:19.432 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:19.424+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:19.672 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:19.669+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:19.756 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:19.752+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:19.908 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:19.902+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:19.916 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:19.911+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:20.008 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:20.003+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:20.399 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:20.393+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:20.659 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:20.654+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:20.734 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:20.730+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:20.883 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:20.877+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:20.888 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:20.883+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:21.023 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:21.018+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:21.392 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:21.387+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:21.636 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:21.632+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:21.780 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:21.775+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:21.863 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:21.859+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:21.879 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:21.874+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:22.016 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:22.010+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:22.365 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:22.360+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:22.669 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:22.664+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:22.735 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:22.732+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:22.866 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:22.862+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:22.906 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:22.900+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:23.022 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:23.016+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:23.328 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:23.322+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:23.651 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:23.647+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:23.742 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:23.737+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:23.820 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:23.816+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:23.881 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:23.876+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:24.026 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:24.021+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:24.371 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:24.366+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:24.690 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:24.685+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:24.752 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:24.747+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:24.825 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:24.821+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:24.897 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:24.891+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:25.011 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:25.004+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:25.385 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:25.368+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:25.683 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:25.678+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:25.707 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:25.703+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:25.795 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:25.789+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:25.932 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:25.926+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:26.025 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:26.018+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:26.338 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:26.332+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:26.694 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:26.689+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:26.716 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:26.712+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:26.848 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:26.843+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:26.918 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:26.912+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:27.002 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:26.997+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:27.367 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:27.360+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:27.654 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:27.650+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:27.761 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:27.756+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:27.836 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:27.831+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:27.950 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:27.944+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:27.995 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:27.989+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:28.329 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:28.324+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:28.661 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:28.657+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:28.798 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:28.794+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:28.809 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:28.804+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:28.952 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:28.946+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:28.978 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:28.971+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:29.348 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:29.342+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:29.656 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:29.652+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:29.782 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:29.777+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:29.841 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:29.836+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:29.974 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:29.968+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:30.018 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:30.011+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:30.373 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:30.363+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:30.673 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:30.667+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:30.764 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:30.759+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:30.893 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:30.887+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:30.948 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:30.942+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:31.068 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:31.061+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:31.403 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:31.397+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:31.683 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:31.679+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:31.722 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:31.718+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:31.895 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:31.890+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:31.995 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:31.988+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:32.028 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:32.022+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:32.432 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:32.426+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:32.711 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:32.707+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:32.714 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:32.710+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:32.946 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:32.941+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:32.972 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:32.966+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:33.058 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:33.052+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:33.414 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:33.408+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:33.735 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:33.730+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:33.766 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:33.761+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:33.975 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:33.970+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:33.987 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:33.982+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:34.097 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:34.091+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:34.378 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:34.372+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:34.726 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:34.721+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:34.744 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:34.739+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:34.978 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:34.973+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:35.015 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:35.012+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:35.081 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:35.074+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:35.417 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:35.411+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:35.713 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:35.708+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:35.750 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:35.746+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:35.993 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:35.987+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:36.030 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:36.025+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:36.079 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:36.072+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:36.462 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:36.456+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:36.686 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:36.681+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:36.788 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:36.784+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:36.989 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:36.985+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:37.029 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:37.023+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:37.091 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:37.084+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:37.493 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:37.487+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:37.723 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:37.716+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:37.835 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:37.831+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:37.949 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:37.945+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:38.044 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:38.039+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:38.064 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:38.057+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:38.458 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:38.452+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:38.548 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:26:38.543+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e455 v455) 2019-12-09T19:26:38.708 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:38.704+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:38.797 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:38.792+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:38.970 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:38.965+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:39.068 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:39.061+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:39.103 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:39.097+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:39.433 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:39.427+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:39.691 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:39.687+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:39.776 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:39.773+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:39.992 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:39.989+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:40.074 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:40.068+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:40.084 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:40.079+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:40.459 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:40.454+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:40.738 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:40.735+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:40.744 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:40.738+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:40.989 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:40.986+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:41.077 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:41.071+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:41.111 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:41.104+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:41.419 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:41.412+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:41.717 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:41.713+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:41.755 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:41.751+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:42.021 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:42.017+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:42.072 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:42.066+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:42.135 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:42.125+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:42.430 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:42.424+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:42.681 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:42.677+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:42.746 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:42.742+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:43.047 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:43.044+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:43.079 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:43.074+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:43.124 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:43.119+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:43.401 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:43.395+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:43.569 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:26:43.564+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e455 v455) 2019-12-09T19:26:43.653 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:43.650+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:43.740 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:43.737+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:44.045 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:44.041+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:44.061 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:44.058+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:44.121 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:44.116+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:44.363 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:44.358+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:44.622 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:44.618+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:44.719 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:44.715+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:45.023 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:45.018+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:45.084 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:45.081+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:45.113 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:45.108+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:45.367 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:45.363+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:45.669 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:45.665+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:45.755 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:45.751+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:46.032 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:46.027+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:46.072 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:46.068+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:46.119 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:46.114+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:46.330 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:46.325+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:46.693 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:46.689+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:46.715 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:46.710+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:47.041 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:47.036+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:47.090 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:47.085+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:47.115 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:47.111+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:47.351 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:47.346+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:47.688 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:47.683+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:47.700 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:47.695+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:48.072 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:26:48.066+0000 1694f700 -1 osd.6 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.847019+0000 front 2019-12-09T19:25:24.939112+0000 (oldest deadline 2019-12-09T19:26:06.825623+0000) 2019-12-09T19:26:48.131 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:26:48.125+0000 1694f700 -1 osd.7 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.443666+0000 front 2019-12-09T19:25:22.457847+0000 (oldest deadline 2019-12-09T19:26:06.516912+0000) 2019-12-09T19:26:48.144 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:26:48.139+0000 1694f700 -1 osd.3 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:24.207069+0000 front 2019-12-09T19:25:23.588636+0000 (oldest deadline 2019-12-09T19:26:06.886970+0000) 2019-12-09T19:26:48.400 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:26:48.394+0000 1694f700 -1 osd.4 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.034798+0000 front 2019-12-09T19:25:22.036103+0000 (oldest deadline 2019-12-09T19:26:07.816118+0000) 2019-12-09T19:26:48.651 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:26:48.639+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e455 v455) 2019-12-09T19:26:48.714 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:26:48.709+0000 1694f700 -1 osd.1 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:22.274683+0000 front 2019-12-09T19:25:22.265519+0000 (oldest deadline 2019-12-09T19:26:05.442714+0000) 2019-12-09T19:26:48.736 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:26:48.732+0000 1694f700 -1 osd.0 455 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:25:23.156503+0000 front 2019-12-09T19:25:23.149494+0000 (oldest deadline 2019-12-09T19:26:07.110702+0000) 2019-12-09T19:26:55.028 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:26:55.020+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 2 pgs recovery_unfound (PG_DAMAGED) 2019-12-09T19:27:29.027 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:48:27.054 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:27:29.037 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:48:27.064 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:27:29.049 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:48:27.076 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:27:29.054 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:48:27.081 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:27:29.057 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:48:27.020 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:27:29.063 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:48:27.027 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:27:29.184 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:48:27.210 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:27:29.200 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:48:27.227 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:27:29.225 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:48:27.188 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:28:44.402 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:28:44.398+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:28:44.683 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:28:44.679+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:28:44.844 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:28:44.839+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:28:45.405 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:28:45.401+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:28:45.695 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:28:45.691+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:28:45.881 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:28:45.875+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:28:46.418 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:28:46.413+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:28:46.455 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:28:46.450+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:28:46.666 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:28:46.662+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:28:46.872 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:28:46.867+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:28:47.386 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:28:47.382+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:28:47.410 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:28:47.405+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:28:47.425 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:28:47.421+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:28:47.671 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:28:47.667+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:28:47.911 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:28:47.907+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:28:48.363 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:28:48.359+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:28:48.381 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:28:48.375+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:28:48.402 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:28:48.396+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:28:48.420 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:28:48.414+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:28:48.703 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:28:48.699+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:28:48.873 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:28:48.864+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:28:49.345 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:28:49.338+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:28:49.365 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:28:49.360+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:28:49.438 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:28:49.434+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:28:49.438 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:28:49.428+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:28:49.688 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:28:49.684+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:28:49.916 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:28:49.912+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:28:50.354 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:28:50.349+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:28:50.413 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:28:50.408+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:28:50.415 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:28:50.410+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:28:50.482 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:28:50.476+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:28:50.705 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:28:50.700+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:28:50.933 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:28:50.928+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:28:51.320 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:28:51.315+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:28:51.409 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:28:51.404+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:28:51.447 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:28:51.443+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:28:51.463 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:28:51.456+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:28:51.695 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:28:51.690+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:28:51.920 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:28:51.914+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:28:52.348 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:28:52.344+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:28:52.449 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:28:52.444+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:28:52.455 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:28:52.450+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:28:52.507 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:28:52.501+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:28:52.710 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:28:52.705+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:28:52.889 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:28:52.884+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:28:53.392 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:28:53.388+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:28:53.411 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:28:53.407+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:28:53.483 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:28:53.478+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:28:53.485 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:28:53.480+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:28:53.691 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:28:53.686+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:28:53.919 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:28:53.913+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:28:54.409 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:28:54.404+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:28:54.436 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:28:54.431+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:28:54.443 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:28:54.439+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:28:54.482 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:28:54.476+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:28:54.648 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:28:54.643+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:28:54.907 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:28:54.902+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:28:55.448 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:28:55.444+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:28:55.463 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:28:55.456+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:28:55.487 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:28:55.482+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:28:55.490 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:28:55.484+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:28:55.683 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:28:55.679+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:28:55.931 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:28:55.925+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:28:56.469 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:28:56.462+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:28:56.499 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:28:56.494+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:28:56.507 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:28:56.501+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:28:56.509 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:28:56.503+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:28:56.730 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:28:56.725+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:28:56.908 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:28:56.903+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:28:57.465 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:28:57.459+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:28:57.473 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:28:57.462+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:28:57.481 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:28:57.477+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:28:57.520 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:28:57.514+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:28:57.749 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:28:57.743+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:28:57.888 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:28:57.882+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:28:58.461 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:28:58.454+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:28:58.476 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:28:58.471+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:28:58.497 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:28:58.492+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:28:58.517 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:28:58.511+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:28:58.755 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:28:58.751+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:28:58.914 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:28:58.907+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:28:59.421 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:28:59.416+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:28:59.436 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:28:59.431+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:28:59.536 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:28:59.531+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:28:59.543 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:28:59.535+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:28:59.723 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:28:59.716+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:28:59.880 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:28:59.873+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:00.418 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:00.412+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:00.436 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:00.431+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:00.507 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:00.498+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:00.574 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:00.568+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:00.741 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:00.737+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:00.912 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:00.906+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:01.394 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:01.390+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:01.395 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:01.388+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:01.503 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:01.499+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:01.537 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:01.531+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:01.737 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:01.732+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:01.921 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:01.915+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:02.388 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:02.382+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:02.435 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:02.430+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:02.527 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:02.523+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:02.589 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:02.583+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:02.780 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:02.776+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:02.928 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:02.921+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:03.370 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:03.365+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:03.400 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:03.396+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:03.504 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:03.499+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:03.551 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:03.545+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:03.740 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:03.736+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:03.934 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:03.928+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:04.336 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:04.331+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:04.430 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:04.425+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:04.475 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:04.472+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:04.564 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:04.558+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:04.748 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:04.743+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:04.925 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:04.918+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:05.354 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:05.349+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:05.434 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:05.429+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:05.441 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:05.436+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:05.546 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:05.541+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:05.760 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:05.756+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:05.942 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:05.936+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:06.316 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:06.309+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:06.395 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:06.392+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:06.479 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:06.475+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:06.523 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:06.517+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:06.737 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:06.732+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:06.965 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:06.959+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:07.319 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:07.312+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:07.436 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:07.433+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:07.526 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:07.522+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:07.539 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:07.532+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:07.744 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:07.741+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:07.982 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:07.975+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:08.307 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:08.301+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:08.458 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:08.454+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:08.573 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:08.569+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:08.581 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:08.574+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:08.794 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:08.791+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:09.014 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:09.007+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:09.287 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:09.282+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:09.443 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:09.439+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:09.545 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:09.542+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:09.610 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:09.604+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:09.754 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:09.751+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:09.969 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:09.962+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:10.336 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:10.330+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:10.480 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:10.476+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:10.534 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:10.530+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:10.612 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:10.605+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:10.733 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:10.729+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:10.973 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:10.967+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:11.323 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:11.318+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:11.479 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:11.475+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:11.566 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:11.562+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:11.599 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:11.593+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:11.700 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:11.696+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:11.958 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:11.951+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:12.280 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:12.273+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:12.526 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:12.522+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:12.608 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:12.605+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:12.612 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:12.606+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:12.751 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:12.746+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:12.983 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:12.977+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:13.284 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:13.278+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:13.521 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:13.516+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:13.584 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:13.580+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:13.610 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:13.605+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:13.776 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:13.771+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:13.943 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:13.937+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:14.277 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:14.271+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:14.509 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:14.504+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:14.547 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:14.544+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:14.623 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:14.617+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:14.801 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:14.796+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:14.943 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:14.937+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:15.270 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:15.263+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:15.522 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:15.518+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:15.531 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:15.527+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:15.641 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:15.636+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:15.839 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:15.835+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:15.952 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:15.946+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:16.293 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:16.278+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:16.491 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:16.485+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:16.545 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:16.541+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:16.687 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:16.682+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:16.822 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:16.817+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:16.917 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:16.911+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:17.323 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:17.318+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:17.527 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:17.523+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:17.544 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:17.539+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:17.719 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:17.713+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:17.779 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:17.774+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:17.882 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:17.877+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:18.307 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:18.301+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:18.486 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:18.481+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:18.512 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:18.507+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:18.708 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:18.702+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:18.773 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:18.768+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:18.873 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:18.869+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:19.227 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:29:19.222+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 42sec e467 v467) 2019-12-09T19:29:19.306 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:19.301+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:19.478 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:19.475+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:19.524 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:19.520+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:19.715 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:19.709+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:19.804 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:19.800+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:19.908 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:19.902+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:20.271 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:20.266+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:20.457 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:20.453+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:20.504 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:20.500+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:20.688 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:20.683+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:20.842 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:20.831+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:20.903 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:20.898+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:21.293 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:21.289+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:21.486 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:21.482+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:21.490 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:21.485+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:21.730 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:21.725+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:21.835 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:21.831+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:21.888 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:21.883+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:22.326 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:22.320+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:22.522 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:22.511+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:22.525 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:22.521+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:22.764 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:22.759+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:22.823 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:22.818+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:22.924 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:22.919+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:23.327 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:23.319+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:23.490 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:23.486+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:23.539 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:23.535+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:23.764 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:23.759+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:23.831 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:23.827+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:23.904 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:23.897+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:24.248 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:29:24.242+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 42sec e467 v467) 2019-12-09T19:29:24.316 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:24.310+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:24.498 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:24.493+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:24.532 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:24.526+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:24.735 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:24.729+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:24.863 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:24.858+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:24.887 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:24.883+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:25.313 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:25.307+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:25.472 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:25.468+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:25.584 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:25.579+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:25.742 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:25.737+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:25.861 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:25.855+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:25.862 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:25.857+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:26.301 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:26.296+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:26.450 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:26.446+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:26.620 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:26.615+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:26.712 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:26.707+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:26.866 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:26.861+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:26.887 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:26.882+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:27.326 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:27.322+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:27.448 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:27.444+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:27.640 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:27.636+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:27.697 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:27.692+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:27.823 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:27.817+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:27.858 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:27.854+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:28.338 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:29:28.332+0000 1694f700 -1 osd.4 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.045237+0000 front 2019-12-09T19:28:03.228415+0000 (oldest deadline 2019-12-09T19:28:48.273680+0000) 2019-12-09T19:29:28.419 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:29:28.414+0000 1694f700 -1 osd.3 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.355613+0000 front 2019-12-09T19:28:02.353039+0000 (oldest deadline 2019-12-09T19:28:44.272904+0000) 2019-12-09T19:29:28.688 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:29:28.682+0000 1694f700 -1 osd.0 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:03.800201+0000 front 2019-12-09T19:28:03.007915+0000 (oldest deadline 2019-12-09T19:28:46.839723+0000) 2019-12-09T19:29:28.754 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:29:28.745+0000 1694f700 -1 osd.7 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.728864+0000 front 2019-12-09T19:28:02.728234+0000 (oldest deadline 2019-12-09T19:28:45.946009+0000) 2019-12-09T19:29:28.806 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:29:28.801+0000 1694f700 -1 osd.6 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:27:58.784517+0000 front 2019-12-09T19:27:58.963029+0000 (oldest deadline 2019-12-09T19:28:44.410866+0000) 2019-12-09T19:29:28.911 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:29:28.905+0000 1694f700 -1 osd.1 467 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:28:02.067211+0000 front 2019-12-09T19:28:02.003699+0000 (oldest deadline 2019-12-09T19:28:44.216845+0000) 2019-12-09T19:29:29.304 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:29:29.298+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 42sec e467 v467) 2019-12-09T19:29:35.662 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:29:35.656+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T19:29:44.372 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:29:44.366+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 2 pgs recovery_unfound (PG_DAMAGED) 2019-12-09T19:29:49.813 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:50:47.840 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:49.820 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:50:47.847 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:49.854 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:50:47.818 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:49.864 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:50:47.827 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:49.908 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:50:47.935 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:49.918 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:50:47.945 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:50.035 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:50:48.062 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:50.157 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:50:48.121 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:29:50.163 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:50:48.190 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:30:17.410 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:30:17.358+0000 34a75700 -1 osd.0 471 build_incremental_map_msg missing incremental map 471 2019-12-09T19:30:17.460 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:30:17.368+0000 33a73700 -1 osd.0 471 build_incremental_map_msg missing incremental map 471 2019-12-09T19:30:17.496 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:30:17.442+0000 35276700 -1 osd.0 471 build_incremental_map_msg missing incremental map 471 2019-12-09T19:30:17.516 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:30:17.452+0000 3827c700 -1 osd.0 471 build_incremental_map_msg missing incremental map 471 2019-12-09T19:30:17.516 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:30:17.456+0000 11caf700 -1 osd.0 471 build_incremental_map_msg missing incremental map 471 2019-12-09T19:30:17.517 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:30:17.485+0000 33a73700 -1 osd.7 471 build_incremental_map_msg missing incremental map 471 2019-12-09T19:30:17.643 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:30:17.468+0000 34274700 -1 osd.6 471 build_incremental_map_msg missing incremental map 471 2019-12-09T19:30:17.702 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:30:17.615+0000 34a75700 -1 osd.6 471 build_incremental_map_msg missing incremental map 471 2019-12-09T19:30:17.743 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:30:17.604+0000 35a77700 -1 osd.7 471 build_incremental_map_msg missing incremental map 471 2019-12-09T19:30:17.755 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:30:17.657+0000 3827c700 -1 osd.7 471 build_incremental_map_msg missing incremental map 471 2019-12-09T19:30:18.022 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:30:17.965+0000 36278700 -1 osd.6 471 build_incremental_map_msg missing incremental map 471 2019-12-09T19:30:37.564 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:30:37.554+0000 35276700 -1 osd.0 476 build_incremental_map_msg missing incremental map 471 2019-12-09T19:31:05.452 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:52:03.477 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:31:05.462 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:52:03.489 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:31:05.474 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:52:03.438 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:31:05.476 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:52:03.504 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:31:05.477 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:52:03.441 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:31:05.481 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:52:03.508 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:31:05.580 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:52:03.606 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:31:05.594 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:52:03.552 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:31:05.635 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:52:03.661 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:31:23.115 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:23.110+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:23.469 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:23.465+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:23.873 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:23.869+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:23.919 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:23.912+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:24.102 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:24.097+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:24.461 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:24.457+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:24.839 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:24.835+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:24.877 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:24.871+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:24.898 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:24.894+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:25.069 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:25.064+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:25.457 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:25.453+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:25.860 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:25.855+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:25.886 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:25.880+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:25.925 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:25.919+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:26.094 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:26.090+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:26.429 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:26.424+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:26.472 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:26.468+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:26.895 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:26.891+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:26.898 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:26.894+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:26.904 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:26.898+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:27.062 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:27.057+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:27.426 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:27.422+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:27.490 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:27.485+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:27.932 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:27.928+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:27.942 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:27.936+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:27.944 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:27.940+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:28.096 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:28.089+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:28.428 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:28.424+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:28.513 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:28.510+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:28.891 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:28.886+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:28.902 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:28.898+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:28.952 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:28.947+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:29.065 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:29.060+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:29.414 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:29.409+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:29.552 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:29.549+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:29.882 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:29.878+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:29.883 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:29.879+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:29.935 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:29.925+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:30.041 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:30.035+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:30.376 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:30.367+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:30.543 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:30.538+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:30.848 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:30.844+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:30.902 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:30.898+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:30.967 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:30.961+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:31.093 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:31.087+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:31.426 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:31.420+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:31.563 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:31.558+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:31.898 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:31.894+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:31.902 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:31.899+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:31.949 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:31.943+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:32.057 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:32.051+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:32.384 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:32.378+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:32.576 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:32.572+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:32.873 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:32.870+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:32.944 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:32.940+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:32.994 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:32.987+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:33.085 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:33.079+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:33.378 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:33.373+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:33.600 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:33.597+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:33.889 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:33.886+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:33.964 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:33.960+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:33.976 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:33.970+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:34.048 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:34.042+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:34.398 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:34.392+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:34.576 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:34.572+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:34.895 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:34.892+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:35.005 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:34.999+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:35.010 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:35.005+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:35.081 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:35.074+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:35.444 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:35.439+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:35.582 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:35.578+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:35.905 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:35.901+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:35.969 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:35.966+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:36.013 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:36.006+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:36.070 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:36.063+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:36.438 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:36.432+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:36.629 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:36.625+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:36.951 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:36.948+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:36.973 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:36.970+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:37.024 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:37.018+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:37.044 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:37.035+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:37.459 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:37.454+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:37.641 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:37.637+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:37.953 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:37.950+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:37.998 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:37.994+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:38.021 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:38.015+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:38.037 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:38.031+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:38.480 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:38.474+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:38.629 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:38.626+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:38.951 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:38.945+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:38.968 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:38.965+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:39.025 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:39.019+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:39.067 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:39.062+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:39.466 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:39.460+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:39.654 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:39.649+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:39.957 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:39.953+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:39.989 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:39.983+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:39.991 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:39.987+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:40.108 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:40.102+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:40.491 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:40.485+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:40.703 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:40.699+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:40.975 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:40.969+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:41.019 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:41.012+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:41.038 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:41.033+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:41.087 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:41.080+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:41.485 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:41.479+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:41.714 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:41.710+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:41.964 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:41.960+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:42.034 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:42.028+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:42.049 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:42.043+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:42.069 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:42.065+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:42.529 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:42.523+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:42.677 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:42.672+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:42.931 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:42.928+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:43.003 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:42.996+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:43.030 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:43.024+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:43.065 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:43.062+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:43.580 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:43.574+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:43.649 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:43.644+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:43.937 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:43.933+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:44.003 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:43.997+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:44.018 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:44.012+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:44.075 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:44.071+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:44.593 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:44.586+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:44.664 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:44.660+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:44.956 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:44.952+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:45.011 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:45.005+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:45.032 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:45.024+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:45.074 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:45.070+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:45.550 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:45.544+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:45.693 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:45.688+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:45.995 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:45.989+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:46.006 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:46.000+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:46.011 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:46.006+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:46.124 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:46.119+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:46.532 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:46.526+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:46.743 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:46.739+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:46.983 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:46.975+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:47.057 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:47.051+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:47.063 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:47.056+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:47.107 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:47.103+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:47.575 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:47.569+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:47.789 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:47.784+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:48.027 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:48.020+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:48.028 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:48.021+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:48.047 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:48.043+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:48.115 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:48.111+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:48.567 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:48.559+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:48.759 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:48.755+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:49.007 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:49.000+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:49.029 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:49.023+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:49.070 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:49.066+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:49.147 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:49.143+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:49.536 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:49.530+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:49.810 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:49.806+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:50.001 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:49.995+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:50.071 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:50.065+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:50.075 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:50.071+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:50.187 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:50.182+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:50.505 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:50.499+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:50.840 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:50.835+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:51.022 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:51.017+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:51.090 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:51.086+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:51.091 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:51.085+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:51.233 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:51.228+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:51.525 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:51.521+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:51.835 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:51.830+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:52.055 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:52.050+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:52.063 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:52.057+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:52.112 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:52.107+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:52.273 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:52.268+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:52.573 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:52.569+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:52.854 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:52.850+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:53.038 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:53.034+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:53.047 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:53.041+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:53.101 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:53.096+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:53.268 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:53.263+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:53.542 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:53.538+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:53.840 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:53.835+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:54.041 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:54.038+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:54.072 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:54.068+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:54.131 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:54.126+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:54.290 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:54.286+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:54.512 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:54.506+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:54.880 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:54.875+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:55.047 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:55.042+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:55.073 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:55.068+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:55.119 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:55.114+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:55.229 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:31:55.225+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e478 v478) 2019-12-09T19:31:55.318 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:55.314+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:55.466 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:55.461+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:55.914 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:55.909+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:56.017 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:56.012+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:56.035 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:56.030+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:56.146 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:56.140+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:56.336 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:56.331+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:56.469 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:56.464+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:56.904 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:56.899+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:56.972 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:56.967+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:57.063 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:57.057+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:57.144 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:57.138+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:57.296 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:57.292+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:57.451 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:57.446+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:57.956 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:57.952+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:57.965 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:57.961+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:58.073 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:58.067+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:58.100 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:58.094+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:58.275 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:58.269+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:58.492 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:58.487+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:58.913 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:58.909+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:58.993 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:58.989+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:31:59.062 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:31:59.056+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:31:59.075 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:31:59.069+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:31:59.249 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:31:59.245+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:31:59.482 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:31:59.477+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:31:59.906 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:31:59.902+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:31:59.973 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:31:59.969+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:32:00.053 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:32:00.046+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:32:00.106 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:32:00.097+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:32:00.247 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:32:00.240+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e478 v478) 2019-12-09T19:32:00.288 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:32:00.283+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:32:00.464 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:32:00.460+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:32:00.950 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:32:00.945+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:32:00.952 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:32:00.947+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:32:01.077 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:32:01.071+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:32:01.099 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:32:01.094+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:32:01.279 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:32:01.274+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:32:01.480 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:32:01.476+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:32:01.927 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:32:01.923+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:32:01.946 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:32:01.941+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:32:02.053 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:32:02.048+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:32:02.091 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:32:02.086+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:32:02.321 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:32:02.316+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:32:02.532 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:32:02.528+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:32:02.920 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:32:02.915+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:32:02.921 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:32:02.916+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:32:03.041 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:32:03.036+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:32:03.062 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:32:03.057+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:32:03.293 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:32:03.289+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:32:03.584 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:32:03.579+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:32:03.898 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:32:03.894+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:32:03.939 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:32:03.934+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:32:04.013 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:32:04.008+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:32:04.089 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:32:04.084+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:32:04.305 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:32:04.300+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:32:04.565 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:32:04.559+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:32:04.948 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:32:04.944+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:32:04.975 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:32:04.969+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:32:04.991 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:32:04.985+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:32:05.099 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:32:05.093+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:32:05.262 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:32:05.258+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e478 v478) 2019-12-09T19:32:05.300 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:32:05.295+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:32:05.612 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:32:05.605+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:32:05.924 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:32:05.920+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:32:05.973 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:32:05.968+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:32:05.996 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:32:05.991+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:32:06.071 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:32:06.061+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:32:06.294 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:32:06.290+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:32:06.587 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:32:06.580+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:32:06.936 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:32:06.932+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:32:06.990 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:32:06.986+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:32:06.997 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:32:06.992+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:32:07.033 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:32:07.028+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:32:07.297 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:32:07.292+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:32:07.599 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:32:07.594+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:32:07.944 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:32:07.940+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:32:07.990 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:32:07.986+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:32:07.999 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:32:07.994+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:32:08.057 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:32:08.052+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:32:08.255 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:32:08.251+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:32:08.554 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:32:08.548+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:32:08.941 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:32:08.936+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:32:08.966 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:32:08.961+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:32:08.990 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:32:08.984+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:32:09.033 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:32:09.027+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:32:09.289 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:32:09.285+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:32:09.583 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:32:09.576+0000 1694f700 -1 osd.7 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:41.446712+0000 front 2019-12-09T19:30:42.168226+0000 (oldest deadline 2019-12-09T19:31:26.041613+0000) 2019-12-09T19:32:09.963 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:32:09.951+0000 1694f700 -1 osd.6 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.503877+0000 front 2019-12-09T19:30:37.981427+0000 (oldest deadline 2019-12-09T19:31:22.141776+0000) 2019-12-09T19:32:09.963 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:32:09.953+0000 1694f700 -1 osd.0 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:37.061513+0000 front 2019-12-09T19:30:37.087533+0000 (oldest deadline 2019-12-09T19:31:22.504931+0000) 2019-12-09T19:32:09.980 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:32:09.976+0000 1694f700 -1 osd.1 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:39.260631+0000 front 2019-12-09T19:30:39.259393+0000 (oldest deadline 2019-12-09T19:31:24.361879+0000) 2019-12-09T19:32:10.044 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:32:10.037+0000 1694f700 -1 osd.4 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:42.162691+0000 front 2019-12-09T19:30:41.450311+0000 (oldest deadline 2019-12-09T19:31:23.709923+0000) 2019-12-09T19:32:10.292 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:32:10.288+0000 1694f700 -1 osd.3 478 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:30:40.067366+0000 front 2019-12-09T19:30:40.006861+0000 (oldest deadline 2019-12-09T19:31:23.237656+0000) 2019-12-09T19:32:10.323 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:32:10.319+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e478 v478) 2019-12-09T19:32:15.160 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:32:15.154+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T19:32:20.340 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:32:20.329+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 2 pgs recovery_unfound (PG_DAMAGED) 2019-12-09T19:32:46.188 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:32:45.843+0000 1694f700 -1 osd.5 478 get_health_metrics reporting 3 slow ops, oldest is pg_backfill(progress 7.b e 478/478 lb 7:dfe34130:::2019-12-09-16-a55fd90f-db62-40cd-9264-5916c91f1695.4358.475-test-client.0-6v3jmbg8idlotik-337:head) 2019-12-09T19:33:53.985 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:33:53.980+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:33:55.020 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:33:55.015+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:33:55.209 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:33:55.204+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:33:56.008 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:33:56.004+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:33:56.051 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:33:56.046+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:33:56.173 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:33:56.167+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:33:56.857 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:33:56.851+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:33:56.976 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:33:56.972+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:33:57.046 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:33:57.040+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:33:57.208 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:33:57.203+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:33:57.594 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:33:57.589+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:33:57.882 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:33:57.878+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:33:58.001 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:33:57.997+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:33:58.007 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:33:58.003+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:33:58.173 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:33:58.167+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:33:58.565 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:33:58.561+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:33:58.841 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:33:58.837+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:33:59.023 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:33:59.017+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:33:59.051 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:33:59.046+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:33:59.160 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:33:59.155+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:33:59.479 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:33:59.475+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:33:59.577 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:33:59.575+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:33:59.828 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:33:59.826+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:33:59.988 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:33:59.985+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:00.012 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:00.006+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:00.193 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:00.188+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:00.493 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:00.486+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:00.619 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:00.616+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:00.805 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:00.802+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:00.871 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:54:58.899 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:34:00.877 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:54:58.904 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:34:00.887 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:54:58.850 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:34:00.928 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:54:58.955 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:34:00.930 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:54:58.893 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:34:00.942 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:54:58.969 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:34:00.976 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:00.972+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:01.035 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:01.032+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:01.134 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:54:59.161 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:34:01.150 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:54:59.178 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:34:01.151 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:54:59.114 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:34:01.171 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:01.165+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:01.521 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:01.517+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:01.611 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:01.608+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:01.841 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:01.837+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:02.014 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:02.010+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:02.029 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:02.026+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:02.142 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:02.137+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:02.514 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:02.509+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:02.654 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:02.650+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:02.892 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:02.889+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:03.001 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:02.996+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:03.072 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:03.068+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:03.176 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:03.170+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:03.505 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:03.500+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:03.670 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:03.667+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:03.850 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:03.847+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:04.040 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:04.036+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:04.041 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:04.035+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:04.161 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:04.155+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:04.488 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:04.479+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:04.639 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:04.636+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:04.904 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:04.901+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:05.012 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:05.006+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:05.015 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:05.012+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:05.194 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:05.188+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:05.528 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:05.523+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:05.613 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:05.609+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:05.950 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:05.947+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:05.978 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:05.972+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:06.052 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:06.049+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:06.221 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:06.214+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:06.485 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:06.479+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:06.582 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:06.577+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:06.942 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:06.937+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:06.982 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:06.976+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:07.049 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:07.045+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:07.221 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:07.215+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:07.467 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:07.461+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:07.576 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:07.572+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:07.917 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:07.913+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:08.001 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:07.996+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:08.079 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:08.074+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:08.230 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:08.223+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:08.495 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:08.490+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:08.546 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:08.542+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:08.942 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:08.937+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:09.042 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:09.037+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:09.061 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:09.057+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:09.219 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:09.213+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:09.494 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:09.488+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:09.563 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:09.558+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:09.905 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:09.900+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:10.030 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:10.024+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:10.100 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:10.096+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:10.273 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:10.268+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:10.466 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:10.461+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:10.579 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:10.576+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:10.860 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:10.855+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:11.000 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:10.994+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:11.072 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:11.068+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:11.327 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:11.320+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:11.439 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:11.433+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:11.602 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:11.598+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:11.835 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:11.832+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:12.029 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:12.022+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:12.118 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:12.113+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:12.365 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:12.358+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:12.474 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:12.468+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:12.557 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:12.553+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:12.857 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:12.852+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:13.017 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:13.011+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:13.081 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:13.077+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:13.377 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:13.372+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:13.500 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:13.494+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:13.585 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:13.581+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:13.862 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:13.858+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:13.999 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:13.993+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:14.072 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:14.069+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:14.358 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:14.352+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:14.495 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:14.489+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:14.577 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:14.572+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:14.829 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:14.824+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:14.967 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:14.962+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:15.046 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:15.041+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:15.372 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:15.365+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:15.477 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:15.471+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:15.563 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:15.558+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:15.864 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:15.859+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:16.016 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:16.010+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:16.048 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:16.045+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:16.391 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:16.384+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:16.525 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:16.519+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:16.610 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:16.605+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:16.845 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:16.840+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:16.997 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:16.992+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:17.046 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:17.041+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:17.406 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:17.402+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:17.573 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:17.566+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:17.604 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:17.600+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:17.876 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:17.871+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:17.986 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:17.980+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:18.023 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:18.019+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:18.362 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:18.356+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:18.576 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:18.570+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:18.601 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:18.597+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:18.922 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:18.915+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:18.987 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:18.983+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:19.024 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:19.018+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:19.372 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:19.361+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:19.560 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:19.555+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:19.604 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:19.599+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:19.970 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:19.965+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:20.019 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:20.014+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:20.052 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:20.046+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:20.335 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:20.329+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:20.567 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:20.560+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:20.585 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:20.581+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:20.945 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:20.942+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:21.047 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:21.042+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:21.079 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:21.072+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:21.307 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:21.300+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:21.581 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:21.577+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:21.591 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:21.585+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:21.983 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:21.978+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:22.034 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:22.027+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:22.036 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:22.033+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:22.344 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:22.338+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:22.539 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:22.535+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:22.621 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:22.615+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:23.017 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:23.011+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:23.028 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:23.024+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:23.039 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:23.034+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:23.342 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:23.338+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:23.581 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:23.575+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:23.587 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:23.583+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:24.002 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:23.997+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:24.043 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:24.039+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:24.090 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:24.086+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:24.354 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:24.348+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:24.572 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:24.567+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:24.597 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:24.594+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:25.015 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:25.011+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:25.025 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:25.018+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:25.136 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:25.132+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:25.412 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:25.407+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:25.572 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:25.566+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:25.645 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:25.641+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:26.011 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:26.005+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:26.069 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:26.065+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:26.107 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:26.102+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:26.406 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:26.401+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:26.611 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:26.607+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:26.617 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:26.612+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:27.018 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:27.013+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:27.040 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:27.035+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:27.104 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:27.101+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:27.398 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:27.393+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:27.574 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:27.569+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:27.651 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:27.647+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:28.033 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:28.029+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:28.067 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:28.062+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:28.078 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:28.074+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:28.438 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:28.433+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:28.565 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:28.560+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:28.668 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:28.665+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:29.037 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:29.034+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:29.059 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:29.054+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:29.073 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:29.069+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:29.430 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:29.425+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:29.518 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:29.514+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:29.640 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:29.635+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:30.005 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:30.001+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:30.087 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:30.081+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:30.105 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:30.101+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:30.424 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:30.419+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:30.564 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:30.558+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:30.612 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:30.607+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:30.945 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:34:30.939+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e488 v488) 2019-12-09T19:34:31.017 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:31.007+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:31.114 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:31.108+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:31.137 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:31.133+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:31.411 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:31.406+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:31.578 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:31.573+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:31.605 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:31.600+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:32.039 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:32.035+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:32.090 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:32.086+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:32.093 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:32.090+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:32.417 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:32.411+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:32.573 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:32.568+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:32.635 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:32.631+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:33.004 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:33.000+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:33.066 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:33.061+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:33.138 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:33.134+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:33.437 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:33.433+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:33.528 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:33.524+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:33.612 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:33.607+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:34.029 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:34.026+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:34.114 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:34.110+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:34.126 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:34.121+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:34.412 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:34.407+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:34.510 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:34.505+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:34.606 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:34.603+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:34.992 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:34.987+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:35.086 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:35.081+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:35.126 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:35.122+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:35.390 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:35.385+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:35.485 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:35.481+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:35.613 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:35.608+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:35.967 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:34:35.960+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e488 v488) 2019-12-09T19:34:35.999 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:35.995+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:36.040 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:36.037+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:36.174 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:36.170+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:36.374 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:36.370+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:36.517 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:36.512+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:36.625 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:36.621+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:37.011 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:37.007+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:37.032 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:37.028+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:37.200 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:37.195+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:37.350 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:37.346+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:37.557 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:37.553+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:37.678 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:37.674+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:38.023 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:38.018+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:38.073 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:38.069+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:38.174 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:38.169+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:38.398 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:38.394+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:38.614 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:38.603+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:38.715 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:38.710+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:38.987 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:38.983+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:39.096 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:39.092+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:39.154 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:39.150+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:39.399 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:39.394+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:39.645 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:39.636+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:39.699 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:39.694+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:39.998 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:39.994+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:40.092 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:40.089+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:40.115 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:34:40.111+0000 1694f700 -1 osd.7 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.459104+0000 front 2019-12-09T19:33:14.034834+0000 (oldest deadline 2019-12-09T19:33:53.790833+0000) 2019-12-09T19:34:40.438 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:34:40.432+0000 1694f700 -1 osd.6 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.831136+0000 front 2019-12-09T19:33:14.174447+0000 (oldest deadline 2019-12-09T19:33:54.864384+0000) 2019-12-09T19:34:40.624 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:34:40.619+0000 1694f700 -1 osd.4 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:13.470925+0000 front 2019-12-09T19:33:13.735848+0000 (oldest deadline 2019-12-09T19:33:59.244456+0000) 2019-12-09T19:34:40.699 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:34:40.694+0000 1694f700 -1 osd.1 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:14.175707+0000 front 2019-12-09T19:33:13.846860+0000 (oldest deadline 2019-12-09T19:33:57.119254+0000) 2019-12-09T19:34:41.033 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:34:41.029+0000 1694f700 -1 osd.3 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:10.950507+0000 front 2019-12-09T19:33:10.948953+0000 (oldest deadline 2019-12-09T19:33:55.210225+0000) 2019-12-09T19:34:41.041 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:34:41.036+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e488 v488) 2019-12-09T19:34:41.118 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:34:41.113+0000 1694f700 -1 osd.0 488 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:33:12.753993+0000 front 2019-12-09T19:33:12.778925+0000 (oldest deadline 2019-12-09T19:33:56.012911+0000) 2019-12-09T19:34:45.241 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:34:45.236+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T19:34:51.073 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:34:51.057+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check update: Possible data damage: 2 pgs recovery_unfound (PG_DAMAGED) 2019-12-09T19:35:09.614 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:56:07.641 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:35:09.632 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:56:07.656 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:35:09.632 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:56:07.658 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:35:09.633 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:56:07.597 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:35:09.643 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:56:07.668 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:35:09.643 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:56:07.604 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:35:09.740 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:09:56:07.767 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:35:09.749 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:09:56:07.776 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:35:09.768 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:09:56:07.731 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:36:29.452 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:29.449+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:30.240 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:30.236+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:30.492 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:30.489+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:30.505 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:30.499+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:30.634 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:30.632+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:30.878 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:30.872+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:31.228 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:31.223+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:31.448 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:31.444+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:31.555 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:31.550+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:31.605 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:31.602+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:31.902 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:31.897+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:32.242 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:32.239+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:32.257 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:32.252+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:32.406 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:32.403+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:32.533 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:32.526+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:32.637 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:32.634+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:32.893 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:32.888+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:33.252 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:33.249+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:33.256 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:33.252+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:33.415 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:33.412+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:33.568 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:33.563+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:33.625 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:33.622+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:33.878 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:33.874+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:34.253 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:34.244+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:34.261 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:34.251+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:34.430 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:34.426+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:34.569 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:34.564+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:34.591 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:34.587+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:34.861 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:34.856+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:35.223 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:35.219+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:35.244 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:35.239+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:35.400 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:35.394+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:35.587 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:35.581+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:35.645 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:35.640+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:35.863 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:35.858+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:36.223 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:36.219+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:36.255 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:36.251+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:36.447 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:36.443+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:36.570 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:36.565+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:36.650 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:36.646+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:36.893 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:36.889+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:37.223 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:37.219+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:37.232 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:37.227+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:37.480 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:37.474+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:37.585 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:37.580+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:37.671 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:37.667+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:37.897 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:37.893+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:38.179 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:38.174+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:38.220 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:38.217+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:38.504 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:38.500+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:38.546 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:38.538+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:38.644 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:38.640+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:38.886 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:38.880+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:39.215 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:39.209+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:39.248 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:39.244+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:39.482 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:39.478+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:39.590 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:39.584+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:39.608 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:39.603+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:39.859 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:39.853+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:40.258 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:40.254+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:40.264 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:40.258+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:40.523 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:40.519+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:40.578 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:40.573+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:40.643 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:40.637+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:40.913 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:40.908+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:41.223 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:41.218+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:41.227 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:41.222+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:41.523 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:41.520+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:41.574 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:41.570+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:41.642 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:41.637+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:41.945 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:41.939+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:42.182 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:42.178+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:42.279 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:42.273+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:42.550 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:42.546+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:42.624 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:42.619+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:42.696 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:42.689+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:42.944 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:42.938+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:43.154 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:43.151+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:43.329 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:43.321+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:43.522 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:43.518+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:43.652 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:43.647+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:43.732 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:43.726+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:43.934 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:43.928+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:44.122 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:44.118+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:44.345 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:44.339+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:44.527 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:44.523+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:44.691 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:44.687+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:44.751 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:44.745+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:44.947 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:44.940+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:45.113 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:45.109+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:45.331 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:45.325+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:45.504 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:45.500+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:45.674 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:45.670+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:45.753 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:45.746+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:45.912 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:45.906+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:46.091 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:46.087+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:46.320 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:46.314+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:46.537 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:46.533+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:46.683 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:46.680+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:46.765 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:46.759+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:46.894 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:46.888+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:47.140 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:47.135+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:47.350 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:47.344+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:47.570 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:47.566+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:47.684 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:47.681+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:47.771 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:47.765+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:47.868 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:47.861+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:48.159 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:48.155+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:48.342 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:48.336+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:48.562 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:48.558+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:48.657 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:48.653+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:48.788 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:48.782+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:48.887 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:48.881+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:49.121 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:49.117+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:49.390 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:49.384+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:49.549 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:49.544+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:49.691 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:49.687+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:49.761 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:49.755+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:49.850 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:49.844+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:50.166 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:50.162+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:50.434 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:50.428+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:50.520 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:50.516+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:50.654 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:50.650+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:50.927 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:50.744+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:50.927 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:50.882+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:51.207 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:51.202+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:51.426 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:51.420+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:51.516 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:51.514+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:51.628 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:51.625+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:51.726 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:51.720+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:51.922 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:51.916+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:52.226 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:52.222+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:52.431 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:52.425+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:52.474 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:52.469+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:52.653 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:52.648+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:52.751 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:52.745+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:52.905 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:52.897+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:53.188 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:53.183+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:53.429 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:53.425+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:53.457 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:53.452+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:53.676 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:53.672+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:53.775 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:53.769+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:53.888 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:53.882+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:54.174 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:54.170+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:54.458 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:54.454+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:54.506 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:54.500+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:54.682 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:54.678+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:54.796 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:54.790+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:54.927 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:54.921+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:55.186 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:55.182+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:55.448 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:55.444+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:55.559 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:55.554+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:55.743 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:55.728+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:55.806 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:55.800+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:55.967 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:55.960+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:56.176 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:56.171+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:56.481 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:56.476+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:56.594 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:56.587+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:56.779 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:56.775+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:56.840 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:56.834+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:56.960 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:56.955+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:57.221 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:57.217+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:57.485 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:57.478+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:57.578 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:57.572+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:57.771 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:57.768+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:57.844 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:57.838+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:58.005 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:57.998+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:58.221 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:58.216+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:58.442 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:58.437+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:58.546 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:58.540+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:58.765 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:58.763+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:58.817 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:58.812+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:36:59.040 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:36:59.034+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:36:59.273 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:36:59.268+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:36:59.474 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:36:59.469+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:36:59.538 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:36:59.533+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:36:59.796 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:36:59.793+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:36:59.824 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:36:59.820+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:37:00.093 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:37:00.087+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:37:00.264 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:37:00.260+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:37:00.475 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:37:00.470+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:37:00.509 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:37:00.504+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:37:00.772 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:37:00.768+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:37:00.877 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:37:00.869+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:37:01.123 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:37:01.119+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:37:01.225 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:37:01.220+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:37:01.458 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:37:01.455+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:37:01.492 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:37:01.486+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:37:01.595 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:37:01.591+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e496 v496) 2019-12-09T19:37:01.769 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:37:01.764+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:37:01.910 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:37:01.905+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:37:02.137 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:37:02.131+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:37:02.219 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:37:02.216+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:37:02.472 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:37:02.468+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:37:02.480 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:37:02.475+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:37:02.747 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:37:02.743+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:37:02.929 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:37:02.924+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:37:03.139 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:37:03.134+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:37:03.253 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:37:03.247+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:37:03.481 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:37:03.478+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:37:03.526 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:37:03.520+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:37:03.701 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:37:03.698+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:37:03.984 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:37:03.978+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:37:04.130 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:37:04.126+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:37:04.282 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:37:04.279+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:37:04.510 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:37:04.506+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:37:04.530 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:37:04.526+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:37:04.675 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:37:04.671+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:37:05.018 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:37:05.012+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:37:05.168 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:37:05.162+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:37:05.324 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:37:05.320+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:37:05.497 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:37:05.493+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:37:05.551 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:37:05.546+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:37:05.641 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:37:05.637+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:37:06.007 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:37:06.003+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:37:06.144 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:37:06.139+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:37:06.297 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:37:06.293+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:37:06.494 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:37:06.489+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:37:06.587 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:37:06.583+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:37:06.612 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:37:06.610+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e496 v496) 2019-12-09T19:37:06.670 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:37:06.665+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:37:06.985 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:37:06.979+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:37:07.147 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:37:07.141+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:37:07.323 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:37:07.319+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:37:07.534 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:37:07.529+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:37:07.635 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:37:07.631+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:37:07.670 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:37:07.665+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:37:08.025 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:37:08.020+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:37:08.115 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:37:08.110+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:37:08.284 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:37:08.280+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:37:08.546 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:37:08.541+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:37:08.597 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:37:08.593+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:37:08.694 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:37:08.689+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:37:09.067 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:37:09.062+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:37:09.136 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:37:09.131+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:37:09.278 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:37:09.275+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:37:09.559 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:37:09.555+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:37:09.592 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:37:09.588+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:37:09.723 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:37:09.716+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:37:10.037 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:37:10.032+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:37:10.094 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:37:10.088+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:37:10.239 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:37:10.235+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:37:10.536 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:37:10.531+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:37:10.592 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:37:10.588+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:37:10.711 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:37:10.707+0000 1694f700 -1 osd.1 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.021648+0000 front 2019-12-09T19:35:47.006744+0000 (oldest deadline 2019-12-09T19:36:30.078615+0000) 2019-12-09T19:37:11.077 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:37:11.072+0000 1694f700 -1 osd.4 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.854444+0000 front 2019-12-09T19:35:48.079142+0000 (oldest deadline 2019-12-09T19:36:29.556664+0000) 2019-12-09T19:37:11.128 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:37:11.123+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:37:11.250 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:37:11.244+0000 1694f700 -1 osd.3 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:47.592758+0000 front 2019-12-09T19:35:47.516204+0000 (oldest deadline 2019-12-09T19:36:31.507234+0000) 2019-12-09T19:37:11.549 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:37:11.540+0000 1694f700 -1 osd.6 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:48.079123+0000 front 2019-12-09T19:35:47.703122+0000 (oldest deadline 2019-12-09T19:36:29.373224+0000) 2019-12-09T19:37:11.603 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:37:11.599+0000 1694f700 -1 osd.0 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:44.946396+0000 front 2019-12-09T19:35:46.099067+0000 (oldest deadline 2019-12-09T19:36:28.435692+0000) 2019-12-09T19:37:11.683 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:37:11.670+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e496 v496) 2019-12-09T19:37:12.154 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:37:12.150+0000 1694f700 -1 osd.7 496 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:35:45.374573+0000 front 2019-12-09T19:35:45.424435+0000 (oldest deadline 2019-12-09T19:36:30.583865+0000) 2019-12-09T19:37:18.008 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:37:18.002+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T19:39:01.906 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:01.902+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:02.876 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:02.873+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:03.627 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:03.623+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:03.929 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:03.924+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:03.931 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:03.928+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:03.934 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:03.930+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:04.363 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:04.358+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:04.587 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:04.581+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:04.756 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:04.750+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:04.905 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:04.900+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:04.915 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:04.911+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:04.943 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:04.938+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:05.375 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:05.370+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:05.608 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:05.604+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:05.710 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:05.706+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:05.928 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:05.922+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:05.936 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:05.933+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:05.938 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:05.934+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:06.422 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:06.417+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:06.585 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:06.580+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:06.673 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:06.668+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:06.881 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:06.878+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:06.901 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:06.897+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:06.913 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:06.910+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:07.384 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:07.379+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:07.560 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:07.554+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:07.647 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:07.642+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:07.870 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:07.865+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:07.874 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:07.868+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:07.915 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:07.910+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:08.338 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:00:06.365 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:39:08.340 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:00:06.368 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:39:08.409 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:08.404+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:08.433 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:00:06.396 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:39:08.451 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:00:06.478 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:39:08.453 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:00:06.415 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:39:08.457 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:00:06.484 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:39:08.520 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:08.516+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:08.582 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:00:06.610 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:39:08.649 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:08.644+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:08.859 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:00:06.886 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:39:08.860 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:08.856+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:08.878 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:00:06.841 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:39:08.907 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:08.903+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:08.926 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:08.922+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:09.400 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:09.396+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:09.491 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:09.486+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:09.607 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:09.601+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:09.888 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:09.884+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:09.905 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:09.901+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:09.964 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:09.960+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:10.438 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:10.433+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:10.508 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:10.503+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:10.658 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:10.653+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:10.871 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:10.867+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:10.886 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:10.881+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:10.926 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:10.921+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:11.424 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:11.420+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:11.491 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:11.487+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:11.706 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:11.701+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:11.844 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:11.840+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:11.845 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:11.841+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:11.902 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:11.898+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:12.385 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:12.379+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:12.462 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:12.458+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:12.696 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:12.691+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:12.853 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:12.849+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:12.872 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:12.869+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:12.918 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:12.914+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:13.364 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:13.359+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:13.476 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:13.471+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:13.681 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:13.675+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:13.864 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:13.858+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:13.897 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:13.894+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:13.966 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:13.963+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:14.362 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:14.356+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:14.488 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:14.482+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:14.709 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:14.703+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:14.913 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:14.910+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:14.914 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:14.908+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:15.008 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:15.004+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:15.388 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:15.382+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:15.467 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:15.461+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:15.681 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:15.674+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:15.892 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:15.887+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:15.894 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:15.890+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:15.971 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:15.966+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:16.358 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:16.351+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:16.455 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:16.447+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:16.635 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:16.629+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:16.897 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:16.893+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:16.900 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:16.896+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:17.006 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:17.001+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:17.357 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:17.350+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:17.445 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:17.439+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:17.684 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:17.678+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:17.874 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:17.870+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:17.926 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:17.922+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:18.018 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:18.014+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:18.334 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:18.328+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:18.436 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:18.431+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:18.684 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:18.677+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:18.909 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:18.904+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:18.940 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:18.936+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:19.060 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:19.056+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:19.289 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:19.284+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:19.484 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:19.479+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:19.702 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:19.697+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:19.907 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:19.904+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:19.914 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:19.910+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:20.098 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:20.093+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:20.304 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:20.298+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:20.537 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:20.531+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:20.693 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:20.686+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:20.926 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:20.922+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:20.931 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:20.927+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:21.095 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:21.092+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:21.332 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:21.327+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:21.536 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:21.530+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:21.673 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:21.667+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:21.906 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:21.903+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:21.928 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:21.924+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:22.052 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:22.048+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:22.319 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:22.313+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:22.526 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:22.520+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:22.632 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:22.626+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:22.905 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:22.901+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:22.943 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:22.939+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:23.010 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:23.007+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:23.356 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:23.350+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:23.549 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:23.544+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:23.628 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:23.622+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:23.907 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:23.902+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:23.921 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:23.916+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:24.024 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:24.020+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:24.335 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:24.329+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:24.508 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:24.503+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:24.628 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:24.621+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:24.938 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:24.933+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:24.953 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:24.949+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:24.994 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:24.988+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:25.303 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:25.297+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:25.543 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:25.537+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:25.600 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:25.591+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:25.919 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:25.915+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:25.969 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:25.966+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:25.994 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:25.990+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:26.311 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:26.305+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:26.543 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:26.537+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:26.594 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:26.587+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:26.892 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:26.887+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:26.934 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:26.930+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:27.019 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:27.015+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:27.333 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:27.326+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:27.555 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:27.549+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:27.613 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:27.607+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:27.871 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:27.868+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:27.984 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:27.978+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:27.992 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:27.987+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:28.328 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:28.322+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:28.573 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:28.567+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:28.581 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:28.575+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:28.832 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:28.827+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:29.010 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:29.006+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:29.028 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:29.024+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:29.297 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:29.291+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:29.534 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:29.529+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:29.608 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:29.603+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:29.876 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:29.873+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:30.039 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:30.034+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:30.054 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:30.048+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:30.352 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:30.345+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:30.560 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:30.554+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:30.641 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:30.634+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:30.905 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:30.901+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:31.021 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:31.017+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:31.092 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:31.088+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:31.364 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:31.358+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:31.541 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:31.535+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:31.602 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:31.596+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:31.958 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:31.954+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:31.995 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:31.990+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:32.067 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:32.062+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:32.410 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:32.405+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:32.540 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:32.533+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:32.629 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:32.624+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:32.933 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:32.929+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:33.009 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:33.005+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:33.103 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:33.098+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:33.387 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:33.381+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:33.561 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:33.554+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:33.586 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:33.579+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:33.932 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:33.928+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:33.995 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:33.990+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:34.075 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:34.070+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:34.363 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:34.358+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:34.602 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:34.597+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:34.631 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:34.626+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:34.920 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:34.916+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:34.997 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:34.993+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:35.068 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:35.064+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:35.354 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:35.349+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:35.563 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:35.557+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:35.650 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:35.645+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:35.887 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:35.882+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:35.980 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:35.976+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:36.090 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:36.085+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:36.360 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:36.355+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:36.572 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:36.567+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:36.619 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:36.614+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:36.863 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:36.858+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:37.036 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:37.033+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:37.103 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:37.098+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:37.235 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:39:37.231+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e506 v506) 2019-12-09T19:39:37.392 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:37.387+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:37.560 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:37.555+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:37.618 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:37.612+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:37.871 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:37.866+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:38.004 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:38.000+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:38.151 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:38.148+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:38.421 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:38.417+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:38.564 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:38.560+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:38.672 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:38.667+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:38.924 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:38.919+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:39.047 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:39.038+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:39.188 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:39.183+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:39.432 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:39.427+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:39.520 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:39.515+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:39.637 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:39.632+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:39.935 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:39.931+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:40.043 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:40.038+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:40.144 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:40.139+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:40.386 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:40.381+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:40.551 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:40.546+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:40.628 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:40.625+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:40.980 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:40.976+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:41.053 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:41.049+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:41.102 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:41.097+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:41.389 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:41.384+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:41.571 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:41.567+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:41.587 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:41.582+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:42.013 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:39:42.010+0000 1694f700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.369260+0000 front 2019-12-09T19:38:18.380087+0000 (oldest deadline 2019-12-09T19:39:03.523519+0000) 2019-12-09T19:39:42.069 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:39:42.066+0000 1694f700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.081890+0000 front 2019-12-09T19:38:18.592913+0000 (oldest deadline 2019-12-09T19:39:03.263758+0000) 2019-12-09T19:39:42.103 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:39:42.099+0000 1694f700 -1 osd.3 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.708514+0000 front 2019-12-09T19:38:19.795964+0000 (oldest deadline 2019-12-09T19:39:01.381640+0000) 2019-12-09T19:39:42.310 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:39:42.305+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e506 v506) 2019-12-09T19:39:42.350 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:39:42.345+0000 1694f700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:19.183990+0000 front 2019-12-09T19:38:19.247497+0000 (oldest deadline 2019-12-09T19:39:03.833071+0000) 2019-12-09T19:39:42.567 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:39:42.564+0000 1694f700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:20.948807+0000 front 2019-12-09T19:38:20.466829+0000 (oldest deadline 2019-12-09T19:39:03.166725+0000) 2019-12-09T19:39:42.628 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:39:42.619+0000 1694f700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:38:18.840326+0000 front 2019-12-09T19:38:19.242994+0000 (oldest deadline 2019-12-09T19:39:04.096839+0000) 2019-12-09T19:39:48.355 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:39:48.348+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T19:40:12.561 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:40:12.554+0000 1694f700 -1 osd.4 508 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:139091 7.9 7:9dc32cef:lc::lc.19:head [call lock.lock in=50b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e507) 2019-12-09T19:40:13.597 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:40:13.593+0000 1694f700 -1 osd.4 508 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:139091 7.9 7:9dc32cef:lc::lc.19:head [call lock.lock in=50b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e507) 2019-12-09T19:41:31.375 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:31.370+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:31.514 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:31.510+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:31.829 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:31.826+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:32.392 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:32.388+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:32.412 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:32.406+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:32.477 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:32.473+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:32.785 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:32.781+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:32.797 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:32.793+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:33.421 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:33.416+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:33.465 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:33.460+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:33.473 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:33.464+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:33.761 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:33.756+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:33.785 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:33.781+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:34.163 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:34.158+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:34.433 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:34.428+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:34.472 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:34.467+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:34.475 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:34.471+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:34.738 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:34.734+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:34.801 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:34.792+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:35.149 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:35.144+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:35.432 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:35.427+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:35.500 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:35.496+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:35.520 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:35.515+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:35.782 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:35.778+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:35.820 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:35.817+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:36.168 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:36.163+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:36.440 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:36.436+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:36.465 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:36.461+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:36.525 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:36.520+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:36.793 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:36.790+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:36.801 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:36.797+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:37.162 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:37.157+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:37.472 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:37.464+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:37.510 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:37.507+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:37.575 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:37.571+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:37.786 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:37.781+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:37.829 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:37.824+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:38.162 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:38.156+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:38.485 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:38.480+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:38.518 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:38.513+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:38.628 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:38.623+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:38.746 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:38.743+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:38.783 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:38.779+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:39.155 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:39.150+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:39.531 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:39.526+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:39.535 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:39.528+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:39.588 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:39.582+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:39.752 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:39.749+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:39.771 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:39.768+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:40.132 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:40.127+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:40.554 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:40.550+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:40.558 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:40.554+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:40.613 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:40.609+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:40.720 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:40.716+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:40.782 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:40.778+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:41.148 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:41.143+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:41.534 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:41.529+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:41.614 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:41.609+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:41.617 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:41.612+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:41.754 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:41.750+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:41.802 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:41.798+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:42.128 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:42.123+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:42.570 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:42.565+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:42.622 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:42.618+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:42.658 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:42.654+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:42.806 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:42.801+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:42.845 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:42.841+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:43.158 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:43.153+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:43.549 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:43.543+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:43.596 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:43.591+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:43.682 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:43.679+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:43.836 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:43.832+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:43.901 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:43.894+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:44.189 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:44.183+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:44.509 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:44.500+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:44.625 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:44.621+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:44.696 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:44.692+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:44.834 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:44.826+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:44.878 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:44.874+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:45.183 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:45.178+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:45.489 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:45.481+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:45.595 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:45.589+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:45.690 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:45.687+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:45.820 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:45.815+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:45.836 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:45.832+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:46.150 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:46.144+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:46.529 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:46.524+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:46.646 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:46.640+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:46.652 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:46.647+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:46.864 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:46.853+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:46.865 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:46.858+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:47.163 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:47.157+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:47.565 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:47.559+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:47.652 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:47.648+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:47.663 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:47.658+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:47.829 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:47.825+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:47.861 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:47.857+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:48.164 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:48.158+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:48.525 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:48.519+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:48.622 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:48.618+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:48.628 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:48.620+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:48.808 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:48.804+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:48.834 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:48.829+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:49.149 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:49.144+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:49.562 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:49.556+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:49.618 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:49.613+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:49.673 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:49.668+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:49.800 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:49.796+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:49.825 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:49.821+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:50.166 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:50.160+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:50.524 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:50.518+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:50.611 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:50.606+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:50.696 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:50.692+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:50.808 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:50.804+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:50.859 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:50.855+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:51.219 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:51.213+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:51.548 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:51.543+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:51.655 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:51.649+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:51.742 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:51.739+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:51.791 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:51.786+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:51.858 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:51.853+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:52.199 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:52.192+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:52.512 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:52.506+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:52.673 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:52.667+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:52.775 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:52.771+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:52.815 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:52.811+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:52.863 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:52.859+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:53.200 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:53.194+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:53.542 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:53.537+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:53.669 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:53.664+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:53.829 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:53.825+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:53.842 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:53.838+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:53.883 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:53.880+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:54.183 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:54.176+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:54.556 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:54.550+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:54.659 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:54.653+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:54.788 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:54.784+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:54.859 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:54.854+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:54.870 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:54.866+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:55.188 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:55.183+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:55.604 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:55.599+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:55.664 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:55.657+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:55.796 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:55.792+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:55.858 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:55.855+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:55.879 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:55.874+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:56.230 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:56.223+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:56.652 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:56.646+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:56.700 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:56.694+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:56.781 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:56.776+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:56.838 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:56.834+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:56.878 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:56.873+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:57.229 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:57.223+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:57.675 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:57.670+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:57.691 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:57.685+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:57.823 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:57.819+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:57.875 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:57.871+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:57.905 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:57.902+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:58.238 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:58.232+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:58.710 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:58.705+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:58.710 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:58.701+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:58.857 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:58.854+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:58.872 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:58.868+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:58.911 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:58.907+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:41:59.270 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:41:59.264+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:41:59.683 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:41:59.674+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:41:59.720 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:41:59.714+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:41:59.844 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:41:59.840+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:41:59.849 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:41:59.844+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:41:59.900 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:41:59.897+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:00.260 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:00.254+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:00.717 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:00.712+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:00.738 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:00.729+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:00.824 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:00.820+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:00.899 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:00.895+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:00.941 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:00.936+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:01.274 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:01.268+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:01.698 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:01.693+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:01.755 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:01.749+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:01.793 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:01.790+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:01.857 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:01.854+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:01.979 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:01.975+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:02.227 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:02.221+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:02.703 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:02.698+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:02.742 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:02.735+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:02.796 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:02.792+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:02.908 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:02.904+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:02.919 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:42:02.915+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e515 v515) 2019-12-09T19:42:02.976 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:02.972+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:03.273 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:03.267+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:03.701 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:03.695+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:03.725 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:03.719+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:03.845 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:03.841+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:03.869 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:03.865+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:03.977 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:03.973+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:04.278 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:04.272+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:04.683 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:04.677+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:04.721 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:04.716+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:04.847 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:04.843+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:04.898 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:04.894+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:05.021 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:05.016+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:05.261 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:05.254+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:05.652 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:05.647+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:05.740 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:05.734+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:05.807 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:05.804+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:05.865 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:05.861+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:06.017 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:06.013+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:06.230 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:06.223+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:06.647 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:06.641+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:06.747 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:06.741+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:06.795 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:06.791+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:06.885 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:06.880+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:07.060 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:07.055+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:07.267 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:07.260+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:07.693 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:07.688+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:07.723 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:07.718+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:07.792 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:07.788+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:07.846 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:07.843+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:07.932 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:42:07.929+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e515 v515) 2019-12-09T19:42:08.112 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:08.108+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:08.248 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:08.243+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:08.684 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:08.679+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:08.690 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:08.685+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:08.776 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:08.773+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:08.837 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:08.834+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:09.065 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:09.062+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:09.231 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:09.225+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:09.689 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:09.685+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:09.724 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:09.719+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:09.760 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:09.756+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:09.882 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:09.879+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:10.118 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:10.109+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:10.270 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:10.265+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:10.680 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:10.675+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:10.682 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:10.678+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:10.797 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:10.792+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:10.898 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:10.893+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:11.115 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:11.111+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:11.331 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:11.319+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:11.652 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:11.642+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:11.685 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:11.681+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:11.764 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:11.760+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:11.949 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:11.944+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:12.128 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:12.124+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:12.359 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:12.354+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:12.637 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:12.632+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:12.681 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:12.676+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:12.732 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:12.727+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:12.945 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:12.940+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:12.951 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:42:12.948+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e515 v515) 2019-12-09T19:42:13.131 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:13.126+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:13.397 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:13.391+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:13.654 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:13.649+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:13.687 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:13.681+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:13.771 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:13.767+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:13.906 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:13.902+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:14.111 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:14.108+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:14.412 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:14.407+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:14.682 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:14.677+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:14.690 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:14.686+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:14.754 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:14.750+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:14.936 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:14.931+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:15.143 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:15.139+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:15.464 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:15.459+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:15.697 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:15.692+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:15.712 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:15.707+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:15.779 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:15.775+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:15.953 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:15.948+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:16.111 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:16.107+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:16.439 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:16.433+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:16.697 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:16.692+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:16.723 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:16.719+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:16.768 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:16.764+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:16.990 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:16.970+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:17.079 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:17.074+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:17.491 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:42:17.486+0000 1694f700 -1 osd.4 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:50.627156+0000 front 2019-12-09T19:40:51.401219+0000 (oldest deadline 2019-12-09T19:41:34.020256+0000) 2019-12-09T19:42:17.674 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:42:17.670+0000 1694f700 -1 osd.6 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.352405+0000 front 2019-12-09T19:40:47.354011+0000 (oldest deadline 2019-12-09T19:41:30.870500+0000) 2019-12-09T19:42:17.738 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:42:17.733+0000 1694f700 -1 osd.7 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.941757+0000 front 2019-12-09T19:40:47.990211+0000 (oldest deadline 2019-12-09T19:41:32.207515+0000) 2019-12-09T19:42:17.787 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:42:17.782+0000 1694f700 -1 osd.3 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:47.384421+0000 front 2019-12-09T19:40:47.355807+0000 (oldest deadline 2019-12-09T19:41:31.046114+0000) 2019-12-09T19:42:17.997 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:42:17.992+0000 1694f700 -1 osd.0 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:51.401531+0000 front 2019-12-09T19:40:51.403080+0000 (oldest deadline 2019-12-09T19:41:31.727846+0000) 2019-12-09T19:42:18.039 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:42:18.031+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e515 v515) 2019-12-09T19:42:18.061 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:42:18.057+0000 1694f700 -1 osd.1 515 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:40:48.998554+0000 front 2019-12-09T19:40:48.911415+0000 (oldest deadline 2019-12-09T19:41:32.338253+0000) 2019-12-09T19:42:23.261 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:03:21.288 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:23.282 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:03:21.310 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:23.311 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:03:21.338 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:23.320 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:03:21.348 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:23.347 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:03:21.310 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:23.350 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:03:21.313 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:23.493 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:03:21.520 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:23.501 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:03:21.528 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:23.594 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:03:21.558 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:42:24.453 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:42:24.448+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T19:43:01.648 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:43:01.631+0000 3a280700 -1 osd.5 520 build_incremental_map_msg missing incremental map 520 2019-12-09T19:43:01.868 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:43:01.840+0000 3827c700 -1 osd.5 520 build_incremental_map_msg missing incremental map 520 2019-12-09T19:43:01.907 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:43:01.843+0000 36a79700 -1 osd.5 520 build_incremental_map_msg missing incremental map 520 2019-12-09T19:43:01.935 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:43:01.864+0000 34a75700 -1 osd.5 520 build_incremental_map_msg missing incremental map 520 2019-12-09T19:43:02.069 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:43:01.904+0000 33a73700 -1 osd.5 520 build_incremental_map_msg missing incremental map 520 2019-12-09T19:43:04.167 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:43:04.143+0000 39a7f700 -1 osd.5 520 build_incremental_map_msg missing incremental map 520 2019-12-09T19:43:04.170 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:43:04.152+0000 39a7f700 -1 osd.5 520 build_incremental_map_msg missing incremental map 520 2019-12-09T19:43:05.494 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:04:03.521 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:43:05.499 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:04:03.526 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:43:05.508 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:04:03.471 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:43:05.511 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:04:03.539 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:43:05.513 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:04:03.476 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:43:05.513 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:04:03.540 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:43:05.589 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:04:03.552 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:43:05.590 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:04:03.617 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:43:05.602 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:04:03.629 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:44:02.954 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:02.949+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:03.908 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:03.903+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:03.929 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:03.925+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:04.781 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:04.776+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:04.899 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:04.894+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:04.905 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:04.900+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:05.837 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:05.829+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:05.876 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:05.871+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:05.904 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:05.899+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:06.610 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:06.604+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:06.814 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:06.811+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:06.870 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:06.865+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:06.925 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:06.921+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:07.044 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:07.039+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:07.567 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:07.562+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:07.836 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:07.831+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:07.849 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:07.844+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:07.911 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:07.908+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:08.001 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:07.997+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:08.591 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:08.586+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:08.806 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:08.801+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:08.850 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:08.846+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:08.963 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:08.959+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:08.964 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:08.960+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:09.335 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:09.331+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:09.607 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:09.603+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:09.772 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:09.768+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:09.816 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:09.811+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:09.944 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:09.940+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:10.017 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:10.013+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:10.359 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:10.355+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:10.646 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:10.641+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:10.790 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:10.786+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:10.800 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:10.796+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:10.968 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:10.964+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:11.015 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:11.009+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:11.411 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:11.407+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:11.637 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:11.631+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:11.762 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:11.759+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:11.801 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:11.796+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:11.977 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:11.968+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:12.022 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:12.018+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:12.431 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:12.427+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:12.624 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:12.618+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:12.747 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:12.744+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:12.781 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:12.777+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:12.980 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:12.975+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:13.076 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:13.055+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:13.392 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:13.388+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:13.623 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:13.618+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:13.739 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:13.734+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:13.805 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:13.797+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:13.992 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:13.987+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:14.067 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:14.063+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:14.360 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:14.356+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:14.623 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:14.612+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:14.762 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:14.757+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:14.788 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:14.783+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:15.018 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:15.013+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:15.108 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:15.105+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:15.338 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:15.334+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:15.642 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:15.637+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:15.750 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:15.746+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:15.808 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:15.804+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:16.045 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:16.039+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:16.092 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:16.081+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:16.304 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:16.301+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:16.655 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:16.650+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:16.737 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:16.732+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:16.795 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:16.791+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:17.043 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:17.039+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:17.093 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:17.088+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:17.322 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:17.317+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:17.686 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:17.681+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:17.704 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:17.699+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:17.841 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:17.838+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:18.016 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:18.012+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:18.099 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:18.094+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:18.285 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:18.280+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:18.674 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:18.670+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:18.707 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:18.703+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:18.833 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:18.829+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:19.006 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:19.001+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:19.070 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:19.065+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:19.294 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:19.285+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:19.715 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:19.711+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:19.734 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:19.730+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:19.873 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:19.869+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:19.985 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:19.982+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:20.097 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:20.092+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:20.314 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:20.310+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:20.678 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:20.672+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:20.780 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:20.774+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:20.840 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:20.836+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:21.001 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:20.996+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:21.132 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:21.125+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:21.298 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:21.289+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:21.700 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:21.693+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:21.830 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:21.819+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:21.854 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:21.850+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:21.993 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:21.987+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:22.133 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:22.127+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:22.303 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:22.300+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:22.722 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:22.716+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:22.859 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:22.854+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:22.860 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:22.856+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:23.007 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:23.003+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:23.180 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:23.174+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:23.296 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:23.292+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:23.750 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:23.744+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:23.856 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:23.851+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:23.857 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:23.851+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:23.976 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:23.972+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:24.211 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:24.205+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:24.328 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:24.318+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:24.713 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:24.707+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:24.821 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:24.818+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:24.857 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:24.851+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:24.999 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:24.994+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:25.184 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:25.177+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:25.331 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:25.327+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:25.728 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:25.723+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:25.822 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:25.815+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:25.870 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:25.867+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:26.053 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:26.048+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:26.211 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:26.206+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:26.364 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:26.359+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:26.728 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:26.721+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:26.839 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:26.834+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:26.909 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:26.906+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:27.092 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:27.088+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:27.177 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:27.171+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:27.363 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:27.359+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:27.727 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:27.721+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:27.823 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:27.815+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:27.909 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:27.906+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:28.049 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:28.045+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:28.182 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:28.176+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:28.335 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:28.326+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:28.767 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:28.761+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:28.857 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:28.852+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:28.939 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:28.936+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:29.041 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:29.037+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:29.177 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:29.172+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:29.372 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:29.368+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:29.743 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:29.736+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:29.882 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:29.876+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:29.897 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:29.894+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:30.091 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:30.087+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:30.143 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:30.137+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:30.384 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:30.380+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:30.705 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:30.699+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:30.848 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:30.842+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:30.933 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:30.929+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:31.054 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:31.050+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:31.142 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:31.137+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:31.356 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:31.352+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:31.662 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:31.656+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:31.851 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:31.845+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:31.935 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:31.931+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:32.031 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:32.028+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:32.187 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:32.181+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:32.349 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:32.345+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:32.673 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:32.667+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:32.864 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:32.858+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:32.950 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:32.945+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:33.076 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:33.072+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:33.221 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:33.216+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:33.379 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:33.373+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:33.594 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:44:33.591+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 39sec e524 v524) 2019-12-09T19:44:33.709 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:33.703+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:33.838 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:33.832+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:33.915 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:33.911+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:34.047 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:34.044+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:34.219 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:34.214+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:34.425 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:34.421+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:34.733 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:34.727+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:34.874 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:34.867+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:34.889 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:34.884+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:35.069 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:35.065+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:35.251 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:35.245+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:35.385 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:35.381+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:35.706 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:35.699+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:35.841 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:35.835+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:35.875 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:35.871+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:36.119 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:36.115+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:36.305 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:36.295+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:36.367 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:36.362+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:36.667 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:36.661+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:36.805 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:36.800+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:36.878 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:36.874+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:37.115 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:37.112+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:37.343 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:37.337+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:37.387 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:37.383+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:37.718 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:37.711+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:37.799 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:37.793+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:37.895 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:37.891+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:38.149 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:38.142+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:38.371 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:38.367+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:38.372 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:38.366+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:38.609 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:44:38.604+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 39sec e524 v524) 2019-12-09T19:44:38.750 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:38.743+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:38.806 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:38.800+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:38.930 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:38.927+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:39.183 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:39.178+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:39.333 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:39.330+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:39.351 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:39.346+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:39.794 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:39.788+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:39.846 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:39.840+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:39.897 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:39.893+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:40.152 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:40.148+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:40.354 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:40.350+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:40.391 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:40.386+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:40.831 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:40.825+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:40.848 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:40.842+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:40.917 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:40.912+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:41.192 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:41.188+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:41.319 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:41.313+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:41.428 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:41.422+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:41.868 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:41.863+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:41.871 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:41.867+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:41.963 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:41.959+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:42.225 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:42.222+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:42.317 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:42.312+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:42.391 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:42.387+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:42.854 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:42.848+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:42.915 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:42.910+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:42.969 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:42.965+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:43.243 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:43.240+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:43.281 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:43.278+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:43.422 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:43.418+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:43.722 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:44:43.716+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 39sec e524 v524) 2019-12-09T19:44:43.816 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:43.812+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:43.878 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:43.874+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:44.018 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:44.014+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:44.233 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:44.228+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:44.261 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:44.257+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:44.386 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:44.382+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:44.772 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:44.766+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:44.906 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:44.901+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:44.975 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:44.971+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:45.210 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:45.207+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:45.228 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:45.224+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:45.376 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:45.370+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:45.780 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:45.775+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:45.882 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:45.877+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:46.026 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:46.022+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:46.218 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:46.214+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:46.218 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:46.211+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:46.384 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:46.379+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:46.774 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:46.770+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:46.842 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:46.838+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:47.010 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:47.006+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:47.190 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:47.186+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:47.226 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:47.221+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:47.376 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:47.372+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:47.799 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:47.794+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:47.863 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:47.858+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:48.042 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:44:48.038+0000 1694f700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.142000+0000 front 2019-12-09T19:43:21.526773+0000 (oldest deadline 2019-12-09T19:44:03.818874+0000) 2019-12-09T19:44:48.144 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:44:48.141+0000 1694f700 -1 osd.0 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.722700+0000 front 2019-12-09T19:43:24.171646+0000 (oldest deadline 2019-12-09T19:44:08.414247+0000) 2019-12-09T19:44:48.215 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:44:48.208+0000 1694f700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.894073+0000 front 2019-12-09T19:43:23.963888+0000 (oldest deadline 2019-12-09T19:44:02.499713+0000) 2019-12-09T19:44:48.373 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:44:48.364+0000 1694f700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.169399+0000 front 2019-12-09T19:43:23.148937+0000 (oldest deadline 2019-12-09T19:44:06.563074+0000) 2019-12-09T19:44:48.804 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:44:48.792+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 39sec e524 v524) 2019-12-09T19:44:48.809 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:44:48.802+0000 1694f700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:23.515056+0000 front 2019-12-09T19:43:20.749279+0000 (oldest deadline 2019-12-09T19:44:05.640162+0000) 2019-12-09T19:44:48.858 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:44:48.853+0000 1694f700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:43:24.161780+0000 front 2019-12-09T19:43:24.170539+0000 (oldest deadline 2019-12-09T19:44:03.114887+0000) 2019-12-09T19:44:53.720 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:44:53.715+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T19:44:59.246 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:05:57.273 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:44:59.293 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:05:57.320 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:44:59.363 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:05:57.326 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:44:59.366 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:05:57.329 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:44:59.381 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:05:57.408 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:44:59.413 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:05:57.440 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:44:59.456 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:05:57.484 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:44:59.576 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:05:57.540 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:44:59.610 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:05:57.637 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:45:34.736 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:45:34.665+0000 114ae700 -1 osd.5 529 build_incremental_map_msg missing incremental map 529 2019-12-09T19:45:34.832 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:45:34.694+0000 3aa81700 -1 osd.5 529 build_incremental_map_msg missing incremental map 529 2019-12-09T19:45:34.855 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:45:34.742+0000 34a75700 -1 osd.5 529 build_incremental_map_msg missing incremental map 529 2019-12-09T19:45:34.856 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:45:34.747+0000 3927e700 -1 osd.5 529 build_incremental_map_msg missing incremental map 529 2019-12-09T19:45:34.865 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:45:34.783+0000 3927e700 -1 osd.5 529 build_incremental_map_msg missing incremental map 529 2019-12-09T19:45:34.865 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:45:34.783+0000 3b282700 -1 osd.5 529 build_incremental_map_msg missing incremental map 529 2019-12-09T19:45:35.109 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:45:34.982+0000 35a77700 -1 osd.5 529 build_incremental_map_msg missing incremental map 529 2019-12-09T19:45:37.181 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:45:37.138+0000 39a7f700 -1 osd.5 530 build_incremental_map_msg missing incremental map 529 2019-12-09T19:45:39.201 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:45:39.175+0000 39a7f700 -1 osd.5 531 build_incremental_map_msg missing incremental map 529 2019-12-09T19:45:41.341 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:45:41.327+0000 39a7f700 -1 osd.5 532 build_incremental_map_msg missing incremental map 520 2019-12-09T19:45:41.374 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:45:41.342+0000 39a7f700 -1 osd.5 532 build_incremental_map_msg missing incremental map 529 2019-12-09T19:46:37.051 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:37.045+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:37.283 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:37.279+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:38.093 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:38.089+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:38.145 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:38.142+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:38.271 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:38.266+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:38.298 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:38.294+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:38.493 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:38.488+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:38.512 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:38.508+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:39.060 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:39.056+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:39.107 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:39.102+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:39.262 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:39.259+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:39.296 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:39.289+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:39.467 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:39.462+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:39.494 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:39.490+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:40.027 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:40.022+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:40.074 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:40.067+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:40.284 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:40.280+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:40.296 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:40.292+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:40.451 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:40.446+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:40.481 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:40.475+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:41.008 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:41.004+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:41.086 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:41.082+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:41.298 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:41.293+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:41.338 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:41.335+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:41.438 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:41.433+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:41.517 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:41.513+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:42.055 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:42.050+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:42.095 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:42.092+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:42.321 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:42.316+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:42.385 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:42.381+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:42.417 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:42.407+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:42.536 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:42.531+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:43.032 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:43.028+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:43.146 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:43.142+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:43.313 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:43.308+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:43.387 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:43.384+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:43.453 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:43.448+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:43.534 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:43.530+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:44.038 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:44.033+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:44.134 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:44.130+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:44.362 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:44.357+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:44.427 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:44.422+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:44.428 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:44.423+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:44.520 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:44.515+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:44.990 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:44.986+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:45.120 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:45.116+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:45.407 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:45.402+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:45.414 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:45.410+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:45.435 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:45.432+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:45.492 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:45.487+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:46.037 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:46.033+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:46.136 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:46.132+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:46.405 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:46.402+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:46.429 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:46.425+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:46.472 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:46.465+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:46.535 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:46.531+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:47.008 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:47.003+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:47.113 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:47.107+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:47.410 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:47.407+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:47.425 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:47.421+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:47.431 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:47.425+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:47.558 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:47.554+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:47.973 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:47.968+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:48.088 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:48.083+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:48.404 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:48.400+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:48.453 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:48.449+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:48.470 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:48.465+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:48.552 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:48.548+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:48.957 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:48.952+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:49.113 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:49.110+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:49.419 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:49.407+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:49.434 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:49.429+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:49.510 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:49.505+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:49.592 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:49.587+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:49.920 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:49.914+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:50.076 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:50.072+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:50.402 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:50.398+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:50.456 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:50.451+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:50.498 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:50.492+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:50.571 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:50.567+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:50.921 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:50.917+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:51.078 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:51.074+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:51.383 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:51.379+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:51.504 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:51.500+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:51.532 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:51.527+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:51.541 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:51.535+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:51.881 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:51.876+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:52.057 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:52.047+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:52.361 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:52.356+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:52.470 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:52.465+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:52.511 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:52.507+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:52.521 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:52.515+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:52.839 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:52.834+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:53.037 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:53.033+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:53.324 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:53.319+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:53.454 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:53.450+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:53.480 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:53.475+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:53.558 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:53.553+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:53.825 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:53.813+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:54.031 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:54.027+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:54.382 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:54.377+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:54.471 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:54.466+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:54.503 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:54.500+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:54.565 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:54.560+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:54.806 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:54.800+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:55.059 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:55.055+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:55.424 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:55.419+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:55.478 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:55.472+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:55.548 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:55.544+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:55.591 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:55.586+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:55.796 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:55.791+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:56.041 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:56.037+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:56.471 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:56.468+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:56.471 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:56.461+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:56.537 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:56.534+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:56.629 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:56.623+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:56.760 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:56.754+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:57.039 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:57.034+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:57.433 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:57.429+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:57.471 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:57.465+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:57.521 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:57.517+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:57.661 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:57.656+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:57.808 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:57.803+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:58.077 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:58.071+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:58.480 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:58.475+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:58.483 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:58.479+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:58.520 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:58.514+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:58.721 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:58.715+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:58.853 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:58.847+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:46:59.076 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:46:59.071+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:46:59.480 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:46:59.475+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:46:59.503 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:46:59.499+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:46:59.512 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:46:59.505+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:46:59.728 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:46:59.723+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:46:59.903 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:46:59.897+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:00.078 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:00.073+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:00.501 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:00.497+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:00.506 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:00.500+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:00.538 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:00.535+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:00.730 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:47:00.724+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:47:00.876 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:00.870+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:01.068 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:01.064+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:01.472 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:01.466+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:01.506 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:01.501+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:01.509 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:01.505+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:01.700 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:47:01.693+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:47:01.848 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:01.840+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:02.112 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:02.107+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:02.465 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:02.461+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:02.467 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:02.462+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:02.541 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:02.537+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:02.694 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:47:02.688+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:47:02.844 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:02.839+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:03.096 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:03.092+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:03.490 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:03.484+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:03.506 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:03.501+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:03.551 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:03.546+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:03.698 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:47:03.692+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:47:03.807 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:03.800+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:04.071 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:04.068+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:04.488 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:04.484+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:04.501 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:04.495+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:04.541 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:04.532+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:04.737 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:47:04.731+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:47:04.775 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:04.769+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:05.040 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:05.035+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:05.470 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:05.464+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:05.479 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:05.475+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:05.511 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:05.507+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:05.742 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:47:05.736+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:47:05.813 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:05.806+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:06.035 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:06.031+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:06.491 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:06.486+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:06.498 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:06.495+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:06.509 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:06.505+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:06.759 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:47:06.753+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:47:06.821 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:06.816+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:07.059 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:07.055+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:07.478 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:07.471+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:07.522 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:07.518+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:07.548 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:07.543+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:07.794 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:47:07.788+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:47:07.810 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:07.804+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:08.080 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:08.076+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:08.438 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:08.432+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:08.544 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:08.540+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:08.569 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:08.565+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:08.755 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:47:08.749+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:47:08.854 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:08.847+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:09.103 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:09.098+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:09.455 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:09.449+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:09.503 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:09.498+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:09.617 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:09.613+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:09.665 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:47:09.663+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e532 v532) 2019-12-09T19:47:09.763 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:47:09.756+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:47:09.863 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:09.858+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:10.076 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:10.072+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:10.425 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:10.419+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:10.500 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:10.497+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:10.634 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:10.629+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:10.784 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:47:10.778+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:47:10.887 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:10.881+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:11.064 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:11.057+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:11.473 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:11.468+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:11.528 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:11.524+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:11.602 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:11.599+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:11.756 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:47:11.751+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:47:11.905 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:11.900+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:12.102 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:12.098+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:12.529 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:12.525+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:12.555 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:12.552+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:12.564 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:12.560+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:12.760 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:47:12.753+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:47:12.860 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:12.854+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:13.088 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:13.083+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:13.505 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:13.499+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:13.549 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:13.546+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:13.586 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:13.582+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:13.775 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:47:13.769+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:47:13.870 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:13.864+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:14.082 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:14.079+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:14.476 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:14.470+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:14.544 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:14.540+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:14.573 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:14.569+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:14.684 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:47:14.681+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e532 v532) 2019-12-09T19:47:14.813 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:47:14.808+0000 1694f700 -1 osd.4 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:54.817421+0000 front 2019-12-09T19:45:55.525115+0000 (oldest deadline 2019-12-09T19:46:37.690293+0000) 2019-12-09T19:47:14.914 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:14.907+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:15.049 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:15.045+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:15.524 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:15.520+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:15.525 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:15.519+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:15.550 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:15.544+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:15.937 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:15.932+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:16.046 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:16.042+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:16.498 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:16.494+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:16.516 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:16.512+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:16.533 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:16.528+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:16.940 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:16.935+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:17.048 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:17.044+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:17.487 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:17.483+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:17.558 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:17.554+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:17.565 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:17.560+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:17.947 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:17.942+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:18.092 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:18.087+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:18.501 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:18.496+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:18.539 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:18.529+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:18.566 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:18.561+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:18.999 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:18.994+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:19.089 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:47:19.085+0000 1694f700 -1 osd.3 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.563365+0000 front 2019-12-09T19:45:52.844276+0000 (oldest deadline 2019-12-09T19:46:37.390337+0000) 2019-12-09T19:47:19.526 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:47:19.521+0000 1694f700 -1 osd.7 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.554676+0000 front 2019-12-09T19:45:52.688282+0000 (oldest deadline 2019-12-09T19:46:37.955599+0000) 2019-12-09T19:47:19.549 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:47:19.541+0000 1694f700 -1 osd.0 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:55.371493+0000 front 2019-12-09T19:45:55.397672+0000 (oldest deadline 2019-12-09T19:46:36.663234+0000) 2019-12-09T19:47:19.561 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:47:19.557+0000 1694f700 -1 osd.1 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.510720+0000 front 2019-12-09T19:45:54.018878+0000 (oldest deadline 2019-12-09T19:46:37.540309+0000) 2019-12-09T19:47:19.777 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:47:19.771+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e532 v532) 2019-12-09T19:47:20.047 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:47:20.043+0000 1694f700 -1 osd.6 532 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:45:53.514264+0000 front 2019-12-09T19:45:53.555299+0000 (oldest deadline 2019-12-09T19:46:36.380195+0000) 2019-12-09T19:47:21.264 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:08:19.291 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:47:21.275 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:08:19.302 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:47:21.287 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:08:19.251 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:47:21.288 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:08:19.316 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:47:21.297 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:08:19.255 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:47:21.297 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:08:19.320 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:47:21.483 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:08:19.446 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:47:21.500 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:08:19.527 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:47:21.541 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:08:19.568 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:47:24.365 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:47:24.360+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T19:49:12.984 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:12.980+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:13.216 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:13.211+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:13.500 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:13.496+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:13.655 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:13.650+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:14.029 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:14.026+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:14.074 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:14.070+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:14.263 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:14.257+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:14.512 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:14.506+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:14.648 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:14.643+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:14.938 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:14.933+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:15.039 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:15.035+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:15.083 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:15.079+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:15.238 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:15.234+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:15.496 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:15.492+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:15.661 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:15.656+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:15.940 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:15.935+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:16.040 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:16.036+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:16.047 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:16.042+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:16.194 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:16.189+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:16.490 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:16.485+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:16.630 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:16.625+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:16.969 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:16.964+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:17.072 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:17.068+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:17.089 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:17.084+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:17.192 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:17.188+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:17.482 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:17.477+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:17.619 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:17.615+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:17.999 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:17.994+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:18.090 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:18.086+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:18.139 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:18.135+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:18.231 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:18.226+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:18.461 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:18.457+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:18.647 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:18.642+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:19.046 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:19.041+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:19.114 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:19.109+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:19.116 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:19.112+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:19.228 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:19.224+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:19.502 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:19.497+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:19.682 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:19.677+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:20.079 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:20.075+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:20.092 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:20.089+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:20.150 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:20.146+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:20.283 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:20.277+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:20.514 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:20.510+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:20.718 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:20.713+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:21.040 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:21.035+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:21.065 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:21.062+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:21.112 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:21.108+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:21.303 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:21.298+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:21.501 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:21.496+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:21.761 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:21.757+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:22.036 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:22.032+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:22.073 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:22.069+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:22.119 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:22.116+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:22.323 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:22.316+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:22.548 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:22.544+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:22.741 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:22.736+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:22.996 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:22.992+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:23.056 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:23.051+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:23.159 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:23.156+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:23.304 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:23.299+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:23.514 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:23.510+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:23.697 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:23.692+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:23.999 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:23.995+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:24.043 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:24.038+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:24.170 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:24.167+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:24.321 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:24.317+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:24.528 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:24.523+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:24.706 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:24.700+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:25.001 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:24.997+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:25.086 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:25.080+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:25.152 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:25.148+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:25.341 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:25.336+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:25.500 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:25.496+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:25.692 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:25.686+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:25.985 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:25.981+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:26.102 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:26.098+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:26.201 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:26.198+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:26.330 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:26.325+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:26.521 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:26.517+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:26.714 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:26.709+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:26.996 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:26.990+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:27.117 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:27.111+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:27.180 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:27.176+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:27.310 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:27.305+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:27.520 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:27.517+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:27.733 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:27.728+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:27.957 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:27.953+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:28.143 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:28.140+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:28.168 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:28.163+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:28.384 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:28.370+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:28.505 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:28.501+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:28.700 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:28.695+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:28.926 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:28.922+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:29.145 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:29.138+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:29.168 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:29.165+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:29.370 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:29.363+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:29.464 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:29.460+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:29.708 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:29.703+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:29.927 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:29.923+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:30.150 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:30.145+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:30.203 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:30.199+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:30.347 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:30.341+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:30.472 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:30.467+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:30.737 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:30.731+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:30.938 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:30.933+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:31.180 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:31.175+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:31.182 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:31.176+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:31.389 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:31.383+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:31.449 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:31.444+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:31.781 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:31.775+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:31.978 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:31.974+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:32.154 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:32.149+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:32.188 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:32.184+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:32.351 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:32.345+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:32.471 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:32.466+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:32.778 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:32.773+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:32.959 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:32.954+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:33.209 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:33.202+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:33.239 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:33.236+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:33.311 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:33.306+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:33.520 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:33.516+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:33.776 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:33.770+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:33.948 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:33.943+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:34.184 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:34.179+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:34.254 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:34.250+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:34.309 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:34.303+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:34.505 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:34.501+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:34.774 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:34.768+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:34.983 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:34.979+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:35.189 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:35.184+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:35.299 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:35.295+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:35.316 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:35.310+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:35.506 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:35.501+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:35.797 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:35.792+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:35.979 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:35.974+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:36.232 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:36.226+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:36.310 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:36.304+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:36.324 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:36.312+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:36.512 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:36.509+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:36.805 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:36.797+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:36.987 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:36.982+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:37.197 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:37.192+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:37.297 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:37.292+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:37.326 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:37.322+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:37.529 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:37.521+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:37.765 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:37.761+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:37.995 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:37.991+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:38.173 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:38.167+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:38.322 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:38.316+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:38.355 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:38.351+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:38.571 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:38.566+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:38.726 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:38.719+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:39.039 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:39.035+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:39.170 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:39.164+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:39.291 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:39.286+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:39.385 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:39.381+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:39.532 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:39.527+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:39.720 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:39.714+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:40.076 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:40.073+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:40.196 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:40.189+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:40.298 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:40.292+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:40.406 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:40.403+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:40.492 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:40.488+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:40.751 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:40.746+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:41.046 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:41.043+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:41.187 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:41.181+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:41.350 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:41.344+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:41.431 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:41.427+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:41.499 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:41.495+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:41.752 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:41.746+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:42.056 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:42.052+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:42.186 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:42.180+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:42.340 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:42.334+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:42.390 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:42.385+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:42.471 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:42.467+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:42.747 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:42.741+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:43.099 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:43.095+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:43.210 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:43.204+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:43.382 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:43.376+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:43.423 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:43.417+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:43.457 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:43.452+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:43.765 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:43.760+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:44.079 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:44.075+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:44.169 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:44.164+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:44.392 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:44.388+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:44.401 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:44.394+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:44.463 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:44.459+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:44.772 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:44.766+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:45.073 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:45.070+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:45.199 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:45.194+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:45.271 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:49:45.268+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e542 v542) 2019-12-09T19:49:45.377 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:45.371+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:45.425 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:45.420+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:45.426 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:45.420+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:45.808 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:45.802+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:46.107 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:46.103+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:46.204 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:46.198+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:46.335 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:46.329+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:46.389 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:46.385+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:46.421 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:46.419+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:46.826 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:46.821+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:47.087 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:47.083+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:47.181 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:47.175+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:47.373 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:47.366+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:47.399 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:47.395+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:47.439 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:47.435+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:47.802 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:47.796+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:48.076 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:48.072+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:48.198 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:48.192+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:48.362 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:48.358+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:48.397 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:48.391+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:48.429 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:48.425+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:48.764 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:48.759+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:49.076 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:49.072+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:49.161 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:49.155+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:49.348 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:49.344+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:49.389 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:49.385+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:49.389 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:49.383+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:49.778 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:49.773+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:50.041 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:50.038+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:50.121 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:50.116+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:50.287 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:49:50.283+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e542 v542) 2019-12-09T19:49:50.380 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:50.371+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:50.408 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:50.404+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:50.433 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:50.428+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:50.771 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:50.766+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:51.089 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:51.085+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:51.152 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:51.148+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:51.360 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:51.357+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:51.382 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:51.379+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:51.421 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:51.416+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:51.821 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:51.809+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:52.083 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:52.081+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:52.187 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:52.183+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:52.387 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:52.383+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:52.417 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:52.413+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:52.441 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:52.436+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:52.845 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:52.841+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:53.052 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:53.047+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:53.167 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:53.162+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:53.350 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:53.345+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:53.410 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:53.407+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:53.470 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:53.466+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:53.884 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:53.880+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:54.029 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:54.025+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:54.147 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:54.143+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:54.335 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:54.331+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:54.418 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:54.414+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:54.523 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:54.519+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:54.886 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:54.881+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:55.010 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:55.006+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:55.191 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:55.187+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:55.311 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:49:55.304+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e542 v542) 2019-12-09T19:49:55.340 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:55.336+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:55.396 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:55.392+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:55.491 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:55.487+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:55.885 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:55.880+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:56.032 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:56.023+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:56.195 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:56.190+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:56.378 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:56.371+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:56.431 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:56.428+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:56.513 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:56.509+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:56.886 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:56.882+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:57.006 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:57.002+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:57.238 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:57.233+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:57.392 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:57.388+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:57.405 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:57.397+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:57.494 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:57.490+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:57.903 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:57.896+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:58.052 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:58.047+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:58.256 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:58.252+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:58.405 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:58.402+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:58.405 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:58.400+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:58.451 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:58.447+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:58.900 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:58.892+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:49:59.020 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:49:59.015+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:49:59.270 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:49:59.264+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:49:59.433 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:49:59.428+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:49:59.448 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:49:59.444+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:49:59.450 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:49:59.445+0000 1694f700 -1 osd.3 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.136367+0000 front 2019-12-09T19:48:31.794727+0000 (oldest deadline 2019-12-09T19:49:12.018813+0000) 2019-12-09T19:49:59.909 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:49:59.904+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:50:00.055 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:50:00.052+0000 1694f700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:28.487779+0000 front 2019-12-09T19:48:28.464147+0000 (oldest deadline 2019-12-09T19:49:13.372467+0000) 2019-12-09T19:50:00.233 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:50:00.228+0000 1694f700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:29.506034+0000 front 2019-12-09T19:48:29.490958+0000 (oldest deadline 2019-12-09T19:49:14.749019+0000) 2019-12-09T19:50:00.400 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:50:00.392+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e542 v542) 2019-12-09T19:50:00.405 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:50:00.401+0000 1694f700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:32.964941+0000 front 2019-12-09T19:48:32.946948+0000 (oldest deadline 2019-12-09T19:49:13.405862+0000) 2019-12-09T19:50:00.410 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:50:00.404+0000 1694f700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.607003+0000 front 2019-12-09T19:48:31.042146+0000 (oldest deadline 2019-12-09T19:49:12.403321+0000) 2019-12-09T19:50:00.906 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:50:00.903+0000 1694f700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:48:31.131372+0000 front 2019-12-09T19:48:30.136417+0000 (oldest deadline 2019-12-09T19:49:12.950782+0000) 2019-12-09T19:50:04.655 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:50:04.649+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T19:50:45.636 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:11:43.664 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:50:45.644 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:11:43.667 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:50:45.689 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:11:43.652 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:50:45.690 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:11:43.654 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:50:45.727 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:11:43.754 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:50:45.732 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:11:43.759 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:50:45.899 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:11:43.926 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:50:45.925 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:11:43.888 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:50:45.968 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:11:43.995 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:51:20.184 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:12:18.212 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:51:20.191 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:12:18.218 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:51:20.203 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:12:18.167 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:51:20.206 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:12:18.234 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:51:20.209 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:12:18.236 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:51:20.210 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:12:18.174 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:51:20.260 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:12:18.288 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:51:20.275 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:12:18.303 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:51:20.289 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:12:18.253 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:51:41.117 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:41.114+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:42.084 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:42.080+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:43.067 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:43.061+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:44.035 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:51:44.030+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:51:44.110 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:44.106+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:44.748 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:51:44.744+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:51:45.041 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:51:45.037+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:51:45.142 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:45.138+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:45.268 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:51:45.263+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:51:45.722 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:51:45.718+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:51:46.052 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:51:46.046+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:51:46.127 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:46.122+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:46.278 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:51:46.273+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:51:46.684 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:51:46.681+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:51:47.020 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:51:47.015+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:51:47.160 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:47.155+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:47.307 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:51:47.302+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:51:47.735 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:51:47.731+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:51:47.740 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:51:47.735+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:51:47.978 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:51:47.974+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:51:48.135 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:48.129+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:48.329 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:51:48.324+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:51:48.746 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:51:48.742+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:51:48.748 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:51:48.744+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:51:48.983 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:51:48.980+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:51:49.182 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:49.176+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:49.378 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:51:49.373+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:51:49.724 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:51:49.719+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:51:49.768 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:51:49.764+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:51:50.024 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:51:50.021+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:51:50.204 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:50.200+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:50.360 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:51:50.355+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:51:50.722 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:51:50.717+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:51:50.735 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:51:50.731+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:51:51.044 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:51:51.040+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:51:51.239 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:51.235+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:51.346 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:51:51.341+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:51:51.730 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:51:51.726+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:51:51.740 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:51:51.735+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:51:52.042 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:51:52.038+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:51:52.266 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:52.260+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:52.390 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:51:52.386+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:51:52.766 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:51:52.761+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:51:52.785 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:51:52.781+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:51:53.032 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:51:53.028+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:51:53.287 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:53.282+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:53.371 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:51:53.367+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:51:53.781 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:51:53.777+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:51:53.793 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:51:53.788+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:51:54.004 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:51:53.999+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:51:54.303 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:54.299+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:54.355 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:51:54.350+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:51:54.741 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:51:54.736+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:51:54.761 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:51:54.757+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:51:55.016 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:51:55.012+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:51:55.322 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:55.318+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:55.328 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:51:55.323+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:51:55.760 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:51:55.754+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:51:55.769 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:51:55.766+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:51:56.060 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:51:56.056+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:51:56.285 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:56.281+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:56.345 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:51:56.339+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:51:56.752 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:51:56.747+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:51:56.799 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:51:56.796+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:51:57.029 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:51:57.024+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:51:57.271 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:57.267+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:57.360 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:51:57.355+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:51:57.790 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:51:57.784+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:51:57.845 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:51:57.840+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:51:58.032 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:51:58.029+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:51:58.268 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:58.265+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:58.407 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:51:58.402+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:51:58.759 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:51:58.755+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:51:58.878 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:51:58.874+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:51:59.034 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:51:59.030+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:51:59.303 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:51:59.299+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:51:59.401 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:51:59.397+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:51:59.791 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:51:59.787+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:51:59.890 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:51:59.885+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:00.066 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:00.062+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:00.362 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:00.357+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:00.446 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:00.441+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:00.750 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:00.745+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:00.927 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:00.923+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:01.023 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:01.019+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:01.405 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:01.401+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:01.429 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:01.424+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:01.769 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:01.765+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:01.892 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:01.885+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:02.008 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:02.004+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:02.425 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:02.422+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:02.477 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:02.472+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:02.798 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:02.792+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:02.899 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:02.895+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:03.012 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:03.008+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:03.398 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:03.394+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:03.460 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:03.454+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:03.761 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:03.756+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:03.885 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:03.881+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:03.994 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:03.990+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:04.419 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:04.415+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:04.475 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:04.469+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:04.814 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:04.808+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:04.860 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:04.854+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:04.998 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:04.994+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:05.395 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:05.391+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:05.482 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:05.477+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:05.805 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:05.799+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:05.833 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:05.829+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:05.983 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:05.979+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:06.369 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:06.365+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:06.531 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:06.525+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:06.790 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:06.784+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:06.798 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:06.794+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:06.977 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:06.973+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:07.355 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:07.351+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:07.503 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:07.497+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:07.807 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:07.803+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:07.819 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:07.814+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:07.935 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:07.931+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:08.326 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:08.323+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:08.531 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:08.524+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:08.807 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:08.803+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:08.859 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:08.851+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:08.941 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:08.937+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:09.323 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:09.320+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:09.542 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:09.536+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:09.820 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:09.815+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:09.853 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:09.847+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:09.937 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:09.930+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:10.320 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:10.315+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:10.550 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:10.544+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:10.778 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:10.773+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:10.807 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:10.801+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:10.832 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:10.827+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:10.894 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:10.889+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:11.318 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:11.313+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:11.539 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:11.534+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:11.743 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:11.739+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:11.801 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:11.794+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:11.810 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:11.801+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:11.869 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:11.865+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:12.307 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:12.302+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:12.505 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:12.498+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:12.764 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:12.760+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:12.823 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:12.816+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:12.836 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:12.832+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:12.845 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:12.840+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:13.357 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:13.353+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:13.558 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:13.552+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:13.741 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:13.737+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:13.844 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:13.840+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:13.852 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:13.846+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:13.855 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:13.849+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:14.339 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:14.335+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:14.558 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:14.552+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:14.724 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:14.719+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:14.871 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:14.866+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:14.884 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:14.881+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:14.899 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:14.893+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:15.341 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:15.336+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:15.527 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:15.521+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:15.678 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:15.674+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:15.876 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:15.870+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:15.897 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:15.893+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:15.948 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:15.942+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:16.188 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:52:16.185+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 48sec e552 v552) 2019-12-09T19:52:16.352 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:16.349+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:16.497 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:16.492+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:16.695 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:16.689+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:16.851 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:16.845+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:16.934 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:16.930+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:16.990 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:16.983+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:17.383 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:17.379+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:17.497 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:17.491+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:17.743 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:17.738+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:17.901 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:17.894+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:17.979 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:17.976+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:18.012 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:18.007+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:18.385 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:18.382+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:18.498 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:18.492+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:18.718 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:18.714+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:18.917 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:18.910+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:18.991 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:18.987+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:19.040 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:19.034+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:19.407 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:19.402+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:19.472 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:19.465+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:19.703 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:19.699+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:19.953 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:19.948+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:20.032 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:20.028+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:20.041 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:20.036+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:20.443 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:20.438+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:20.460 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:20.456+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:20.735 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:20.730+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:20.976 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:20.971+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:21.011 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:21.005+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:21.044 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:21.037+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:21.207 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:52:21.204+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 48sec e552 v552) 2019-12-09T19:52:21.415 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:21.412+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:21.457 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:21.451+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:21.729 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:21.725+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:22.012 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:22.007+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:22.044 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:22.040+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:22.049 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:22.043+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:22.417 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:22.411+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:22.431 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:22.428+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:22.686 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:22.682+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:23.057 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:23.051+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:23.079 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:23.076+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:23.095 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:23.090+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:23.444 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:23.438+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:23.446 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:23.442+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:23.662 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:23.658+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:24.060 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:24.052+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:24.095 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:24.090+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:24.098 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:24.094+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:24.467 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:24.463+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:24.470 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:24.466+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:24.711 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:24.707+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:25.015 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:25.011+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:25.116 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:25.111+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:25.149 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:25.145+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:25.440 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:25.436+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:25.491 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:25.488+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:25.698 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:25.693+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:26.018 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:26.014+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:26.093 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:26.089+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:26.115 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:26.111+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:26.231 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:52:26.225+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 48sec e552 v552) 2019-12-09T19:52:26.460 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:26.456+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:26.479 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:26.474+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:26.656 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:26.652+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:27.046 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:27.041+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:27.115 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:27.109+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:27.126 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:27.122+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:27.455 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:27.451+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:27.521 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:27.517+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:27.665 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:27.661+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:28.004 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:27.997+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:28.094 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:28.091+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:28.160 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:28.154+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:28.431 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:28.428+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:28.544 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:28.540+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:28.633 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:28.629+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:28.991 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:28.986+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:29.115 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:29.109+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:29.136 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:29.132+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:29.439 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:29.435+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:29.513 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:29.509+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:29.684 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:29.680+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:29.981 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:29.976+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:30.122 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:30.118+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:30.166 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:30.162+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:30.415 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:30.411+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:30.519 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:52:30.514+0000 1694f700 -1 osd.6 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.715908+0000 front 2019-12-09T19:51:03.716843+0000 (oldest deadline 2019-12-09T19:51:45.004348+0000) 2019-12-09T19:52:30.719 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:52:30.715+0000 1694f700 -1 osd.3 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:00.749285+0000 front 2019-12-09T19:51:00.750213+0000 (oldest deadline 2019-12-09T19:51:44.734746+0000) 2019-12-09T19:52:30.958 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:52:30.945+0000 1694f700 -1 osd.7 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:05.975887+0000 front 2019-12-09T19:51:05.977776+0000 (oldest deadline 2019-12-09T19:52:10.352290+0000) 2019-12-09T19:52:31.086 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:52:31.081+0000 1694f700 -1 osd.4 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:51:03.709112+0000 front 2019-12-09T19:51:03.714822+0000 (oldest deadline 2019-12-09T19:51:47.050952+0000) 2019-12-09T19:52:31.145 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:52:31.141+0000 1694f700 -1 osd.0 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:57.860986+0000 front 2019-12-09T19:50:57.855814+0000 (oldest deadline 2019-12-09T19:51:43.509186+0000) 2019-12-09T19:52:31.315 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:52:31.311+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 48sec e552 v552) 2019-12-09T19:52:31.388 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:52:31.384+0000 1694f700 -1 osd.1 552 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:50:55.157552+0000 front 2019-12-09T19:51:01.173403+0000 (oldest deadline 2019-12-09T19:51:40.991275+0000) 2019-12-09T19:52:40.363 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:52:40.357+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T19:54:18.266 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:18.262+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:18.785 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:18.780+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:19.028 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:19.024+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:19.303 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:19.297+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:19.613 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:19.607+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:19.753 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:19.748+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:20.059 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:20.053+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:20.246 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:54:20.241+0000 1694f700 -1 osd.0 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.253815+0000 front 2019-12-09T19:53:36.305963+0000 (oldest deadline 2019-12-09T19:54:20.238872+0000) 2019-12-09T19:54:20.263 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:20.257+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:20.640 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:20.635+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:20.713 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:20.709+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:21.092 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:21.088+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:21.227 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:21.222+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:21.607 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:21.602+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:21.721 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:21.716+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:22.097 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:22.093+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:22.226 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:22.220+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:22.657 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:22.652+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:22.720 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:22.716+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:23.068 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:23.064+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:23.238 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:23.234+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:23.648 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:23.643+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:23.764 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:23.760+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:24.117 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:24.112+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:24.273 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:24.268+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:24.651 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:24.647+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:24.787 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:24.783+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:25.126 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:25.123+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:25.321 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:25.316+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:25.640 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:25.635+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:25.758 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:25.754+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:26.137 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:26.134+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:26.274 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:26.270+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:26.676 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:26.671+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:26.723 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:26.719+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:27.188 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:27.183+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:27.240 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:27.235+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:27.645 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:27.640+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:27.683 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:27.680+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:28.200 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:28.196+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:28.290 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:28.284+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:28.663 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:28.658+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:28.678 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:28.674+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:28.731 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:28.726+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:29.254 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:29.250+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:29.277 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:29.269+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:29.646 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:29.642+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:29.683 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:29.678+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:29.702 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:29.698+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:30.225 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:30.222+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:30.299 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:30.294+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:30.627 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:30.622+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:30.675 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:30.670+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:30.680 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:30.675+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:31.232 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:31.228+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:31.265 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:31.261+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:31.598 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:31.595+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:31.677 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:31.672+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:31.733 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:31.728+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:32.205 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:32.201+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:32.260 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:32.255+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:32.630 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:32.622+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:32.729 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:32.723+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:32.782 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:32.775+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:33.249 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:33.245+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:33.279 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:33.273+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:33.623 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:33.618+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:33.714 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:33.709+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:33.787 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:33.783+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:34.269 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:34.263+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:34.302 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:34.297+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:34.646 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:34.642+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:34.729 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:34.724+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:34.812 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:34.806+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:35.269 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:35.265+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:35.284 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:35.280+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:35.665 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:35.660+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:35.766 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:35.760+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:35.774 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:35.768+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:36.245 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:36.240+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:36.264 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:36.258+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:36.716 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:36.710+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:36.749 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:36.743+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:36.801 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:36.795+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:37.230 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:37.226+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:37.241 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:37.236+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:37.716 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:37.710+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:37.737 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:37.734+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:37.802 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:37.797+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:38.202 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:38.197+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:38.294 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:38.289+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:38.713 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:38.709+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:38.715 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:38.709+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:38.824 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:38.818+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:39.166 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:39.162+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:39.350 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:39.344+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:39.694 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:39.690+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:39.713 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:39.707+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:39.808 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:39.803+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:40.219 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:40.211+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:40.376 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:40.353+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:40.698 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:40.695+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:40.711 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:40.706+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:40.787 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:40.781+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:41.174 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:41.171+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:41.344 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:41.338+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:41.679 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:41.675+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:41.734 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:41.728+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:41.829 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:41.823+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:42.164 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:42.161+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:42.350 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:42.344+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:42.706 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:42.701+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:42.730 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:42.724+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:42.827 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:42.821+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:43.213 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:43.209+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:43.356 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:43.349+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:43.683 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:43.678+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:43.731 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:43.726+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:43.795 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:43.789+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:44.228 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:44.224+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:44.349 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:44.343+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:44.653 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:44.646+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:44.695 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:44.691+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:44.847 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:44.840+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:45.187 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:45.182+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:45.325 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:45.319+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:45.679 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:45.673+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:45.725 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:45.720+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:45.825 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:45.819+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:46.236 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:46.231+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:46.290 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:46.285+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:46.706 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:46.702+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:46.708 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:46.702+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:46.860 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:46.855+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:47.268 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:47.264+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:47.321 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:47.316+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:47.720 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:47.710+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:47.741 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:47.738+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:47.882 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:47.877+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:48.271 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:48.267+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:48.360 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:48.354+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:48.701 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:48.697+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:48.727 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:48.720+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:48.858 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:48.852+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:49.241 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:49.237+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:49.380 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:49.375+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:49.736 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:49.732+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:49.772 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:49.766+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:49.907 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:49.901+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:50.270 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:50.266+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:50.391 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:50.387+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:50.730 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:50.724+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:50.736 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:50.730+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:50.917 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:50.910+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:51.296 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:51.292+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:51.407 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:51.401+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:51.712 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:51.707+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:51.764 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:54:51.761+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e562 v562) 2019-12-09T19:54:51.778 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:51.772+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:51.944 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:51.939+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:52.259 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:52.254+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:52.397 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:52.392+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:52.710 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:52.706+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:52.816 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:52.810+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:52.988 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:52.983+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:53.278 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:53.274+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:53.358 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:53.352+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:53.707 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:53.703+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:53.790 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:53.784+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:53.992 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:53.986+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:54.323 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:54.319+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:54.331 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:54.326+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:54.736 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:54.732+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:54.761 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:54.756+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:54.965 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:54.958+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:55.297 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:55.293+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:55.342 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:55.336+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:55.739 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:55.735+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:55.761 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:55.754+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:55.973 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:55.968+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:56.259 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:56.255+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:56.305 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:56.299+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:56.754 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:56.750+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:56.834 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:56.766+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:56.835 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:54:56.778+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e562 v562) 2019-12-09T19:54:56.985 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:56.980+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:57.257 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:57.248+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:57.332 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:57.327+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:57.753 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:57.749+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:57.786 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:57.781+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:57.974 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:57.970+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:58.245 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:58.242+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:58.370 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:58.366+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:58.746 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:58.741+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:58.747 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:58.743+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:58.953 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:58.948+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:54:59.308 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:54:59.297+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:54:59.343 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:54:59.338+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:54:59.774 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:54:59.770+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:54:59.783 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:54:59.778+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:54:59.967 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:54:59.963+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:55:00.320 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:55:00.317+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:55:00.350 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:55:00.346+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:55:00.785 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:55:00.781+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:55:00.820 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:55:00.815+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:55:00.953 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:55:00.948+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:55:01.289 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:55:01.285+0000 1694f700 -1 osd.1 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.422796+0000 front 2019-12-09T19:53:34.691093+0000 (oldest deadline 2019-12-09T19:54:18.517144+0000) 2019-12-09T19:55:01.355 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:55:01.350+0000 1694f700 -1 osd.4 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:34.435555+0000 front 2019-12-09T19:53:34.436375+0000 (oldest deadline 2019-12-09T19:54:17.306989+0000) 2019-12-09T19:55:01.796 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:55:01.791+0000 1694f700 -1 osd.6 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:33.705480+0000 front 2019-12-09T19:53:33.766130+0000 (oldest deadline 2019-12-09T19:54:18.796299+0000) 2019-12-09T19:55:01.797 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:55:01.794+0000 1694f700 -1 osd.3 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:35.391949+0000 front 2019-12-09T19:53:35.875215+0000 (oldest deadline 2019-12-09T19:54:17.820324+0000) 2019-12-09T19:55:01.869 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:55:01.862+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e562 v562) 2019-12-09T19:55:01.938 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:55:01.934+0000 1694f700 -1 osd.7 562 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:53:36.588677+0000 front 2019-12-09T19:53:36.596133+0000 (oldest deadline 2019-12-09T19:54:28.499779+0000) 2019-12-09T19:55:10.252 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:55:10.245+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T19:55:20.426 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:16:18.449 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:20.431 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:16:18.459 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:20.439 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:16:18.467 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:20.444 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:16:18.472 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:20.452 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:16:18.415 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:20.460 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:16:18.424 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:20.683 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:16:18.709 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:20.733 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:16:18.760 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:20.760 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:16:18.723 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:55:42.954 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:55:42.733+0000 1694f700 -1 osd.5 562 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:139554 7.3 7.751e8b3 (undecoded) ondisk+read+known_if_redirected e562) 2019-12-09T19:55:47.983 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:55:47.936+0000 35276700 -1 osd.5 567 build_incremental_map_msg missing incremental map 567 2019-12-09T19:55:48.296 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:55:48.161+0000 33a73700 -1 osd.5 567 build_incremental_map_msg missing incremental map 567 2019-12-09T19:55:48.339 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:55:48.211+0000 35276700 -1 osd.5 567 build_incremental_map_msg missing incremental map 567 2019-12-09T19:55:49.760 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:55:49.676+0000 35a77700 -1 osd.5 568 build_incremental_map_msg missing incremental map 567 2019-12-09T19:56:49.137 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:56:49.131+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:56:49.544 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:56:49.538+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:56:50.139 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:56:50.134+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:56:50.395 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:56:50.390+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:56:50.509 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:56:50.503+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:56:50.627 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:56:50.623+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:56:51.104 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:56:51.097+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:56:51.366 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:56:51.363+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:56:51.549 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:56:51.543+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:56:51.650 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:56:51.645+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:56:51.651 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:56:51.646+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:56:52.108 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:56:52.104+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:56:52.230 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:56:52.225+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:56:52.355 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:56:52.352+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:56:52.577 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:56:52.572+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:56:52.612 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:56:52.608+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:56:52.696 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:56:52.690+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:56:53.087 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:56:53.082+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:56:53.270 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:56:53.265+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:56:53.328 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:56:53.324+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:56:53.551 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:56:53.546+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:56:53.607 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:56:53.603+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:56:53.685 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:56:53.680+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:56:54.135 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:56:54.131+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:56:54.281 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:56:54.276+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:56:54.377 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:56:54.373+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:56:54.532 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:56:54.526+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:56:54.654 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:56:54.649+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:56:54.713 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:56:54.709+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:56:55.130 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:56:55.126+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:56:55.237 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:56:55.232+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:56:55.340 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:56:55.336+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:56:55.574 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:56:55.569+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:56:55.646 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:56:55.642+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:56:55.700 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:56:55.696+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:56:56.086 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:56:56.081+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:56:56.241 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:56:56.235+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:56:56.376 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:56:56.372+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:56:56.564 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:56:56.559+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:56:56.628 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:56:56.624+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:56:56.693 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:56:56.689+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:56:57.112 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:56:57.107+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:56:57.230 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:56:57.226+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:56:57.373 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:56:57.368+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:56:57.527 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:56:57.523+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:56:57.628 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:56:57.624+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:56:57.650 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:56:57.647+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:56:58.120 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:56:58.115+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:56:58.192 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:56:58.188+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:56:58.327 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:56:58.323+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:56:58.528 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:56:58.523+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:56:58.636 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:56:58.631+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:56:58.702 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:56:58.697+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:56:59.164 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:56:59.159+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:56:59.238 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:56:59.232+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:56:59.323 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:56:59.319+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:56:59.503 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:56:59.498+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:56:59.636 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:56:59.632+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:56:59.671 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:56:59.668+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:00.147 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:00.142+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:00.270 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:00.265+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:00.361 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:00.356+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:00.533 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:00.528+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:00.688 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:00.684+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:00.698 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:00.694+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:01.108 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:01.103+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:01.264 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:01.260+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:01.406 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:01.402+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:01.575 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:01.570+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:01.667 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:01.662+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:01.680 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:01.675+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:02.112 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:02.107+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:02.272 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:02.266+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:02.407 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:02.404+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:02.557 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:02.552+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:02.628 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:02.624+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:02.723 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:02.719+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:03.095 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:03.091+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:03.233 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:03.228+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:03.371 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:03.367+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:03.544 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:03.538+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:03.670 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:03.667+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:03.734 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:03.730+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:04.144 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:04.138+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:04.196 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:04.191+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:04.357 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:04.353+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:04.593 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:04.586+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:04.675 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:04.671+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:04.775 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:04.770+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:05.113 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:05.108+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:05.172 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:05.167+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:05.390 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:05.386+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:05.622 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:05.617+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:05.663 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:05.659+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:05.819 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:05.815+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:06.093 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:06.087+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:06.217 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:06.211+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:06.424 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:06.420+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:06.625 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:06.621+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:06.634 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:06.630+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:06.839 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:06.835+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:07.108 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:07.102+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:07.256 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:07.251+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:07.394 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:07.390+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:07.616 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:07.611+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:07.650 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:07.645+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:07.874 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:07.868+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:08.103 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:08.099+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:08.241 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:08.235+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:08.429 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:08.425+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:08.586 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:08.583+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:08.625 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:08.619+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:08.874 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:08.869+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:09.095 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:09.090+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:09.274 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:09.266+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:09.400 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:09.397+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:09.582 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:09.578+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:09.650 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:09.644+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:09.863 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:09.859+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:10.140 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:10.134+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:10.273 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:10.267+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:10.419 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:10.415+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:10.552 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:10.547+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:10.606 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:10.600+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:10.887 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:10.883+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:11.150 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:11.145+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:11.236 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:11.230+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:11.384 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:11.381+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:11.584 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:11.579+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:11.612 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:11.605+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:11.899 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:11.895+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:12.193 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:12.187+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:12.209 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:12.203+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:12.356 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:12.351+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:12.547 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:12.544+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:12.650 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:12.645+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:12.895 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:12.890+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:13.180 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:13.174+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:13.209 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:13.203+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:13.341 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:13.337+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:13.513 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:13.509+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:13.689 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:13.683+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:13.947 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:13.942+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:14.162 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:14.157+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:14.178 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:14.172+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:14.342 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:14.337+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:14.526 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:14.522+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:14.651 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:14.645+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:14.961 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:14.957+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:15.146 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:15.137+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:15.226 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:15.220+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:15.330 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:15.323+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:15.525 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:15.520+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:15.648 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:15.642+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:15.946 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:15.941+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:16.162 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:16.155+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:16.236 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:16.231+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:16.295 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:16.292+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:16.488 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:16.484+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:16.660 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:16.655+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:16.990 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:16.983+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:17.188 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:17.181+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:17.267 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:17.261+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:17.314 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:17.310+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:17.456 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:17.452+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:17.664 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:17.659+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:18.021 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:18.017+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:18.217 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:18.212+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:18.234 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:18.227+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:18.296 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:18.290+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:18.416 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:18.411+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:18.694 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:18.688+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:19.022 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:19.018+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:19.211 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:19.205+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:19.273 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:19.267+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:19.328 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:19.324+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:19.466 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:19.460+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:19.656 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:19.650+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:20.066 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:20.062+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:20.221 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:20.210+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:20.236 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:20.224+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:20.312 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:20.308+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:20.506 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:20.502+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:20.660 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:20.654+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:21.020 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:21.016+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:21.252 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:21.246+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:21.267 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:21.261+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:21.326 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:21.322+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:21.501 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:21.498+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:21.693 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:21.687+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:22.027 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:22.022+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:22.241 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:22.235+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:22.278 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:22.273+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:22.362 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:22.358+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:22.442 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:57:22.438+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 42sec e573 v573) 2019-12-09T19:57:22.544 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:22.539+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:22.713 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:22.707+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:22.994 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:22.989+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:23.283 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:23.278+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:23.296 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:23.289+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:23.387 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:23.383+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:23.569 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:23.566+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:23.699 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:23.692+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:24.046 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:24.042+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:24.327 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:24.321+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:24.342 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:24.336+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:24.400 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:24.396+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:24.556 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:24.552+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:24.725 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:24.717+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:25.069 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:25.065+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:25.327 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:25.322+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:25.339 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:25.334+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:25.451 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:25.448+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:25.522 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:25.519+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:25.737 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:25.730+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:26.090 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:26.086+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:26.310 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:26.304+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:26.361 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:26.354+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:26.468 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:26.464+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:26.539 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:26.536+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:26.710 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:26.703+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:27.130 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:27.126+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:27.277 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:27.272+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:27.340 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:27.334+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:27.463 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:57:27.458+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 42sec e573 v573) 2019-12-09T19:57:27.513 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:27.509+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:27.575 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:27.571+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:27.762 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:27.756+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:28.085 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:28.080+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:28.266 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:28.261+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:28.391 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:28.385+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:28.551 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:28.546+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:28.564 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:28.560+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:28.759 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:28.753+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:29.054 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:29.050+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:29.242 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:29.236+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:29.437 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:29.430+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:29.529 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:29.526+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:29.531 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:29.527+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:29.803 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:29.797+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:30.104 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:30.101+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:30.207 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:30.203+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:30.413 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:30.409+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:30.511 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:30.509+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:30.580 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:30.577+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:30.794 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:30.789+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:31.139 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:31.135+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:31.237 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:31.232+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:31.464 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:31.459+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:31.556 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:31.554+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:31.579 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:31.576+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:31.845 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:57:31.837+0000 1694f700 -1 osd.6 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:03.706723+0000 front 2019-12-09T19:56:03.710769+0000 (oldest deadline 2019-12-09T19:56:49.437594+0000) 2019-12-09T19:57:32.174 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:57:32.168+0000 1694f700 -1 osd.1 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.455006+0000 front 2019-12-09T19:56:08.422216+0000 (oldest deadline 2019-12-09T19:56:51.079752+0000) 2019-12-09T19:57:32.287 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:57:32.283+0000 1694f700 -1 osd.7 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.349868+0000 front 2019-12-09T19:56:09.847477+0000 (oldest deadline 2019-12-09T19:56:48.599201+0000) 2019-12-09T19:57:32.431 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:57:32.427+0000 1694f700 -1 osd.4 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:09.578954+0000 front 2019-12-09T19:56:08.682734+0000 (oldest deadline 2019-12-09T19:56:52.017865+0000) 2019-12-09T19:57:32.539 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:57:32.536+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 42sec e573 v573) 2019-12-09T19:57:32.544 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:57:32.542+0000 1694f700 -1 osd.3 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:06.147335+0000 front 2019-12-09T19:56:05.484111+0000 (oldest deadline 2019-12-09T19:56:49.825193+0000) 2019-12-09T19:57:32.557 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:57:32.555+0000 1694f700 -1 osd.0 573 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:56:08.591885+0000 front 2019-12-09T19:56:08.573639+0000 (oldest deadline 2019-12-09T19:56:50.024757+0000) 2019-12-09T19:57:40.361 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:57:40.354+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T19:58:17.144 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T19:58:17.136+0000 35a77700 -1 osd.5 573 build_incremental_map_msg missing incremental map 567 2019-12-09T19:59:08.140 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:20:06.168 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:08.183 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:20:06.210 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:08.216 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:20:06.178 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:08.218 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:20:06.182 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:08.256 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:20:06.284 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:08.258 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:20:06.286 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:08.435 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:20:06.462 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:08.461 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:20:06.425 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:08.466 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:20:06.493 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:22.301 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:22.295+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:23.278 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:23.271+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:23.380 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:23.373+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:24.092 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:24.087+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:24.314 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:24.308+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:24.344 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:24.340+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:25.148 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:25.141+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:25.350 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:25.347+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:25.357 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:25.352+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:25.377 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:20:23.405 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:25.389 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:20:23.416 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:25.403 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:20:23.366 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:25.408 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:20:23.435 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:25.410 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:20:23.438 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:25.421 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:20:23.384 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:25.433 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:20:23.461 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:25.463 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:20:23.490 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:25.464 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:20:23.427 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T19:59:26.186 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:26.181+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:26.367 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:26.362+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:26.404 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:26.399+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:27.017 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:27.013+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:27.168 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:27.162+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:27.365 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:27.358+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:27.456 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:27.452+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:27.646 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:27.643+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:27.674 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:27.670+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:28.036 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:28.032+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:28.169 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:28.165+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:28.351 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:28.347+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:28.420 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:28.416+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:28.611 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:28.607+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:28.720 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:28.716+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:29.038 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:29.034+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:29.147 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:29.135+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:29.391 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:29.387+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:29.401 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:29.395+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:29.637 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:29.632+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:29.696 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:29.693+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:30.010 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:30.005+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:30.105 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:30.095+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:30.409 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:30.404+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:30.416 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:30.412+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:30.656 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:30.650+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:30.676 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:30.671+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:31.030 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:31.025+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:31.126 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:31.121+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:31.425 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:31.421+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:31.463 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:31.459+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:31.656 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:31.652+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:31.673 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:31.667+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:31.998 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:31.991+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:32.088 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:32.084+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:32.428 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:32.424+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:32.455 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:32.450+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:32.616 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:32.611+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:32.690 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:32.686+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:32.958 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:32.953+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:33.074 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:33.069+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:33.427 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:33.423+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:33.454 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:33.450+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:33.623 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:33.619+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:33.708 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:33.704+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:33.976 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:33.971+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:34.126 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:34.121+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:34.405 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:34.399+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:34.426 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:34.420+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:34.636 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:34.633+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:34.760 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:34.756+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:34.955 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:34.951+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:35.169 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:35.163+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:35.370 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:35.366+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:35.450 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:35.446+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:35.636 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:35.631+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:35.742 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:35.738+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:36.000 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:35.995+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:36.172 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:36.167+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:36.339 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:36.334+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:36.476 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:36.471+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:36.654 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:36.651+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:36.775 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:36.771+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:36.966 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:36.962+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:37.189 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:37.184+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:37.313 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:37.309+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:37.497 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:37.493+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:37.678 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:37.674+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:37.786 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:37.782+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:37.938 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:37.933+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:38.197 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:38.191+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:38.361 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:38.356+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:38.541 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:38.536+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:38.635 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:38.631+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:38.785 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:38.782+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:38.900 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:38.895+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:39.172 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:39.166+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:39.392 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:39.388+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:39.537 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:39.533+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:39.627 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:39.623+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:39.768 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:39.764+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:39.899 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:39.893+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:40.210 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:40.202+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:40.406 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:40.402+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:40.577 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:40.573+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:40.637 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:40.633+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:40.761 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:40.752+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:40.944 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:40.939+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:41.172 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:41.167+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:41.443 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:41.439+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:41.569 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:41.564+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:41.635 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:41.631+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:41.718 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:41.715+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:41.951 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:41.946+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:42.151 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:42.146+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:42.417 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:42.413+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:42.583 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:42.577+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:42.660 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:42.655+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:42.705 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:42.702+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:43.003 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:42.997+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:43.189 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:43.182+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:43.468 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:43.463+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:43.591 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:43.585+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:43.661 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:43.658+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:43.701 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:43.697+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:44.024 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:44.020+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:44.195 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:44.189+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:44.484 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:44.480+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:44.615 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:44.609+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:44.685 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:44.682+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:44.729 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:44.726+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:45.014 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:45.008+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:45.210 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:45.204+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:45.467 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:45.463+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:45.645 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:45.642+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:45.659 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:45.653+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:45.693 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:45.689+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:45.993 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:45.987+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:46.216 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:46.211+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:46.501 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:46.496+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:46.682 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:46.677+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:46.695 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:46.691+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:46.695 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:46.691+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:47.023 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:47.017+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:47.209 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:47.203+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:47.504 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:47.500+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:47.673 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:47.669+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:47.708 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:47.704+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:47.724 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:47.719+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:48.031 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:48.025+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:48.189 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:48.183+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:48.551 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:48.547+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:48.659 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:48.654+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:48.726 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:48.720+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:48.750 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:48.746+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:49.070 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:49.064+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:49.179 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:49.173+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:49.567 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:49.562+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:49.706 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:49.702+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:49.722 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:49.718+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:49.747 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:49.742+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:50.081 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:50.076+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:50.152 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:50.146+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:50.544 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:50.541+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:50.698 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:50.695+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:50.740 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:50.735+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:50.789 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:50.775+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:51.112 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:51.106+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:51.174 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:51.167+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:51.536 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:51.530+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:51.720 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:51.716+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:51.765 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:51.761+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:51.820 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:51.813+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:52.129 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:52.122+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:52.140 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:52.134+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:52.583 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:52.580+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:52.759 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:52.755+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:52.780 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:52.776+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:52.872 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:52.865+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:53.103 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:53.097+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:53.178 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:53.172+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:53.246 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:59:53.239+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e582 v582) 2019-12-09T19:59:53.563 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:53.558+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:53.775 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:53.770+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:53.825 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:53.820+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:53.831 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:53.825+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:54.120 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:54.114+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:54.195 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:54.188+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:54.599 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:54.595+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:54.816 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:54.811+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:54.822 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:54.817+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:54.845 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:54.840+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:55.142 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:55.136+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:55.241 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:55.235+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:55.641 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:55.638+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:55.803 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:55.799+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:55.842 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:55.838+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:55.856 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:55.850+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:56.114 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:56.108+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:56.274 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:56.267+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:56.596 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:56.592+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:56.840 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:56.836+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:56.860 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:56.855+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:56.905 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:56.900+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:57.105 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:57.099+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:57.315 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:57.310+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:57.607 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:57.602+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:57.824 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:57.820+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:57.891 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:57.887+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:57.955 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:57.949+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:58.137 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:58.130+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:58.259 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T19:59:58.257+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e582 v582) 2019-12-09T19:59:58.293 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:58.287+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:58.635 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:58.632+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:58.795 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:58.789+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:58.859 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:58.856+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:58.944 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:58.938+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T19:59:59.140 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T19:59:59.134+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T19:59:59.313 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T19:59:59.307+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T19:59:59.598 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T19:59:59.595+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T19:59:59.773 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T19:59:59.770+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T19:59:59.814 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T19:59:59.812+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T19:59:59.997 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T19:59:59.991+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T20:00:00.191 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:00:00.181+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T20:00:00.339 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:00:00.332+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T20:00:00.617 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:00:00.614+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T20:00:00.729 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:00:00.727+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T20:00:00.809 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:00:00.806+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T20:00:00.971 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:00:00.965+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T20:00:01.164 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:00:01.158+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T20:00:01.320 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:00:01.314+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T20:00:01.618 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:00:01.614+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T20:00:01.745 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:00:01.743+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T20:00:01.769 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:00:01.766+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T20:00:02.013 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:00:02.005+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T20:00:02.158 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:00:02.152+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T20:00:02.314 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:00:02.309+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T20:00:02.574 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:00:02.571+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T20:00:02.766 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:00:02.763+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T20:00:02.797 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:00:02.794+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T20:00:02.968 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:00:02.962+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T20:00:03.197 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:00:03.191+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T20:00:03.330 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:00:03.325+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T20:00:03.538 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:00:03.534+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T20:00:03.653 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:00:03.649+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e582 v582) 2019-12-09T20:00:03.698 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:21:01.725 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:00:03.701 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:21:01.729 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:00:03.769 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:00:03.766+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T20:00:03.790 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:21:01.753 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:00:03.803 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:00:03.801+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T20:00:03.811 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:21:01.839 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:00:03.812 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:21:01.774 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:00:03.826 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:21:01.853 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:00:03.852 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:21:01.879 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:00:03.869 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:21:01.832 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:00:03.920 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:21:01.947 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:00:03.931 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:00:03.927+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T20:00:04.159 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:00:04.155+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T20:00:04.331 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:00:04.326+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T20:00:04.571 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:00:04.567+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T20:00:04.746 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:00:04.743+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T20:00:04.799 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:00:04.796+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T20:00:04.897 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:00:04.892+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T20:00:05.180 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:00:05.175+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T20:00:05.366 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:00:05.362+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T20:00:05.587 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:00:05.584+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T20:00:05.717 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:00:05.713+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T20:00:05.813 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:00:05.810+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T20:00:05.876 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:00:05.871+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T20:00:06.221 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:00:06.216+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T20:00:06.377 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:00:06.372+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T20:00:06.552 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:00:06.547+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T20:00:06.723 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:00:06.720+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T20:00:06.838 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:00:06.834+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T20:00:06.867 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:00:06.862+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T20:00:07.217 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:00:07.212+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T20:00:07.394 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:00:07.389+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T20:00:07.509 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:00:07.505+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T20:00:07.718 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:00:07.713+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T20:00:07.855 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:00:07.850+0000 1694f700 -1 osd.7 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.327956+0000 front 2019-12-09T19:58:36.679725+0000 (oldest deadline 2019-12-09T19:59:22.036916+0000) 2019-12-09T20:00:07.874 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:00:07.870+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T20:00:08.200 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:00:08.195+0000 1694f700 -1 osd.4 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:41.362508+0000 front 2019-12-09T19:58:41.363963+0000 (oldest deadline 2019-12-09T19:59:23.677757+0000) 2019-12-09T20:00:08.416 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:00:08.410+0000 1694f700 -1 osd.6 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:44.324131+0000 front 2019-12-09T19:58:43.670116+0000 (oldest deadline 2019-12-09T19:59:26.965193+0000) 2019-12-09T20:00:08.511 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:00:08.507+0000 1694f700 -1 osd.3 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.976810+0000 front 2019-12-09T19:58:42.460048+0000 (oldest deadline 2019-12-09T19:59:22.823310+0000) 2019-12-09T20:00:08.712 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:00:08.709+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e582 v582) 2019-12-09T20:00:08.758 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:00:08.755+0000 1694f700 -1 osd.1 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:43.685987+0000 front 2019-12-09T19:58:42.820346+0000 (oldest deadline 2019-12-09T19:59:27.338771+0000) 2019-12-09T20:00:08.876 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:00:08.872+0000 1694f700 -1 osd.0 582 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T19:58:42.434282+0000 front 2019-12-09T19:58:44.332951+0000 (oldest deadline 2019-12-09T19:59:27.029845+0000) 2019-12-09T20:00:16.502 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:00:16.496+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T20:00:53.229 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:00:53.209+0000 3aa81700 -1 osd.5 587 build_incremental_map_msg missing incremental map 587 2019-12-09T20:00:53.674 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:00:53.447+0000 3a280700 -1 osd.5 587 build_incremental_map_msg missing incremental map 587 2019-12-09T20:00:54.820 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:00:54.708+0000 35276700 -1 osd.5 588 build_incremental_map_msg missing incremental map 587 2019-12-09T20:00:57.478 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:00:57.263+0000 35a77700 -1 osd.5 590 build_incremental_map_msg missing incremental map 587 2019-12-09T20:01:55.691 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:01:55.686+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:01:56.073 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:01:56.067+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:01:56.717 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:01:56.711+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:01:57.038 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:01:57.031+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:01:57.334 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:01:57.331+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:01:57.522 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:01:57.516+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:01:57.638 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:01:57.633+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:01:57.722 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:01:57.717+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:01:58.047 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:01:58.040+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:01:59.194 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:01:58.304+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:01:59.194 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:01:58.639+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:01:59.194 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:01:58.690+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:01:59.195 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:01:58.565+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:01:59.195 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:01:58.768+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:01:59.195 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:01:59.085+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:01:59.277 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:01:59.273+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:01:59.598 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:01:59.592+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:01:59.614 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:01:59.610+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:01:59.727 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:01:59.723+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:01:59.732 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:01:59.726+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:00.077 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:00.072+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:00.240 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:00.236+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:00.631 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:00.626+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:00.645 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:00.639+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:00.718 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:00.714+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:00.747 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:00.743+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:01.097 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:01.088+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:01.221 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:01.216+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:01.590 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:01.586+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:01.642 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:01.637+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:01.709 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:01.705+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:01.717 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:01.712+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:02.129 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:02.125+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:02.246 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:02.242+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:02.606 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:02.602+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:02.620 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:02.615+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:02.712 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:02.708+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:02.715 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:02.711+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:03.098 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:03.093+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:03.246 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:03.243+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:03.646 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:03.641+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:03.646 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:03.642+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:03.714 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:03.710+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:03.727 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:03.722+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:04.098 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:04.093+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:04.271 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:04.266+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:04.615 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:04.610+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:04.661 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:04.657+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:04.687 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:04.683+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:04.722 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:04.717+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:05.101 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:05.096+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:05.269 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:05.266+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:05.620 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:05.614+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:05.659 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:05.654+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:05.716 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:05.712+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:05.772 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:05.767+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:06.117 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:06.112+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:06.231 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:06.227+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:06.616 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:06.611+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:06.656 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:06.651+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:06.726 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:06.721+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:06.743 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:06.738+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:07.110 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:07.105+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:07.250 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:07.245+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:07.627 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:07.623+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:07.649 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:07.644+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:07.694 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:07.689+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:07.761 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:07.756+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:08.072 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:08.067+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:08.281 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:08.277+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:08.611 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:08.605+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:08.649 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:08.644+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:08.694 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:08.686+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:08.738 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:08.733+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:09.070 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:09.065+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:09.262 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:09.259+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:09.631 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:09.627+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:09.671 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:09.667+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:09.676 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:09.671+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:09.779 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:09.773+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:10.050 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:10.046+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:10.255 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:10.251+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:10.590 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:10.586+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:10.634 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:10.630+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:10.716 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:10.712+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:10.822 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:10.818+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:11.072 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:11.066+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:11.246 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:11.242+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:11.608 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:11.604+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:11.629 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:11.625+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:11.681 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:11.675+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:11.783 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:11.774+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:12.033 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:12.029+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:12.212 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:12.207+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:12.584 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:12.579+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:12.628 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:12.623+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:12.722 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:12.716+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:12.797 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:12.792+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:13.000 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:12.995+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:13.230 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:13.226+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:13.552 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:13.547+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:13.597 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:13.593+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:13.772 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:13.768+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:13.819 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:13.814+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:14.045 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:14.041+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:14.208 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:14.204+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:14.585 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:14.580+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:14.649 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:14.645+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:14.783 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:14.777+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:14.803 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:14.799+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:15.006 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:15.000+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:15.251 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:15.247+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:15.568 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:15.564+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:15.655 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:15.651+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:15.808 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:15.804+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:15.826 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:15.820+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:16.010 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:16.004+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:16.233 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:16.229+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:16.575 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:16.571+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:16.671 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:16.667+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:16.803 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:16.793+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:16.853 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:16.839+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:16.977 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:16.972+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:17.246 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:17.242+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:17.586 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:17.582+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:17.724 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:17.720+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:17.797 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:17.790+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:17.803 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:17.794+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:17.982 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:17.976+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:18.249 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:18.245+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:18.621 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:18.617+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:18.764 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:18.761+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:18.797 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:18.788+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:18.818 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:18.812+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:19.000 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:18.994+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:19.303 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:19.297+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:19.633 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:19.629+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:19.772 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:19.765+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:19.814 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:19.810+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:19.841 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:19.835+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:19.966 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:19.960+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:20.277 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:20.256+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:20.675 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:20.671+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:20.742 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:20.737+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:20.805 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:20.800+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:20.832 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:20.828+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:21.017 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:21.012+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:21.240 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:21.235+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:21.718 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:21.714+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:21.721 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:21.715+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:21.796 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:21.791+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:21.823 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:21.817+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:21.982 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:21.976+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:22.223 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:22.218+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:22.678 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:22.673+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:22.689 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:22.685+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:22.816 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:22.810+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:22.817 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:22.813+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:23.010 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:23.003+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:23.184 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:23.179+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:23.709 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:23.705+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:23.729 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:23.721+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:23.779 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:23.773+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:23.853 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:23.849+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:24.014 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:24.008+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:24.222 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:24.218+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:24.681 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:24.677+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:24.685 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:24.679+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:24.776 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:24.771+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:24.879 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:24.875+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:24.980 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:24.974+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:25.180 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:25.176+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:25.683 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:25.679+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:25.727 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:25.722+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:25.742 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:25.736+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:25.903 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:25.899+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:25.987 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:25.981+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:26.212 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:26.210+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:26.686 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:26.683+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:26.719 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:26.713+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:26.723 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:26.718+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:26.895 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:26.892+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:26.994 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:26.988+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:27.212 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:27.209+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:27.683 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:27.679+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:27.689 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:27.683+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:27.738 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:27.733+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:27.915 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:27.912+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:28.025 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:28.020+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:28.234 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:28.231+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:28.688 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:28.682+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:28.701 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:28.696+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:28.707 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:28.704+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:28.965 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:28.962+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:29.073 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:29.067+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:29.193 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:02:29.191+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 41sec e593 v593) 2019-12-09T20:02:29.252 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:29.249+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:29.692 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:29.685+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:29.744 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:29.740+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:29.752 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:29.746+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:30.002 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:29.999+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:30.123 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:30.118+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:30.297 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:30.293+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:30.711 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:30.705+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:30.737 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:30.733+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:30.744 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:30.737+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:31.018 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:31.015+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:31.105 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:31.099+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:31.323 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:31.319+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:31.694 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:31.692+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:31.703 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:31.696+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:31.727 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:31.721+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:32.022 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:32.018+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:32.113 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:32.106+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:32.304 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:32.302+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:32.711 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:32.705+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:32.744 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:32.739+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:32.747 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:32.745+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:33.036 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:33.030+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:33.138 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:33.132+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:33.304 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:33.301+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:33.671 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:33.665+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:33.704 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:33.700+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:33.728 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:33.722+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:34.076 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:34.072+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:34.170 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:34.164+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:34.214 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:02:34.211+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 41sec e593 v593) 2019-12-09T20:02:34.268 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:34.264+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:34.707 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:34.701+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:34.707 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:34.701+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:34.752 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:34.748+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:35.068 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:35.064+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:35.149 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:35.143+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:35.229 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:35.225+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:35.746 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:35.740+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:35.748 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:35.742+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:35.754 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:35.750+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:36.032 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:36.028+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:36.192 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:36.188+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:36.197 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:36.191+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:36.774 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:36.769+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:36.796 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:36.792+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:36.797 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:36.792+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:37.082 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:37.079+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:37.195 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:37.189+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:37.233 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:37.230+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:37.814 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:37.809+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:37.824 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:37.820+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:37.838 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:37.833+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:38.104 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:38.100+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:38.154 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:38.150+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:38.257 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:38.253+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:38.808 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:02:38.805+0000 1694f700 -1 osd.0 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.694801+0000 front 2019-12-09T20:01:14.153736+0000 (oldest deadline 2019-12-09T20:01:57.112902+0000) 2019-12-09T20:02:38.816 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:02:38.811+0000 1694f700 -1 osd.4 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:13.679315+0000 front 2019-12-09T20:01:13.489511+0000 (oldest deadline 2019-12-09T20:01:56.791845+0000) 2019-12-09T20:02:38.841 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:02:38.836+0000 1694f700 -1 osd.6 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.620650+0000 front 2019-12-09T20:01:15.744584+0000 (oldest deadline 2019-12-09T20:01:58.429420+0000) 2019-12-09T20:02:39.059 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:02:39.055+0000 1694f700 -1 osd.1 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:16.804829+0000 front 2019-12-09T20:01:15.277355+0000 (oldest deadline 2019-12-09T20:01:55.246668+0000) 2019-12-09T20:02:39.135 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:02:39.130+0000 1694f700 -1 osd.7 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:15.382918+0000 front 2019-12-09T20:01:14.460048+0000 (oldest deadline 2019-12-09T20:01:55.360640+0000) 2019-12-09T20:02:39.254 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:02:39.250+0000 1694f700 -1 osd.3 593 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:01:12.463760+0000 front 2019-12-09T20:01:16.684195+0000 (oldest deadline 2019-12-09T20:01:57.158493+0000) 2019-12-09T20:02:39.293 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:02:39.289+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 41sec e593 v593) 2019-12-09T20:02:46.712 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:02:46.706+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T20:03:21.078 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:24:19.106 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:03:21.087 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:24:19.115 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:03:21.095 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:24:19.059 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:03:21.096 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:24:19.123 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:03:21.100 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:24:19.127 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:03:21.100 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:24:19.063 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:03:21.347 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:24:19.310 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:03:21.439 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:24:19.466 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:03:21.447 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:24:19.474 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:04:27.430 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:27.424+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:27.621 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:27.614+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:28.040 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:28.036+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:28.139 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:28.134+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:28.459 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:28.454+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:28.632 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:28.627+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:29.062 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:29.058+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:29.102 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:29.099+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:29.475 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:29.470+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:29.601 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:29.595+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:30.103 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:30.099+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:30.109 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:30.105+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:30.215 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:30.209+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:30.444 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:30.440+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:30.478 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:30.472+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:30.590 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:30.583+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:31.080 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:31.077+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:31.112 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:31.109+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:31.218 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:31.212+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:31.424 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:31.420+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:31.497 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:31.491+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:31.570 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:31.564+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:32.052 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:32.049+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:32.085 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:32.081+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:32.187 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:32.181+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:32.443 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:32.439+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:32.536 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:32.530+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:32.611 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:32.605+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:33.052 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:33.047+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:33.101 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:33.097+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:33.163 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:33.155+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:33.423 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:33.419+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:33.510 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:33.505+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:33.630 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:33.624+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:34.095 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:34.092+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:34.120 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:34.116+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:34.138 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:34.132+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:34.389 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:34.383+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:34.530 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:34.524+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:34.664 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:34.658+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:35.117 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:35.111+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:35.123 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:35.119+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:35.158 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:35.149+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:35.345 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:35.341+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:35.495 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:35.491+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:35.675 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:35.671+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:36.112 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:36.106+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:36.177 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:36.173+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:36.197 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:36.192+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:36.393 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:36.388+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:36.519 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:36.513+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:36.673 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:36.667+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:37.096 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:37.092+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:37.210 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:37.206+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:37.221 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:37.216+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:37.439 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:37.435+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:37.533 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:37.528+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:37.652 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:37.647+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:38.089 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:38.084+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:38.202 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:38.196+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:38.220 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:38.216+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:38.480 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:38.476+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:38.494 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:38.489+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:38.608 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:38.603+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:39.137 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:39.133+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:39.160 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:39.154+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:39.246 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:39.243+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:39.438 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:39.434+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:39.455 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:39.450+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:39.663 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:39.657+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:40.122 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:40.117+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:40.125 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:40.122+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:40.265 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:40.261+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:40.413 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:40.408+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:40.438 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:40.433+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:40.658 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:40.652+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:41.153 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:41.148+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:41.167 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:41.163+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:41.280 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:41.276+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:41.439 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:41.434+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:41.456 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:41.452+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:41.678 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:41.673+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:42.139 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:42.135+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:42.155 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:42.149+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:42.287 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:42.283+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:42.421 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:42.416+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:42.423 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:42.418+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:42.727 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:42.722+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:43.179 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:43.175+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:43.202 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:43.196+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:43.306 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:43.301+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:43.428 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:43.424+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:43.443 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:43.439+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:43.763 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:43.758+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:44.209 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:44.205+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:44.234 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:44.228+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:44.280 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:44.275+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:44.424 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:44.419+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:44.442 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:44.437+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:44.731 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:44.726+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:45.203 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:45.198+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:45.237 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:45.233+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:45.256 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:45.247+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:45.449 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:45.446+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:45.474 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:45.469+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:45.757 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:45.746+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:46.210 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:46.205+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:46.219 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:46.214+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:46.228 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:46.223+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:46.476 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:46.466+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:46.517 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:46.510+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:46.800 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:46.795+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:47.184 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:47.179+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:47.198 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:47.192+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:47.234 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:47.230+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:47.430 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:47.426+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:47.513 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:47.507+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:47.829 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:47.823+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:48.184 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:48.178+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:48.209 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:48.204+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:48.210 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:48.206+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:48.388 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:48.382+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:48.500 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:48.495+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:48.868 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:48.864+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:49.158 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:49.154+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:49.171 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:49.166+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:49.179 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:49.175+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:49.419 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:49.415+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:49.463 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:49.458+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:49.857 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:49.852+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:50.125 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:50.121+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:50.145 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:50.140+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:50.184 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:50.181+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:50.425 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:50.421+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:50.428 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:50.424+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:50.898 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:50.893+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:51.102 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:51.095+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:51.161 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:51.157+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:51.236 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:51.233+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:51.418 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:51.412+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:51.420 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:51.415+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:51.926 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:51.919+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:52.154 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:52.150+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:52.155 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:52.149+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:52.202 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:52.197+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:52.459 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:52.454+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:52.478 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:52.471+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:52.967 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:52.962+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:53.128 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:53.124+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:53.155 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:53.152+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:53.205 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:53.199+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:53.458 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:53.454+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:53.463 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:53.457+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:53.929 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:53.923+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:54.111 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:54.106+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:54.112 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:54.107+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:54.169 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:54.164+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:54.444 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:54.438+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:54.512 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:54.508+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:54.968 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:54.962+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:55.142 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:55.139+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:55.156 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:55.152+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:55.209 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:55.203+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:55.431 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:55.424+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:55.479 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:55.475+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:55.951 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:55.945+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:56.143 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:56.141+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:56.154 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:56.151+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:56.234 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:56.227+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:56.431 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:56.425+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:56.521 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:56.518+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:57.004 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:56.998+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:57.151 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:57.148+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:57.173 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:57.169+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:57.270 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:57.263+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:57.438 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:57.431+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:57.551 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:57.547+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:58.033 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:58.027+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:58.144 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:58.140+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:58.179 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:58.173+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:58.290 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:58.284+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:58.486 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:58.480+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:58.572 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:58.567+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:04:59.079 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:04:59.073+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:04:59.116 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:04:59.112+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:04:59.146 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:04:59.143+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:04:59.339 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:04:59.334+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:04:59.513 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:04:59.506+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:04:59.622 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:04:59.620+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:05:00.000 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:04:59.995+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 49sec e603 v603) 2019-12-09T20:05:00.106 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:05:00.103+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:05:00.109 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:05:00.107+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:05:00.116 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:05:00.110+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:05:00.356 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:05:00.350+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:05:00.490 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:05:00.483+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:05:00.577 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:05:00.574+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:05:01.082 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:05:01.079+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:05:01.098 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:05:01.095+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:05:01.146 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:05:01.140+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:05:01.361 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:05:01.355+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:05:01.540 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:05:01.535+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:05:01.599 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:05:01.596+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:05:02.085 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:05:02.081+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:05:02.092 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:05:02.088+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:05:02.103 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:05:02.097+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:05:02.351 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:05:02.344+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:05:02.538 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:05:02.530+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:05:02.632 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:05:02.627+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:05:03.063 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:05:03.060+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:05:03.080 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:05:03.076+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:05:03.130 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:05:03.120+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:05:03.375 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:05:03.367+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:05:03.549 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:05:03.544+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:05:03.632 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:05:03.627+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:05:04.083 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:05:04.078+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:05:04.097 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:05:04.092+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:05:04.115 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:05:04.110+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:05:04.360 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:05:04.353+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:05:04.527 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:05:04.517+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:05:04.620 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:05:04.616+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:05:05.008 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:05:05.006+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 49sec e603 v603) 2019-12-09T20:05:05.116 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:05:05.111+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:05:05.120 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:05:05.117+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:05:05.129 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:05:05.126+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:05:05.378 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:05:05.371+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:05:05.525 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:05:05.520+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:05:05.617 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:05:05.613+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:05:06.108 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:05:06.104+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:05:06.141 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:05:06.136+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:05:06.165 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:05:06.161+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:05:06.362 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:05:06.356+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:05:06.527 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:05:06.521+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:05:06.644 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:05:06.640+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:05:07.157 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:05:07.153+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:05:07.181 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:05:07.175+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:05:07.183 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:05:07.180+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:05:07.343 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:05:07.336+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:05:07.566 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:05:07.561+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:05:07.620 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:05:07.616+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:05:08.157 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:05:08.151+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:05:08.192 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:05:08.189+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:05:08.201 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:05:08.198+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:05:08.374 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:05:08.368+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:05:08.552 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:05:08.545+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:05:08.657 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:05:08.652+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:05:09.145 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:05:09.139+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:05:09.198 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:05:09.194+0000 1694f700 -1 osd.0 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.500086+0000 front 2019-12-09T20:03:44.502248+0000 (oldest deadline 2019-12-09T20:04:27.841158+0000) 2019-12-09T20:05:09.218 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:05:09.214+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:05:09.420 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:05:09.414+0000 1694f700 -1 osd.4 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:46.786186+0000 front 2019-12-09T20:03:46.716651+0000 (oldest deadline 2019-12-09T20:04:30.143136+0000) 2019-12-09T20:05:09.510 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:05:09.504+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:05:09.615 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:05:09.610+0000 1694f700 -1 osd.3 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.566149+0000 front 2019-12-09T20:03:44.587574+0000 (oldest deadline 2019-12-09T20:04:29.710069+0000) 2019-12-09T20:05:10.098 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:05:10.083+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 49sec e603 v603) 2019-12-09T20:05:10.165 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:05:10.159+0000 1694f700 -1 osd.6 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:44.080711+0000 front 2019-12-09T20:03:44.081570+0000 (oldest deadline 2019-12-09T20:04:27.353743+0000) 2019-12-09T20:05:10.223 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:05:10.220+0000 1694f700 -1 osd.1 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:39.445464+0000 front 2019-12-09T20:03:44.528486+0000 (oldest deadline 2019-12-09T20:04:27.290008+0000) 2019-12-09T20:05:10.547 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:05:10.541+0000 1694f700 -1 osd.7 603 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:03:43.211406+0000 front 2019-12-09T20:03:42.756286+0000 (oldest deadline 2019-12-09T20:04:26.796293+0000) 2019-12-09T20:05:16.945 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:05:16.936+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T20:05:57.139 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:05:57.116+0000 38a7d700 -1 osd.5 608 build_incremental_map_msg missing incremental map 608 2019-12-09T20:05:57.359 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:05:57.175+0000 37a7b700 -1 osd.5 608 build_incremental_map_msg missing incremental map 608 2019-12-09T20:05:57.406 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:05:57.221+0000 3727a700 -1 osd.5 608 build_incremental_map_msg missing incremental map 608 2019-12-09T20:05:57.449 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:05:57.284+0000 38a7d700 -1 osd.5 608 build_incremental_map_msg missing incremental map 608 2019-12-09T20:06:00.175 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:06:00.150+0000 35a77700 -1 osd.5 609 build_incremental_map_msg missing incremental map 608 2019-12-09T20:06:00.219 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:06:00.158+0000 39a7f700 -1 osd.5 610 build_incremental_map_msg missing incremental map 608 2019-12-09T20:06:02.710 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:06:02.694+0000 39a7f700 -1 osd.5 612 build_incremental_map_msg missing incremental map 587 2019-12-09T20:06:02.860 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:06:02.851+0000 39a7f700 -1 osd.5 612 build_incremental_map_msg missing incremental map 608 2019-12-09T20:06:56.788 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:06:56.781+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:06:56.927 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:06:56.918+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:06:57.770 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:06:57.763+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:06:57.922 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:06:57.916+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:06:58.173 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:06:58.169+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:06:58.587 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:06:58.578+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:06:58.758 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:06:58.748+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:06:58.883 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:06:58.877+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:06:59.191 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:06:59.187+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:06:59.307 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:06:59.303+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:06:59.623 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:06:59.618+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:06:59.757 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:06:59.752+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:06:59.883 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:06:59.877+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:06:59.906 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:06:59.900+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:00.222 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:00.218+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:00.321 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:00.315+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:00.652 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:00.646+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:00.733 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:00.728+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:00.889 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:00.883+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:00.909 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:00.903+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:01.232 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:01.228+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:01.298 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:01.294+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:01.655 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:01.651+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:01.719 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:01.713+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:01.883 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:01.878+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:01.901 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:01.894+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:02.235 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:02.230+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:02.296 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:02.290+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:02.694 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:02.689+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:02.770 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:02.764+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:02.895 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:02.890+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:02.909 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:02.904+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:03.274 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:03.263+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:03.274 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:03.265+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:03.714 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:03.709+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:03.758 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:03.752+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:03.888 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:03.881+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:03.955 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:03.948+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:04.239 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:04.234+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:04.265 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:04.261+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:04.745 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:04.739+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:04.764 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:04.759+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:04.847 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:04.842+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:04.962 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:04.952+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:05.218 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:05.213+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:05.254 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:05.250+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:05.797 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:05.787+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:05.802 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:05.797+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:05.883 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:05.876+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:05.922 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:05.916+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:06.173 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:06.168+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:06.277 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:06.273+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:06.771 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:06.764+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:06.845 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:06.841+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:06.885 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:06.875+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:06.917 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:06.912+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:07.140 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:07.136+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:07.300 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:07.296+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:07.796 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:07.789+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:07.846 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:07.841+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:07.899 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:07.892+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:07.914 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:07.908+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:08.174 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:08.169+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:08.320 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:08.316+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:08.844 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:08.834+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:08.895 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:08.891+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:08.904 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:08.898+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:08.953 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:08.948+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:09.163 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:09.160+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:09.284 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:09.280+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:09.894 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:09.888+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:09.913 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:09.907+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:09.944 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:09.940+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:09.965 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:09.960+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:10.170 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:10.166+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:10.257 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:10.253+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:10.880 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:10.875+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:10.919 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:10.915+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:10.956 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:10.951+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:10.977 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:10.972+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:11.187 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:11.182+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:11.239 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:11.235+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:11.890 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:11.862+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:11.918 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:11.913+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:11.936 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:11.932+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:11.998 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:11.993+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:12.193 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:12.189+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:12.202 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:12.197+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:12.920 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:12.915+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:12.922 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:12.916+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:12.963 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:12.958+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:12.964 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:12.960+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:13.196 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:13.193+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:13.229 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:13.225+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:13.903 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:13.898+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:13.903 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:13.897+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:13.940 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:13.934+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:14.001 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:13.996+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:14.202 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:14.199+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:14.235 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:14.231+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:14.871 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:14.867+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:14.920 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:14.915+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:14.971 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:14.966+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:15.023 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:15.019+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:15.230 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:15.225+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:15.232 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:15.229+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:15.831 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:15.827+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:15.898 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:15.893+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:15.929 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:15.924+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:16.010 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:16.004+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:16.190 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:16.185+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:16.196 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:16.192+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:16.867 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:16.863+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:16.901 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:16.895+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:16.984 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:16.980+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:17.021 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:17.017+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:17.190 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:17.185+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:17.202 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:17.198+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:17.866 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:17.861+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:17.953 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:17.948+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:18.026 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:18.020+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:18.030 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:18.025+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:18.162 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:18.157+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:18.171 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:18.168+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:18.883 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:18.879+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:18.969 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:18.963+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:19.033 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:19.028+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:19.091 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:19.087+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:19.123 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:19.119+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:19.165 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:19.160+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:19.855 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:19.851+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:19.943 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:19.937+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:19.998 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:19.992+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:20.073 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:20.069+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:20.153 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:20.149+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:20.187 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:20.183+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:20.823 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:20.820+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:20.990 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:20.984+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:21.030 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:21.024+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:21.125 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:21.118+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:21.205 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:21.201+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:21.218 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:21.213+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:21.837 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:21.833+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:21.992 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:21.986+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:22.025 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:22.019+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:22.123 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:22.118+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:22.223 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:22.219+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:22.234 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:22.230+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:22.810 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:22.806+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:23.031 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:23.026+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:23.059 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:23.053+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:23.158 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:23.152+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:23.215 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:23.211+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:23.224 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:23.221+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:23.778 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:23.775+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:24.023 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:24.018+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:24.060 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:24.055+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:24.172 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:24.168+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:24.192 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:24.186+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:24.258 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:24.254+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:24.743 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:24.740+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:24.997 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:24.993+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:25.089 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:25.084+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:25.170 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:25.167+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:25.213 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:25.209+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:25.247 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:25.241+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:25.740 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:25.738+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:25.770 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:28:23.798 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:25.776 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:28:23.804 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:25.786 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:28:23.813 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:25.789 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:28:23.816 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:25.793 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:28:23.757 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:25.804 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:28:23.767 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:25.978 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:25.971+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:26.023 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:28:24.050 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:26.053 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:28:24.074 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:26.102 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:28:24.065 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:26.132 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:26.127+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:26.221 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:26.217+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:26.221 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:26.218+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:26.243 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:26.238+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:26.765 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:26.762+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:26.963 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:26.959+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:27.181 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:27.176+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:27.194 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:27.190+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:27.250 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:27.246+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:27.272 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:27.269+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:27.735 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:27.732+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:27.959 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:27.950+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:28.136 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:28.131+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:28.154 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:28.149+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:28.225 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:28.220+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:28.302 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:28.298+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:28.726 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:28.723+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:28.926 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:28.920+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:29.139 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:29.133+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:29.149 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:29.142+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:29.211 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:29.208+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:29.322 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:29.319+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:29.696 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:29.692+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:29.928 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:29.922+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:30.129 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:30.124+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:30.182 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:30.176+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:30.188 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:30.185+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:30.306 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:30.303+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:30.721 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:30.716+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:30.779 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:07:30.773+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 41sec e613 v613) 2019-12-09T20:07:30.875 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:28:28.902 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:30.891 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:30.884+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:30.914 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:28:28.941 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:30.914 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:28:28.942 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:30.939 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:28:28.966 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:30.949 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:28:28.977 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:30.957 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:28:28.920 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:30.957 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:28:28.984 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:30.969 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:28:28.927 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:30.990 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:28:28.953 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:07:31.168 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:31.162+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:31.180 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:31.174+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:31.213 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:31.209+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:31.272 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:31.269+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:31.681 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:31.676+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:31.913 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:31.907+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:32.168 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:32.162+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:32.209 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:32.204+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:32.242 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:32.237+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:32.288 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:32.283+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:32.636 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:32.631+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:32.881 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:32.872+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:33.187 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:33.181+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:33.223 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:33.219+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:33.230 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:33.224+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:33.276 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:33.271+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:33.626 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:33.622+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:33.863 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:33.857+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:34.172 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:34.166+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:34.206 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:34.202+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:34.217 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:34.211+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:34.269 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:34.265+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:34.680 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:34.675+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:34.869 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:34.863+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:35.163 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:35.157+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:35.193 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:35.187+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:35.228 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:35.221+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:35.245 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:35.241+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:35.690 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:35.685+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:35.797 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:07:35.790+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 41sec e613 v613) 2019-12-09T20:07:35.881 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:35.875+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:36.195 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:36.188+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:36.206 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:36.199+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:36.211 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:36.205+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:36.256 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:36.251+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:36.732 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:36.727+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:36.869 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:36.862+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:37.187 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:37.180+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:37.192 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:37.186+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:37.238 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:37.233+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:37.243 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:37.239+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:37.746 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:37.741+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:37.854 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:37.847+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:38.144 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:38.136+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:38.162 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:38.156+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:38.266 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:38.261+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:38.271 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:38.267+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:38.705 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:38.699+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:38.899 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:38.894+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:39.134 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:39.128+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:39.213 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:39.208+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:39.247 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:39.243+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:39.267 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:39.263+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:39.708 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:39.703+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:39.951 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:07:39.945+0000 1694f700 -1 osd.4 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.918247+0000 front 2019-12-09T20:06:16.662921+0000 (oldest deadline 2019-12-09T20:06:56.727250+0000) 2019-12-09T20:07:40.185 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:07:40.178+0000 1694f700 -1 osd.6 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.733933+0000 front 2019-12-09T20:06:14.901444+0000 (oldest deadline 2019-12-09T20:06:56.562615+0000) 2019-12-09T20:07:40.249 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:07:40.244+0000 1694f700 -1 osd.7 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:14.608568+0000 front 2019-12-09T20:06:14.190247+0000 (oldest deadline 2019-12-09T20:06:59.118739+0000) 2019-12-09T20:07:40.282 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:07:40.277+0000 1694f700 -1 osd.1 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.054685+0000 front 2019-12-09T20:06:16.368420+0000 (oldest deadline 2019-12-09T20:06:59.003635+0000) 2019-12-09T20:07:40.311 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:07:40.307+0000 1694f700 -1 osd.0 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:16.676587+0000 front 2019-12-09T20:06:14.694696+0000 (oldest deadline 2019-12-09T20:06:57.802053+0000) 2019-12-09T20:07:40.722 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:07:40.717+0000 1694f700 -1 osd.3 613 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:06:12.049694+0000 front 2019-12-09T20:06:13.413451+0000 (oldest deadline 2019-12-09T20:06:57.593854+0000) 2019-12-09T20:07:40.871 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:07:40.867+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 41sec e613 v613) 2019-12-09T20:07:46.997 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:07:46.989+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T20:08:28.498 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:08:28.435+0000 3aa81700 -1 osd.5 618 build_incremental_map_msg missing incremental map 618 2019-12-09T20:08:28.746 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:08:28.684+0000 38a7d700 -1 osd.5 618 build_incremental_map_msg missing incremental map 618 2019-12-09T20:08:29.607 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:08:29.545+0000 35a77700 -1 osd.5 618 build_incremental_map_msg missing incremental map 618 2019-12-09T20:08:29.609 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:08:29.547+0000 35a77700 -1 osd.5 618 build_incremental_map_msg missing incremental map 618 2019-12-09T20:09:30.406 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:30.400+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:31.377 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:31.371+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:32.332 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:32.326+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:32.365 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:32.358+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:33.353 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:33.344+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:33.413 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:33.407+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:34.147 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:34.142+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:34.235 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:34.225+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:34.258 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:34.254+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:34.368 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:34.364+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:34.443 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:34.437+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:35.201 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:35.192+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:35.219 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:35.215+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:35.271 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:35.265+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:35.326 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:35.321+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:35.431 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:35.426+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:35.559 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:35.555+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:36.173 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:36.167+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:36.272 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:36.265+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:36.292 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:36.286+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:36.376 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:36.373+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:36.423 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:36.416+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:36.524 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:36.520+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:37.133 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:37.127+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:37.268 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:37.263+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:37.299 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:37.291+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:37.388 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:37.383+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:37.408 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:37.402+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:37.579 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:37.575+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:38.116 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:38.110+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:38.268 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:38.263+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:38.318 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:38.314+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:38.417 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:38.411+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:38.422 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:38.417+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:38.600 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:38.596+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:39.097 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:39.090+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:39.278 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:39.272+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:39.319 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:39.314+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:39.448 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:39.441+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:39.449 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:39.445+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:39.632 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:39.628+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:40.096 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:40.090+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:40.279 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:40.273+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:40.281 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:40.277+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:40.404 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:40.399+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:40.501 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:40.494+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:40.651 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:40.647+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:41.096 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:41.091+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:41.307 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:41.302+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:41.313 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:41.307+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:41.452 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:41.448+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:41.543 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:41.538+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:41.693 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:41.689+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:42.140 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:42.133+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:42.313 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:42.305+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:42.352 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:42.349+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:42.468 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:42.463+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:42.534 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:42.527+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:42.654 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:42.649+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:43.111 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:43.106+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:43.358 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:43.351+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:43.397 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:43.392+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:43.494 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:43.489+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:43.584 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:43.578+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:43.683 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:43.679+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:44.129 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:44.122+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:44.312 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:44.306+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:44.377 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:44.372+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:44.482 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:44.477+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:44.595 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:44.589+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:44.644 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:44.641+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:45.155 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:45.149+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:45.337 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:45.330+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:45.344 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:45.339+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:45.516 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:45.511+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:45.628 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:45.621+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:45.633 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:45.629+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:46.194 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:46.188+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:46.319 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:46.315+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:46.359 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:46.352+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:46.525 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:46.520+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:46.582 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:46.577+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:46.618 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:46.610+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:47.172 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:47.167+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:47.308 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:47.304+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:47.376 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:47.369+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:47.485 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:47.481+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:47.582 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:47.578+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:47.583 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:47.579+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:48.173 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:48.168+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:48.315 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:48.310+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:48.414 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:48.407+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:48.506 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:48.502+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:48.599 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:48.595+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:48.607 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:48.595+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:49.222 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:49.217+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:49.359 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:49.356+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:49.416 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:49.401+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:49.540 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:49.536+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:49.577 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:49.572+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:49.579 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:49.575+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:50.258 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:50.253+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:50.391 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:50.388+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:50.441 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:50.433+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:50.530 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:50.527+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:50.599 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:50.595+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:50.604 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:50.601+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:51.264 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:51.258+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:51.348 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:51.345+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:51.414 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:51.408+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:51.542 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:51.539+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:51.592 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:51.588+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:51.618 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:51.609+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:52.252 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:52.241+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:52.365 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:52.363+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:52.436 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:52.431+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:52.555 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:52.552+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:52.570 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:52.567+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:52.658 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:52.650+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:53.227 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:53.221+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:53.334 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:53.330+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:53.483 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:53.478+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:53.568 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:53.565+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:53.607 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:53.604+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:53.641 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:53.636+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:54.261 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:54.256+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:54.372 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:54.368+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:54.479 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:54.474+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:54.568 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:54.564+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:54.616 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:54.612+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:54.630 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:54.624+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:55.273 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:55.267+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:55.395 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:55.392+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:55.488 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:55.477+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:55.591 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:55.587+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:55.621 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:55.617+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:55.653 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:55.643+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:56.286 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:56.281+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:56.415 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:56.411+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:56.446 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:56.437+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:56.595 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:56.583+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:56.649 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:56.646+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:56.692 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:56.674+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:57.314 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:57.309+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:57.426 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:57.423+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:57.492 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:57.488+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:57.599 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:57.595+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:57.614 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:57.610+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:57.707 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:57.701+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:58.364 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:58.359+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:58.419 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:58.415+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:58.460 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:58.454+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:58.578 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:58.573+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:58.628 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:58.623+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:58.709 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:58.704+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:09:59.359 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:09:59.349+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:09:59.446 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:09:59.442+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:09:59.476 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:09:59.470+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:09:59.541 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:09:59.538+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:09:59.625 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:09:59.621+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:09:59.721 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:09:59.715+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:00.364 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:00.359+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:00.447 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:00.442+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:00.470 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:00.465+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:00.522 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:10:00.519+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:10:00.640 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:10:00.635+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:10:00.729 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:00.724+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:01.376 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:01.371+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:01.428 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:01.423+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:01.444 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:01.440+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:01.483 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:10:01.480+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:10:01.677 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:10:01.672+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:10:01.758 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:01.752+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:02.365 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:02.360+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:02.456 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:10:02.452+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:10:02.460 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:02.456+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:02.477 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:02.472+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:02.645 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:10:02.641+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:10:02.787 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:02.782+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:03.379 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:03.372+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:03.433 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:10:03.425+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:10:03.448 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:03.444+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:03.534 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:03.527+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:03.607 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:10:03.603+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:10:03.783 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:03.776+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:04.379 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:04.372+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:04.417 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:10:04.412+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:10:04.449 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:04.444+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:04.557 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:04.552+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:04.589 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:10:04.585+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:10:04.757 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:04.752+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:05.343 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:05.332+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:05.403 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:10:05.398+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:10:05.438 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:05.434+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:05.586 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:05.580+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:05.641 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:10:05.637+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:10:05.805 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:05.799+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:06.370 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:10:06.365+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:10:06.373 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:06.367+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:06.402 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:10:06.398+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 42sec e621 v621) 2019-12-09T20:10:06.403 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:06.398+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:06.563 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:06.557+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:06.654 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:10:06.649+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:10:06.826 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:06.820+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:07.368 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:10:07.364+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:10:07.370 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:07.364+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:07.371 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:07.366+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:07.548 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:07.542+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:07.696 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:10:07.690+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:10:07.855 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:07.848+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:08.341 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:08.336+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:08.407 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:10:08.400+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:10:08.416 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:08.409+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:08.567 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:08.554+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:08.699 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:10:08.694+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:10:08.827 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:08.821+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:09.347 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:09.340+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:09.371 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:10:09.367+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:10:09.392 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:09.385+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:09.523 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:09.517+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:09.675 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:10:09.670+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:10:09.786 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:09.779+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:10.374 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:10.370+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:10.402 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:10:10.398+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:10:10.428 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:10.422+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:10.487 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:10.480+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:10.707 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:10:10.699+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:10:10.837 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:10.832+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:11.345 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:11.338+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:11.396 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:11.389+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:11.401 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:10:11.397+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:10:11.419 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:10:11.415+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 42sec e621 v621) 2019-12-09T20:10:11.463 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:11.457+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:11.736 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:10:11.732+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:10:11.849 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:11.843+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:12.386 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:12.381+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:12.418 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:10:12.414+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:10:12.444 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:12.438+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:12.508 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:12.501+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:12.716 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:10:12.712+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:10:12.871 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:12.865+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:13.400 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:13.393+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:13.428 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:13.423+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:13.443 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:10:13.439+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:10:13.470 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:13.464+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:13.755 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:10:13.750+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:10:13.902 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:13.896+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:14.416 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:14.413+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:14.429 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:14.423+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:14.498 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:10:14.493+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:10:14.522 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:14.515+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:14.719 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:10:14.714+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:10:14.882 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:14.877+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:15.389 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:15.383+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:15.431 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:15.427+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:15.533 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:15.527+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:15.545 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:10:15.541+0000 1694f700 -1 osd.3 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.429352+0000 front 2019-12-09T20:08:49.826153+0000 (oldest deadline 2019-12-09T20:09:35.077782+0000) 2019-12-09T20:10:15.684 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:10:15.679+0000 1694f700 -1 osd.1 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:49.828030+0000 front 2019-12-09T20:08:49.828933+0000 (oldest deadline 2019-12-09T20:09:30.109733+0000) 2019-12-09T20:10:15.855 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:15.848+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:16.400 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:10:16.394+0000 1694f700 -1 osd.6 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.218889+0000 front 2019-12-09T20:08:48.279406+0000 (oldest deadline 2019-12-09T20:09:34.042246+0000) 2019-12-09T20:10:16.408 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:10:16.404+0000 1694f700 -1 osd.0 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.650959+0000 front 2019-12-09T20:08:48.642984+0000 (oldest deadline 2019-12-09T20:09:33.620477+0000) 2019-12-09T20:10:16.501 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:10:16.496+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 42sec e621 v621) 2019-12-09T20:10:16.572 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:10:16.563+0000 1694f700 -1 osd.4 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:48.755319+0000 front 2019-12-09T20:08:48.756798+0000 (oldest deadline 2019-12-09T20:09:33.771232+0000) 2019-12-09T20:10:16.814 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:10:16.809+0000 1694f700 -1 osd.7 621 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:08:47.586565+0000 front 2019-12-09T20:08:51.332326+0000 (oldest deadline 2019-12-09T20:09:32.059213+0000) 2019-12-09T20:10:20.961 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:10:20.953+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T20:10:58.273 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:10:58.265+0000 35a77700 -1 osd.5 621 build_incremental_map_msg missing incremental map 618 2019-12-09T20:11:03.097 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:11:03.091+0000 33a73700 -1 osd.5 626 build_incremental_map_msg missing incremental map 626 2019-12-09T20:11:03.377 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:11:03.334+0000 34274700 -1 osd.5 626 build_incremental_map_msg missing incremental map 626 2019-12-09T20:11:03.513 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:11:03.437+0000 36a79700 -1 osd.5 626 build_incremental_map_msg missing incremental map 626 2019-12-09T20:11:03.558 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:11:03.470+0000 3727a700 -1 osd.5 626 build_incremental_map_msg missing incremental map 626 2019-12-09T20:11:04.702 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:11:04.697+0000 35a77700 -1 osd.5 627 build_incremental_map_msg missing incremental map 626 2019-12-09T20:11:04.741 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:11:04.709+0000 35a77700 -1 osd.5 627 build_incremental_map_msg missing incremental map 626 2019-12-09T20:11:19.258 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:32:17.285 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:11:19.265 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:32:17.292 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:11:19.272 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:32:17.299 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:11:19.276 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:32:17.303 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:11:19.278 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:32:17.241 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:11:19.291 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:32:17.254 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:11:19.546 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:32:17.573 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:11:19.669 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:32:17.696 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:11:19.715 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:32:17.678 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:12:04.926 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:04.918+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:05.229 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:05.225+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:05.889 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:05.885+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:06.245 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:06.239+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:06.922 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:06.916+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:06.922 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:06.918+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:07.228 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:07.224+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:07.945 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:07.941+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:07.967 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:07.961+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:08.180 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:08.175+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:08.194 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:08.190+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:08.721 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:08.716+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:08.936 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:08.932+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:08.952 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:08.947+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:09.150 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:09.145+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:09.220 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:09.212+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:09.261 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:09.255+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:09.704 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:09.699+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:09.898 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:09.894+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:09.989 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:09.982+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:10.194 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:10.190+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:10.260 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:10.255+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:10.287 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:10.282+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:10.713 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:10.708+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:10.951 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:10.946+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:10.991 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:10.984+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:11.225 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:11.219+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:11.248 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:11.245+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:11.288 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:11.282+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:11.709 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:11.705+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:11.923 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:11.919+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:11.949 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:11.944+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:12.232 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:12.228+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:12.265 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:12.260+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:12.267 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:12.262+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:12.719 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:12.715+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:12.968 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:12.962+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:12.972 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:12.968+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:13.218 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:13.214+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:13.250 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:13.243+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:13.257 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:13.251+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:13.744 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:13.740+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:13.976 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:13.971+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:14.000 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:13.994+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:14.197 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:14.192+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:14.254 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:14.247+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:14.266 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:14.261+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:14.785 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:14.781+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:14.948 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:14.944+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:15.016 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:15.009+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:15.225 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:15.220+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:15.239 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:15.233+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:15.292 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:15.286+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:15.754 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:15.749+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:16.001 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:15.996+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:16.051 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:16.045+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:16.226 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:16.219+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:16.274 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:16.270+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:16.287 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:16.281+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:16.746 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:16.741+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:17.004 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:16.999+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:17.032 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:17.029+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:17.209 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:17.204+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:17.262 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:17.258+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:17.336 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:17.330+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:17.711 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:17.707+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:18.021 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:18.014+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:18.032 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:18.029+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:18.252 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:18.245+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:18.293 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:18.287+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:18.298 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:18.294+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:18.713 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:18.709+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:19.039 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:19.036+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:19.087 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:19.044+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:19.214 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:19.209+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:19.320 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:19.314+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:19.323 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:19.320+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:19.765 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:19.762+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:20.062 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:20.058+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:20.083 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:20.077+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:20.236 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:20.230+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:20.317 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:20.311+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:20.321 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:20.318+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:20.769 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:20.765+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:21.039 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:21.036+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:21.102 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:21.096+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:21.277 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:21.272+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:21.282 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:21.280+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:21.332 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:21.324+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:21.769 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:21.765+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:22.053 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:22.051+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:22.122 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:22.118+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:22.287 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:22.282+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:22.290 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:22.284+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:22.292 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:22.288+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:22.743 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:22.740+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:23.088 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:23.085+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:23.090 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:23.085+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:23.268 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:23.263+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:23.291 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:23.289+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:23.321 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:23.316+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:23.726 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:23.722+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:24.125 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:24.116+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:24.140 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:24.137+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:24.288 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:24.285+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:24.315 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:24.310+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:24.370 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:24.366+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:24.683 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:24.679+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:25.131 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:25.126+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:25.152 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:25.149+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:25.275 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:25.269+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:25.340 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:25.337+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:25.343 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:25.337+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:25.681 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:25.677+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:26.126 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:26.121+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:26.141 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:26.137+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:26.261 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:26.256+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:26.342 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:26.336+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:26.386 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:26.382+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:26.661 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:26.655+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:27.112 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:27.107+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:27.192 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:27.182+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:27.249 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:27.245+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:27.326 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:27.321+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:27.424 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:27.421+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:27.659 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:27.654+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:28.117 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:28.112+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:28.201 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:28.197+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:28.270 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:28.264+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:28.371 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:28.366+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:28.458 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:28.453+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:28.675 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:28.671+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:29.074 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:29.070+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:29.213 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:29.209+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:29.300 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:29.295+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:29.351 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:29.346+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:29.450 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:29.446+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:29.664 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:29.659+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:30.046 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:30.042+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:30.195 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:30.191+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:30.275 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:30.270+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:30.392 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:30.385+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:30.461 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:30.457+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:30.619 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:30.614+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:31.053 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:31.049+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:31.201 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:31.196+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:31.250 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:31.245+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:31.375 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:31.371+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:31.431 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:31.426+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:31.665 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:31.660+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:32.072 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:32.068+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:32.162 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:32.158+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:32.265 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:32.261+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:32.436 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:32.423+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:32.468 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:32.463+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:32.693 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:32.689+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:33.056 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:33.052+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:33.183 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:33.180+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:33.307 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:33.302+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:33.474 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:33.469+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:33.476 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:33.472+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:33.722 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:33.718+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:34.045 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:34.040+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:34.186 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:34.182+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:34.328 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:34.323+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:34.446 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:34.442+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:34.499 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:34.492+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:34.728 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:34.725+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:35.018 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:35.012+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:35.154 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:35.149+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:35.379 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:35.373+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:35.466 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:35.460+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:35.545 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:35.540+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:35.696 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:35.691+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:36.018 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:36.013+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:36.144 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:36.139+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:36.387 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:36.382+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:36.517 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:36.510+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:36.517 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:36.504+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:36.705 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:36.700+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:37.032 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:37.027+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:37.067 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:12:37.063+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 41sec e630 v630) 2019-12-09T20:12:37.118 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:37.115+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:37.375 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:37.371+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:37.476 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:37.470+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:37.495 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:37.491+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:37.758 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:37.754+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:38.018 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:38.013+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:38.127 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:38.122+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:38.392 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:38.387+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:38.491 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:38.487+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:38.500 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:38.496+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:38.766 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:38.762+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:39.007 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:39.002+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:39.177 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:39.174+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:39.444 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:39.438+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:39.461 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:39.455+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:39.536 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:39.532+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:39.808 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:39.804+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:40.005 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:39.999+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:40.190 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:40.186+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:40.426 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:40.421+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:40.457 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:40.451+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:40.578 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:40.573+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:40.790 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:40.784+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:41.013 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:41.006+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:41.230 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:41.226+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:41.417 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:41.411+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:41.431 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:41.425+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:41.569 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:41.565+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:41.751 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:41.746+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:42.014 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:42.007+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:42.083 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:12:42.080+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 41sec e630 v630) 2019-12-09T20:12:42.240 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:42.235+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:42.428 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:42.422+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:42.470 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:42.464+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:42.582 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:42.578+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:42.749 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:42.745+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:43.046 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:43.040+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:43.236 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:43.232+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:43.446 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:43.438+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:43.492 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:43.486+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:43.559 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:43.554+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:43.723 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:43.719+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:44.018 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:44.011+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:44.233 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:44.227+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:44.485 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:44.480+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:44.487 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:44.479+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:44.559 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:44.555+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:44.748 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:44.744+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:45.069 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:45.057+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:45.210 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:45.206+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:45.497 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:45.490+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:45.509 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:45.502+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:45.603 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:45.599+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:45.786 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:45.776+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:46.047 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:46.041+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:46.209 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:46.204+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:46.472 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:12:46.466+0000 1694f700 -1 osd.6 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.788691+0000 front 2019-12-09T20:11:24.825129+0000 (oldest deadline 2019-12-09T20:12:08.735266+0000) 2019-12-09T20:12:46.555 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:12:46.542+0000 1694f700 -1 osd.4 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.153007+0000 front 2019-12-09T20:11:22.329810+0000 (oldest deadline 2019-12-09T20:12:07.192730+0000) 2019-12-09T20:12:46.621 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:12:46.617+0000 1694f700 -1 osd.3 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:22.968852+0000 front 2019-12-09T20:11:22.985040+0000 (oldest deadline 2019-12-09T20:12:05.213866+0000) 2019-12-09T20:12:46.816 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:12:46.812+0000 1694f700 -1 osd.0 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:23.142631+0000 front 2019-12-09T20:11:25.669596+0000 (oldest deadline 2019-12-09T20:12:08.489428+0000) 2019-12-09T20:12:47.068 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:12:47.062+0000 1694f700 -1 osd.7 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:25.668483+0000 front 2019-12-09T20:11:23.790497+0000 (oldest deadline 2019-12-09T20:12:06.646238+0000) 2019-12-09T20:12:47.171 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:12:47.156+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 41sec e630 v630) 2019-12-09T20:12:47.228 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:12:47.224+0000 1694f700 -1 osd.1 630 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:11:24.925174+0000 front 2019-12-09T20:11:23.260263+0000 (oldest deadline 2019-12-09T20:12:04.775480+0000) 2019-12-09T20:12:51.117 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:12:51.111+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T20:14:37.598 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:37.590+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:38.039 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:35:36.066 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:14:38.066 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:35:36.094 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:14:38.115 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:38.112+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:38.117 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:35:36.145 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:14:38.120 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:35:36.148 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:14:38.130 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:35:36.093 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:14:38.132 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:35:36.095 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:14:38.319 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:35:36.346 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:14:38.321 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:35:36.349 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:14:38.380 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:35:36.344 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:14:38.568 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:38.562+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:38.683 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:38.679+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:38.803 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:38.797+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:39.079 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:39.072+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:39.530 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:39.525+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:39.690 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:39.687+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:39.835 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:39.830+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:40.082 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:40.078+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:40.436 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:40.433+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:40.539 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:40.534+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:40.709 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:40.703+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:40.824 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:40.818+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:41.004 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:40.997+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:41.060 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:41.056+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:41.454 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:41.449+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:41.579 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:41.573+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:41.670 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:41.666+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:41.854 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:41.848+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:42.045 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:42.039+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:42.054 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:42.050+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:42.410 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:42.405+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:42.589 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:42.583+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:42.656 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:42.652+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:42.885 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:42.880+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:43.086 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:43.081+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:43.098 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:43.093+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:43.404 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:43.400+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:43.614 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:43.607+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:43.642 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:43.638+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:43.937 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:43.930+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:44.096 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:44.092+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:44.123 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:44.116+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:44.446 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:44.441+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:44.602 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:44.596+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:44.686 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:44.682+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:44.907 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:44.900+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:45.084 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:45.080+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:45.160 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:45.154+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:45.451 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:45.448+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:45.649 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:45.643+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:45.692 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:45.686+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:45.951 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:45.945+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:46.104 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:46.101+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:46.205 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:46.198+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:46.449 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:46.441+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:46.621 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:46.615+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:46.657 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:46.654+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:46.954 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:46.948+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:47.070 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:47.067+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:47.161 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:47.154+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:47.480 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:47.477+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:47.588 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:47.581+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:47.614 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:47.611+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:47.969 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:47.958+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:48.071 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:48.067+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:48.168 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:48.162+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:48.432 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:48.430+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:48.567 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:48.560+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:48.610 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:48.607+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:48.975 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:48.968+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:49.120 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:49.115+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:49.198 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:49.192+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:49.410 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:49.407+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:49.599 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:49.593+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:49.611 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:49.606+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:49.950 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:49.944+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:50.144 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:50.140+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:50.203 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:50.198+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:50.380 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:50.377+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:50.590 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:50.586+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:50.642 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:50.636+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:50.965 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:50.959+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:51.195 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:51.189+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:51.197 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:51.193+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:51.335 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:51.332+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:51.567 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:51.564+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:51.633 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:51.628+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:51.937 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:51.932+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:52.199 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:52.192+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:52.244 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:52.240+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:52.323 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:52.320+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:52.577 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:52.570+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:52.614 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:52.608+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:52.993 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:52.987+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:53.164 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:53.157+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:53.290 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:53.287+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:53.336 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:53.334+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:53.558 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:53.554+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:53.569 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:53.563+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:53.972 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:53.966+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:54.181 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:54.174+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:54.297 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:54.292+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:54.326 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:54.321+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:54.593 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:54.587+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:54.603 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:54.595+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:55.003 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:54.997+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:55.231 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:55.224+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:55.277 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:55.268+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:55.364 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:55.359+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:55.565 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:55.560+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:55.622 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:55.616+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:56.007 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:56.001+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:56.271 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:56.265+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:56.324 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:56.319+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:56.340 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:56.336+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:56.582 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:56.575+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:56.589 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:56.584+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:57.003 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:56.998+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:57.256 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:57.252+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:57.352 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:57.348+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:57.370 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:57.366+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:57.550 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:57.543+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:57.587 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:57.583+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:58.005 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:57.999+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:58.261 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:58.255+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:58.366 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:58.361+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:58.396 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:58.393+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:58.585 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:58.580+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:58.599 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:58.595+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:14:59.041 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:14:59.037+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:14:59.214 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:14:59.211+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:14:59.343 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:14:59.339+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:14:59.424 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:14:59.419+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:14:59.594 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:14:59.589+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:14:59.642 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:14:59.638+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:00.088 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:00.084+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:00.207 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:00.202+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:00.352 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:00.348+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:00.424 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:00.420+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:00.566 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:00.560+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:00.660 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:00.656+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:01.110 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:01.105+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:01.226 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:01.220+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:01.381 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:01.378+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:01.391 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:01.388+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:01.530 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:01.525+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:01.713 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:01.710+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:02.106 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:02.100+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:02.270 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:02.265+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:02.354 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:02.350+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:02.432 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:02.428+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:02.564 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:02.559+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:02.739 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:02.734+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:03.081 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:03.075+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:03.284 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:03.279+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:03.362 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:03.359+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:03.486 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:03.482+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:03.569 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:03.564+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:03.740 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:03.735+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:04.069 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:04.065+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:04.268 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:04.263+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:04.403 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:04.400+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:04.505 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:04.497+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:04.530 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:04.524+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:04.791 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:04.786+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:05.061 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:05.056+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:05.292 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:05.286+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:05.375 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:05.370+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:05.532 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:05.527+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:05.534 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:05.529+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:05.799 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:05.795+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:06.041 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:06.035+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:06.269 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:06.264+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:06.417 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:06.414+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:06.497 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:06.492+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:06.569 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:06.564+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:06.773 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:06.769+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:07.040 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:07.035+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:07.224 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:07.219+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:07.438 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:07.434+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:07.532 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:07.527+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:07.618 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:07.613+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:07.798 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:07.794+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:08.017 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:08.013+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:08.182 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:08.177+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:08.211 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:15:08.208+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 40sec e640 v640) 2019-12-09T20:15:08.480 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:08.475+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:08.487 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:08.483+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:08.661 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:08.657+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:08.761 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:08.757+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:09.031 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:09.026+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:09.140 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:09.136+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:09.433 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:09.429+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:09.478 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:09.473+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:09.695 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:09.690+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:09.726 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:09.722+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:10.028 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:10.022+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:10.196 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:10.190+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:10.434 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:10.430+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:10.523 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:10.519+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:10.696 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:10.692+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:10.701 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:10.696+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:11.040 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:11.035+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:11.231 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:11.226+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:11.455 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:11.451+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:11.548 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:11.544+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:11.659 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:11.655+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:11.704 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:11.699+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:11.996 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:11.991+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:12.251 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:12.246+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:12.418 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:12.413+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:12.572 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:12.567+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:12.709 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:12.705+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:12.713 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:12.708+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:13.004 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:12.999+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:13.224 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:15:13.219+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 40sec e640 v640) 2019-12-09T20:15:13.302 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:13.298+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:13.420 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:13.416+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:13.593 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:13.589+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:13.715 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:13.710+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:13.733 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:13.725+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:14.017 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:14.011+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:14.284 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:14.275+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:14.383 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:14.379+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:14.620 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:14.616+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:14.704 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:14.700+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:14.755 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:14.749+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:15.033 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:15.027+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:15.266 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:15.260+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:15.358 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:15.355+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:15.650 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:15.647+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:15.723 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:15.717+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:15.745 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:15.740+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:16.036 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:16.030+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:16.227 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:16.220+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:16.388 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:16.385+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:16.678 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:16.672+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:16.690 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:16.685+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:16.792 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:16.788+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:17.054 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:17.047+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:17.213 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:17.204+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:17.430 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:17.427+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:17.675 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:17.671+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:17.708 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:17.702+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:17.848 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:17.842+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:18.020 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:18.014+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:18.200 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:18.193+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:18.241 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:15:18.237+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 40sec e640 v640) 2019-12-09T20:15:18.468 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:18.464+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:18.637 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:18.632+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:18.705 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:18.699+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:18.811 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:18.807+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:18.997 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:18.991+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:19.155 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:19.149+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:19.429 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:19.424+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:19.629 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:19.624+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:19.744 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:19.739+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:19.825 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:19.821+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:19.972 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:19.961+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:20.160 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:20.154+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:20.478 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:20.473+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:20.661 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:20.657+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:20.760 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:20.753+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:20.837 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:20.833+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:20.991 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:20.985+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:21.152 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:21.146+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:21.475 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:21.471+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:21.661 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:21.656+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:21.747 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:21.741+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:21.792 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:21.789+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:21.979 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:21.972+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:22.111 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:22.105+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:22.478 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:22.474+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:22.687 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:22.683+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:22.797 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:22.791+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:22.800 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:22.796+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:22.938 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:22.931+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:23.098 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:23.092+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:23.323 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:15:23.319+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 40sec e640 v640) 2019-12-09T20:15:23.533 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:23.529+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:23.690 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:23.685+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:23.800 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:23.794+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:23.854 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:23.850+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:23.953 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:23.947+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:24.118 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:24.111+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:24.545 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:24.541+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:24.741 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:24.737+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:24.838 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:24.833+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:24.889 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:24.885+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:25.002 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:24.996+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:25.168 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:25.162+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:25.552 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:25.548+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:25.727 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:25.723+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:25.824 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:25.819+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:25.846 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:25.841+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:25.962 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:25.956+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:26.179 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:26.173+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:26.519 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:26.515+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:26.688 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:26.683+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:26.820 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:26.814+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:26.862 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:26.857+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:26.971 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:26.965+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:27.158 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:27.152+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:27.503 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:27.499+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:27.668 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:15:27.663+0000 1694f700 -1 osd.1 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.163051+0000 front 2019-12-09T20:13:53.978574+0000 (oldest deadline 2019-12-09T20:14:38.002759+0000) 2019-12-09T20:15:27.837 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:15:27.831+0000 1694f700 -1 osd.6 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:56.814224+0000 front 2019-12-09T20:14:01.879114+0000 (oldest deadline 2019-12-09T20:14:36.743899+0000) 2019-12-09T20:15:27.901 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:15:27.897+0000 1694f700 -1 osd.3 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:14:01.886183+0000 front 2019-12-09T20:14:02.476024+0000 (oldest deadline 2019-12-09T20:14:38.653024+0000) 2019-12-09T20:15:27.979 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:15:27.973+0000 1694f700 -1 osd.7 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:54.424104+0000 front 2019-12-09T20:13:52.550796+0000 (oldest deadline 2019-12-09T20:14:37.821896+0000) 2019-12-09T20:15:28.214 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:15:28.208+0000 1694f700 -1 osd.4 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:57.099178+0000 front 2019-12-09T20:13:57.223519+0000 (oldest deadline 2019-12-09T20:14:40.554900+0000) 2019-12-09T20:15:28.378 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:15:28.372+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 40sec e640 v640) 2019-12-09T20:15:28.460 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:15:28.456+0000 1694f700 -1 osd.0 640 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:13:55.414908+0000 front 2019-12-09T20:13:55.370972+0000 (oldest deadline 2019-12-09T20:14:39.734122+0000) 2019-12-09T20:15:30.940 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:36:28.967 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:30.946 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:36:28.973 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:30.954 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:36:28.917 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:30.955 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:36:28.982 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:30.958 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:36:28.985 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:30.960 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:36:28.923 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:31.030 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:36:29.058 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:31.053 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:36:29.080 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:31.076 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:36:29.039 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:35.304 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:15:35.288+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T20:15:53.612 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:36:51.639 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:53.614 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:36:51.641 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:53.620 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:36:51.648 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:53.621 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:36:51.584 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:53.624 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:36:51.587 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:53.651 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:36:51.677 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:53.691 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:36:51.718 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:53.700 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:36:51.664 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:15:53.739 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:36:51.766 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:16:07.295 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:16:07.285+0000 36a79700 -1 osd.5 645 build_incremental_map_msg missing incremental map 645 2019-12-09T20:16:07.297 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:16:07.287+0000 35a77700 -1 osd.5 645 build_incremental_map_msg missing incremental map 645 2019-12-09T20:16:07.397 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:16:07.369+0000 3a280700 -1 osd.5 645 build_incremental_map_msg missing incremental map 645 2019-12-09T20:16:07.448 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:16:07.407+0000 33a73700 -1 osd.5 645 build_incremental_map_msg missing incremental map 645 2019-12-09T20:16:07.780 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:16:07.572+0000 38a7d700 -1 osd.5 645 build_incremental_map_msg missing incremental map 645 2019-12-09T20:16:08.033 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:16:07.998+0000 36278700 -1 osd.5 645 build_incremental_map_msg missing incremental map 645 2019-12-09T20:16:11.808 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:16:11.770+0000 39a7f700 -1 osd.5 647 build_incremental_map_msg missing incremental map 645 2019-12-09T20:16:11.900 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:16:11.820+0000 39a7f700 -1 osd.5 647 build_incremental_map_msg missing incremental map 645 2019-12-09T20:17:06.338 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:06.333+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:07.314 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:07.307+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:07.366 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:07.360+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:07.445 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:07.440+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:08.163 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:08.158+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:08.319 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:08.313+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:08.378 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:08.372+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:08.486 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:08.481+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:08.724 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:08.720+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:09.185 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:09.178+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:09.341 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:09.336+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:09.418 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:09.412+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:09.449 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:09.444+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:09.708 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:09.703+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:10.207 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:10.202+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:10.340 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:10.333+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:10.468 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:10.461+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:10.470 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:10.465+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:10.671 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:10.666+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:11.164 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:11.159+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:11.333 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:11.329+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:11.464 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:11.458+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:11.489 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:11.483+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:11.671 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:11.666+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:12.166 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:12.161+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:12.383 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:12.378+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:12.460 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:12.454+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:12.490 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:12.482+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:12.663 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:12.659+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:13.112 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:13.106+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:13.128 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:13.121+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:13.425 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:13.419+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:13.430 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:13.426+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:13.459 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:13.453+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:13.681 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:13.677+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:14.114 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:14.111+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:14.174 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:14.168+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:14.412 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:14.409+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:14.460 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:14.454+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:14.488 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:14.481+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:14.637 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:14.634+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:15.080 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:15.077+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:15.221 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:15.216+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:15.398 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:15.394+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:15.449 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:15.443+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:15.450 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:15.442+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:15.637 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:15.634+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:16.056 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:16.051+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:16.260 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:16.253+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:16.399 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:16.395+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:16.458 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:16.451+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:16.492 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:16.487+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:16.651 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:16.644+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:17.073 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:17.069+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:17.260 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:17.254+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:17.451 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:17.448+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:17.479 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:17.472+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:17.493 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:17.487+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:17.618 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:17.613+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:18.045 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:18.041+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:18.313 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:18.308+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:18.467 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:18.464+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:18.493 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:18.486+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:18.503 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:18.497+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:18.572 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:18.569+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:19.041 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:19.037+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:19.284 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:19.278+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:19.460 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:19.453+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:19.473 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:19.470+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:19.504 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:19.497+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:19.547 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:19.544+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:20.068 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:20.064+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:20.263 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:20.258+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:20.448 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:20.442+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:20.504 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:20.500+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:20.519 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:20.513+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:20.536 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:20.532+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:21.113 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:21.107+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:21.244 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:21.239+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:21.421 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:21.415+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:21.499 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:21.493+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:21.516 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:21.512+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:21.531 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:21.527+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:22.074 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:22.070+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:22.203 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:22.198+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:22.460 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:22.454+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:22.480 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:22.474+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:22.486 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:22.482+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:22.512 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:22.507+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:23.122 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:23.117+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:23.165 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:23.160+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:23.419 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:23.414+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:23.476 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:23.472+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:23.511 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:23.505+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:23.536 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:23.532+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:24.121 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:24.117+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:24.210 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:24.204+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:24.450 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:24.444+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:24.475 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:24.468+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:24.511 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:24.506+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:24.516 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:24.512+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:25.136 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:25.132+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:25.217 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:25.211+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:25.445 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:25.439+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:25.477 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:25.469+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:25.484 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:25.479+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:25.569 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:25.565+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:26.175 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:26.169+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:26.178 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:26.174+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:26.456 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:26.450+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:26.478 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:26.473+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:26.513 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:26.509+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:26.538 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:26.535+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:27.149 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:27.142+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:27.165 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:27.160+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:27.459 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:27.453+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:27.482 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:27.476+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:27.527 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:27.523+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:27.565 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:27.561+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:28.149 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:28.145+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:28.186 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:28.180+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:28.423 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:28.417+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:28.488 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:28.482+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:28.557 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:28.553+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:28.563 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:28.559+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:29.150 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:29.146+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:29.179 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:29.173+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:29.442 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:29.436+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:29.539 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:29.532+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:29.542 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:29.537+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:29.583 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:29.578+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:30.200 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:30.194+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:30.201 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:30.197+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:30.480 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:30.474+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:30.521 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:30.516+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:30.574 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:30.567+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:30.616 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:30.611+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:31.182 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:31.168+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:31.200 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:31.195+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:31.440 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:31.434+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:31.541 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:31.537+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:31.574 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:31.568+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:31.615 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:31.611+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:32.201 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:32.196+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:32.210 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:32.206+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:32.441 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:32.435+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:32.549 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:32.545+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:32.584 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:32.579+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:32.590 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:32.586+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:33.209 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:33.205+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:33.258 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:33.249+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:33.442 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:33.437+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:33.584 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:33.580+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:33.586 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:33.582+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:33.600 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:33.595+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:34.203 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:34.198+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:34.237 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:34.232+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:34.429 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:34.423+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:34.557 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:34.552+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:34.606 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:34.600+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:34.622 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:34.614+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:35.213 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:35.209+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:35.263 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:35.258+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:35.422 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:35.416+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:35.583 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:35.578+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:35.647 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:35.643+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:35.647 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:35.643+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:36.241 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:36.237+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:36.279 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:36.274+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:36.437 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:36.432+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:36.552 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:36.547+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:36.608 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:36.603+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:36.666 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:36.660+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:37.229 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:37.225+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:37.309 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:37.304+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:37.410 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:37.406+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:37.556 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:37.551+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:37.626 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:37.618+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:37.643 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:37.634+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:38.225 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:38.221+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:38.335 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:38.331+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:38.380 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:38.375+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:38.609 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:38.603+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:38.621 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:38.616+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:38.625 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:38.621+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:38.906 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:17:38.902+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e649 v649) 2019-12-09T20:17:39.277 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:39.273+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:39.357 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:39.352+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:39.382 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:39.377+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:39.629 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:39.625+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:39.641 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:39.635+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:39.646 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:39.642+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:40.258 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:40.253+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:40.380 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:40.376+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:40.426 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:40.421+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:40.615 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:40.609+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:40.621 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:40.617+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:40.698 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:40.694+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:41.232 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:41.229+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:41.364 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:41.359+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:41.453 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:41.448+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:41.646 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:41.642+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:41.648 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:41.643+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:41.678 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:41.673+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:42.250 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:42.246+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:42.415 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:42.410+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:42.494 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:42.488+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:42.634 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:42.629+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:42.663 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:42.659+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:42.666 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:42.661+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:43.284 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:43.280+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:43.443 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:43.438+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:43.504 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:43.499+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:43.610 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:43.605+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:43.694 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:43.690+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:43.716 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:43.712+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:43.921 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:17:43.918+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e649 v649) 2019-12-09T20:17:44.294 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:44.290+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:44.412 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:44.408+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:44.480 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:44.475+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:44.564 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:44.559+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:44.661 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:44.657+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:44.753 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:44.749+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:45.269 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:45.265+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:45.439 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:45.434+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:45.462 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:45.458+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:45.523 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:45.518+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:45.710 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:45.706+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:45.759 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:45.754+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:46.233 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:46.229+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:46.425 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:46.420+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:46.488 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:46.482+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:46.498 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:46.494+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:46.715 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:46.711+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:46.781 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:46.776+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:47.223 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:47.219+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:47.390 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:47.385+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:47.480 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:47.476+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:47.546 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:47.539+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:47.716 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:47.711+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:47.800 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:47.796+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:48.197 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:17:48.192+0000 1694f700 -1 osd.0 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:28.106851+0000 front 2019-12-09T20:16:28.152531+0000 (oldest deadline 2019-12-09T20:17:12.347696+0000) 2019-12-09T20:17:48.377 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:17:48.372+0000 1694f700 -1 osd.6 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:27.180851+0000 front 2019-12-09T20:16:23.237336+0000 (oldest deadline 2019-12-09T20:17:07.155743+0000) 2019-12-09T20:17:48.528 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:48.524+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:48.543 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:17:48.539+0000 1694f700 -1 osd.7 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:24.112142+0000 front 2019-12-09T20:16:28.105519+0000 (oldest deadline 2019-12-09T20:17:07.671472+0000) 2019-12-09T20:17:48.760 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:17:48.756+0000 1694f700 -1 osd.3 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:29.069592+0000 front 2019-12-09T20:16:22.763739+0000 (oldest deadline 2019-12-09T20:17:08.646576+0000) 2019-12-09T20:17:48.819 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:17:48.814+0000 1694f700 -1 osd.1 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:21.492562+0000 front 2019-12-09T20:16:29.083449+0000 (oldest deadline 2019-12-09T20:17:06.062593+0000) 2019-12-09T20:17:48.982 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:17:48.977+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 44sec e649 v649) 2019-12-09T20:17:49.509 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:17:49.505+0000 1694f700 -1 osd.4 649 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:16:26.564682+0000 front 2019-12-09T20:16:21.283853+0000 (oldest deadline 2019-12-09T20:17:06.540675+0000) 2019-12-09T20:17:56.069 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:17:56.062+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T20:19:21.644 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:40:19.671 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:21.659 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:40:19.687 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:21.665 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:40:19.628 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:21.666 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:40:19.694 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:21.670 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:40:19.633 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:21.675 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:40:19.703 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:21.909 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:40:19.936 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:21.910 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:40:19.937 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:21.959 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:40:19.923 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:19:41.793 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:41.790+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:42.480 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:42.474+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:42.768 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:42.765+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:43.234 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:43.229+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:43.497 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:43.490+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:43.756 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:43.749+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:44.273 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:44.269+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:44.463 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:44.457+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:44.795 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:44.793+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:45.299 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:45.295+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:45.466 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:19:45.464+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:19:45.514 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:45.509+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:45.753 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:45.749+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:46.314 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:46.308+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:46.466 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:19:46.463+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:19:46.472 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:46.468+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:46.775 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:46.772+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:47.362 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:47.356+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:47.428 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:47.423+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:47.492 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:19:47.490+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:19:47.754 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:47.751+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:48.352 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:48.346+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:48.419 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:48.413+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:48.460 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:19:48.457+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:19:48.802 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:48.799+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:49.378 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:49.371+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:49.416 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:49.410+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:49.480 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:19:49.476+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:19:49.820 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:49.816+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:50.377 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:50.371+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:50.387 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:50.381+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:50.521 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:19:50.517+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:19:50.798 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:50.793+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:51.414 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:51.408+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:51.424 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:51.397+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:51.544 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:19:51.540+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:19:51.796 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:51.790+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:52.392 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:52.385+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:52.423 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:52.417+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:52.528 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:19:52.524+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:19:52.796 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:52.791+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:53.385 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:53.379+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:53.433 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:53.427+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:53.582 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:19:53.578+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:19:53.760 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:53.755+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:54.396 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:54.390+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:54.409 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:54.402+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:54.581 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:19:54.577+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:19:54.728 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:54.724+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:55.395 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:55.388+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:55.421 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:55.415+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:55.601 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:19:55.597+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:19:55.739 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:55.736+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:55.876 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:19:55.870+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:19:56.402 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:56.396+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:56.418 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:56.413+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:56.649 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:19:56.645+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:19:56.760 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:56.756+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:56.859 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:19:56.855+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:19:57.388 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:57.382+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:57.391 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:57.385+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:57.638 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:19:57.634+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:19:57.744 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:57.739+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:57.818 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:19:57.813+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:19:58.381 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:58.375+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:58.395 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:58.390+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:58.601 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:19:58.596+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:19:58.721 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:58.711+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:58.844 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:19:58.840+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:19:59.386 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:19:59.379+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:19:59.393 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:19:59.387+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:19:59.642 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:19:59.638+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:19:59.677 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:19:59.674+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:19:59.812 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:19:59.808+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:00.412 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:00.406+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:00.437 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:00.431+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:00.648 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:20:00.643+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:20:00.655 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:00.650+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:00.833 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:00.828+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:01.445 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:01.440+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:01.486 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:01.480+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:01.652 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:01.647+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:01.663 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:20:01.659+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:20:01.875 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:01.871+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:02.455 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:02.450+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:02.523 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:02.517+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:02.652 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:02.647+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:02.671 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:20:02.667+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:20:02.893 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:02.889+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:03.479 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:03.473+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:03.545 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:03.539+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:03.640 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:20:03.635+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:20:03.660 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:03.654+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:03.856 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:03.852+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:04.443 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:04.438+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:04.508 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:04.502+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:04.640 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:20:04.636+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:20:04.697 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:04.692+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:04.897 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:04.893+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:05.465 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:05.459+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:05.465 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:05.458+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:05.637 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:20:05.633+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:20:05.695 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:05.692+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:05.949 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:05.944+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:06.453 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:06.447+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:06.483 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:06.477+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:06.674 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:20:06.669+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:20:06.679 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:06.674+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:06.972 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:06.967+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:07.504 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:07.498+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:07.521 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:07.516+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:07.665 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:20:07.662+0000 1694f700 -1 osd.1 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.029778+0000 front 2019-12-09T20:18:56.990457+0000 (oldest deadline 2019-12-09T20:19:41.185200+0000) 2019-12-09T20:20:07.703 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:07.698+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:07.958 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:07.954+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:08.539 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:08.535+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:08.552 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:08.548+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:08.671 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:08.667+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:08.938 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:08.934+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:09.543 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:09.536+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:09.582 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:09.578+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:09.699 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:09.695+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:09.909 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:09.905+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:10.592 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:10.588+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:10.615 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:10.610+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:10.668 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:10.664+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:10.816 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:20:10.811+0000 1694f700 -1 osd.4 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:56.686695+0000 front 2019-12-09T20:18:56.562949+0000 (oldest deadline 2019-12-09T20:20:10.072055+0000) 2019-12-09T20:20:10.909 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:10.905+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:11.580 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:11.576+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:11.610 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:11.605+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:11.703 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:11.699+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:11.859 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:20:11.854+0000 1694f700 -1 osd.4 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:56.686695+0000 front 2019-12-09T20:18:56.562949+0000 (oldest deadline 2019-12-09T20:20:10.072055+0000) 2019-12-09T20:20:11.884 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:11.879+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:12.602 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:12.598+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:12.660 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:12.650+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:12.690 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:12.686+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:12.841 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:20:12.836+0000 1694f700 -1 osd.4 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:56.686695+0000 front 2019-12-09T20:18:56.562949+0000 (oldest deadline 2019-12-09T20:20:10.072055+0000) 2019-12-09T20:20:12.867 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:12.863+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:13.616 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:13.612+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:13.670 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:13.665+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:13.736 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:13.730+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:13.829 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:20:13.821+0000 1694f700 -1 osd.4 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:56.686695+0000 front 2019-12-09T20:18:56.562949+0000 (oldest deadline 2019-12-09T20:20:10.072055+0000) 2019-12-09T20:20:13.869 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:13.859+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:14.645 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:14.641+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:14.651 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:14.646+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:14.711 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:14.706+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:14.836 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:20:14.830+0000 1694f700 -1 osd.4 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:56.686695+0000 front 2019-12-09T20:18:56.562949+0000 (oldest deadline 2019-12-09T20:20:10.072055+0000) 2019-12-09T20:20:14.883 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:14.878+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:15.614 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:15.608+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:15.694 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:15.690+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:15.698 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:15.693+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:15.810 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:20:15.806+0000 1694f700 -1 osd.4 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:56.686695+0000 front 2019-12-09T20:18:56.562949+0000 (oldest deadline 2019-12-09T20:20:10.072055+0000) 2019-12-09T20:20:15.896 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:15.892+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:16.664 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:16.659+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:16.711 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:16.707+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:16.711 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:16.705+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:16.833 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:20:16.828+0000 1694f700 -1 osd.4 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:56.686695+0000 front 2019-12-09T20:18:56.562949+0000 (oldest deadline 2019-12-09T20:20:10.072055+0000) 2019-12-09T20:20:16.927 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:16.922+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:17.643 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:17.638+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:17.717 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:17.712+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:17.757 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:17.752+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:17.836 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:20:17.830+0000 1694f700 -1 osd.4 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:56.686695+0000 front 2019-12-09T20:18:56.562949+0000 (oldest deadline 2019-12-09T20:20:10.072055+0000) 2019-12-09T20:20:17.893 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:17.889+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:18.686 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:18.681+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:18.729 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:18.724+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:18.742 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:18.737+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:18.842 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:20:18.837+0000 1694f700 -1 osd.4 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:56.686695+0000 front 2019-12-09T20:18:56.562949+0000 (oldest deadline 2019-12-09T20:20:10.072055+0000) 2019-12-09T20:20:18.856 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:18.852+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:19.565 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:20:19.562+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 46sec e660 v660) 2019-12-09T20:20:19.720 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:19.715+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:19.728 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:19.724+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:19.810 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:19.800+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:19.866 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:20:19.862+0000 1694f700 -1 osd.4 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:56.686695+0000 front 2019-12-09T20:18:56.562949+0000 (oldest deadline 2019-12-09T20:20:10.072055+0000) 2019-12-09T20:20:19.904 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:19.900+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:20.683 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:20.679+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:20.763 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:20.759+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:20.773 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:20.769+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:20.834 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:20:20.829+0000 1694f700 -1 osd.4 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:56.686695+0000 front 2019-12-09T20:18:56.562949+0000 (oldest deadline 2019-12-09T20:20:10.072055+0000) 2019-12-09T20:20:20.881 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:20.876+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:21.676 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:21.672+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:21.726 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:21.721+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:21.755 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:21.750+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:21.824 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:20:21.815+0000 1694f700 -1 osd.4 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:56.686695+0000 front 2019-12-09T20:18:56.562949+0000 (oldest deadline 2019-12-09T20:20:10.072055+0000) 2019-12-09T20:20:21.851 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:21.846+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:22.713 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:22.708+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:22.715 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:22.711+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:22.750 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:22.744+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:22.859 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:20:22.854+0000 1694f700 -1 osd.4 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:56.686695+0000 front 2019-12-09T20:18:56.562949+0000 (oldest deadline 2019-12-09T20:20:10.072055+0000) 2019-12-09T20:20:22.894 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:22.890+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:23.697 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:23.693+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:23.764 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:23.759+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:23.765 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:23.762+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:23.886 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:20:23.881+0000 1694f700 -1 osd.4 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:56.686695+0000 front 2019-12-09T20:18:56.562949+0000 (oldest deadline 2019-12-09T20:20:10.072055+0000) 2019-12-09T20:20:23.890 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:20:23.885+0000 1694f700 -1 osd.3 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.640459+0000 front 2019-12-09T20:18:59.673754+0000 (oldest deadline 2019-12-09T20:19:55.757633+0000) 2019-12-09T20:20:24.651 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:20:24.643+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 46sec e660 v660) 2019-12-09T20:20:24.660 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:20:24.656+0000 1694f700 -1 osd.7 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.933732+0000 front 2019-12-09T20:18:59.791938+0000 (oldest deadline 2019-12-09T20:19:43.167395+0000) 2019-12-09T20:20:24.744 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:24.740+0000 1694f700 -1 osd.0 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:59.793959+0000 front 2019-12-09T20:18:59.449355+0000 (oldest deadline 2019-12-09T20:19:44.637092+0000) 2019-12-09T20:20:24.770 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:20:24.765+0000 1694f700 -1 osd.6 660 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:18:58.769623+0000 front 2019-12-09T20:18:58.768642+0000 (oldest deadline 2019-12-09T20:19:41.804364+0000) 2019-12-09T20:20:31.440 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:20:31.435+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T20:20:55.362 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:20:55.357+0000 1694f700 -1 osd.0 662 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:140461 7.6 7:6d4431ed:lc::lc.7:head [call rgw.lc_get_next_entry in=30b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e661) 2019-12-09T20:22:13.465 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:13.462+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:14.422 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:14.419+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:14.458 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:14.452+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:15.437 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:15.433+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:15.443 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:15.438+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:15.820 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:15.815+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:15.910 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:15.905+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:16.037 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:16.033+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:16.298 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:16.293+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:16.402 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:16.398+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:16.468 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:16.464+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:16.824 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:16.818+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:16.889 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:16.884+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:17.008 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:17.004+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:17.340 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:17.335+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:17.424 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:17.418+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:17.462 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:17.459+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:17.854 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:17.849+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:17.926 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:17.922+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:17.972 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:17.965+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:18.385 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:18.381+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:18.475 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:18.470+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:18.476 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:18.473+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:18.826 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:18.822+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:18.899 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:18.895+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:18.986 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:18.981+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:19.399 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:19.394+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:19.460 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:19.456+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:19.472 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:19.467+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:19.835 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:19.831+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:19.911 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:19.908+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:20.012 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:20.007+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:20.376 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:20.371+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:20.436 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:20.430+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:20.472 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:20.468+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:20.830 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:20.825+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:20.907 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:20.903+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:21.027 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:21.023+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:21.397 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:21.392+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:21.432 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:21.427+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:21.478 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:21.474+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:21.820 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:21.816+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:21.917 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:21.914+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:22.026 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:22.022+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:22.428 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:22.423+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:22.474 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:22.467+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:22.497 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:22.493+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:22.801 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:22.796+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:22.906 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:22.902+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:22.994 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:22.990+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:23.386 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:23.380+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:23.504 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:23.498+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:23.536 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:23.532+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:23.808 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:23.802+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:23.897 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:23.893+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:24.003 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:24.000+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:24.377 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:24.372+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:24.481 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:24.475+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:24.525 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:24.520+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:24.848 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:24.841+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:24.912 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:24.908+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:25.036 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:25.031+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:25.422 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:25.417+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:25.465 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:25.459+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:25.531 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:25.527+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:25.806 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:25.801+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:25.958 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:25.954+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:26.015 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:26.010+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:26.421 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:26.411+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:26.427 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:26.419+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:26.555 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:26.551+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:26.840 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:26.834+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:26.926 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:26.921+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:26.975 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:26.969+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:27.456 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:27.449+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:27.467 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:27.461+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:27.534 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:27.530+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:27.863 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:27.858+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:27.926 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:27.922+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:27.949 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:27.945+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:28.439 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:28.433+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:28.510 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:28.504+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:28.553 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:28.549+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:28.901 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:28.895+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:28.938 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:28.934+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:28.973 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:28.969+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:29.421 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:29.416+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:29.485 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:29.479+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:29.594 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:29.589+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:29.879 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:29.874+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:29.968 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:29.963+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:29.990 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:29.986+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:30.463 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:30.457+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:30.511 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:30.505+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:30.577 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:30.573+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:30.836 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:30.830+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:30.949 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:30.945+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:31.012 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:31.007+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:31.436 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:31.431+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:31.536 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:31.529+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:31.575 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:31.571+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:31.792 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:31.786+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:31.934 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:31.930+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:32.009 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:32.005+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:32.419 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:32.413+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:32.522 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:32.517+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:32.559 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:32.554+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:32.771 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:32.765+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:32.893 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:32.888+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:33.016 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:33.011+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:33.417 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:33.411+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:33.537 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:33.534+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:33.565 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:33.554+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:33.774 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:33.767+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:33.875 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:33.871+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:34.045 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:34.041+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:34.430 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:34.424+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:34.524 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:34.520+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:34.565 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:34.554+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:34.750 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:34.744+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:34.883 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:34.880+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:35.028 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:35.024+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:35.480 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:35.474+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:35.527 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:35.522+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:35.580 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:35.574+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:35.752 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:35.747+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:35.917 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:35.914+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:36.047 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:36.043+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:36.523 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:36.519+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:36.528 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:36.523+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:36.540 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:36.533+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:36.762 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:36.757+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:36.902 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:36.898+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:37.034 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:37.030+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:37.533 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:37.528+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:37.560 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:37.554+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:37.573 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:37.567+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:37.768 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:37.762+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:37.869 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:37.865+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:38.042 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:38.038+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:38.550 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:38.544+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:38.571 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:38.567+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:38.607 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:38.601+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:38.799 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:38.794+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:38.918 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:38.913+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:39.018 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:39.014+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:39.505 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:39.500+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:39.582 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:39.577+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:39.596 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:39.590+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:39.833 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:39.828+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:39.881 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:39.876+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:40.049 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:40.044+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:40.528 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:40.522+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:40.609 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:40.605+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:40.633 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:40.628+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:40.883 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:40.877+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:40.924 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:40.914+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:41.097 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:41.093+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:41.491 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:41.484+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:41.597 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:41.592+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:41.633 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:41.627+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:41.875 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:41.869+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:41.915 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:41.911+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:42.090 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:42.086+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:42.537 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:42.530+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:42.587 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:42.583+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:42.667 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:42.662+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:42.856 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:42.849+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:42.918 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:42.914+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:43.134 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:43.130+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:43.535 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:43.529+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:43.558 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:43.555+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:43.725 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:43.712+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:43.864 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:43.855+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:43.911 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:43.908+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:44.151 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:44.147+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:44.503 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:44.497+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:44.540 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:44.533+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:44.738 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:44.734+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:44.882 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:44.877+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:44.949 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:44.945+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:45.111 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:45.106+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:45.538 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:45.533+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:45.562 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:45.558+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:45.737 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:45.732+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:45.928 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:45.924+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:45.939 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:45.935+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:46.071 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:46.064+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:46.577 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:46.571+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:46.595 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:46.591+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:46.744 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:46.739+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:46.946 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:46.941+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:46.989 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:46.984+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:47.033 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:47.029+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:47.552 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:47.547+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:47.593 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:47.589+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:47.709 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:47.699+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:47.904 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:47.900+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:48.013 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:48.008+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:48.029 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:48.024+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:48.548 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:48.543+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:48.633 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:48.630+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:48.728 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:48.723+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:48.959 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:48.954+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:48.974 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:48.969+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:49.045 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:49.040+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:49.569 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:49.564+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:49.677 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:49.672+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:49.733 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:49.729+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:49.953 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:49.948+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:49.981 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:49.977+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:50.041 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:50.036+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:50.150 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:22:50.145+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 42sec e672 v672) 2019-12-09T20:22:50.527 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:50.522+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:50.725 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:50.721+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:50.739 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:50.734+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:50.944 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:50.940+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:51.003 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:50.999+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:51.009 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:51.004+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:51.509 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:51.505+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:51.715 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:51.712+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:51.748 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:51.744+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:51.958 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:51.954+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:52.005 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:52.000+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:52.043 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:52.039+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:52.536 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:52.531+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:52.688 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:52.682+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:52.763 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:52.759+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:52.977 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:52.972+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:52.998 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:52.994+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:53.010 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:53.006+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:53.576 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:53.571+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:53.715 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:53.711+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:53.763 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:53.759+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:53.977 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:53.973+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:54.007 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:54.003+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:54.041 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:54.037+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:54.617 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:22:54.612+0000 1694f700 -1 osd.4 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.776249+0000 front 2019-12-09T20:21:33.773656+0000 (oldest deadline 2019-12-09T20:22:14.255053+0000) 2019-12-09T20:22:54.691 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:22:54.687+0000 1694f700 -1 osd.1 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.146745+0000 front 2019-12-09T20:21:33.476603+0000 (oldest deadline 2019-12-09T20:22:13.031081+0000) 2019-12-09T20:22:54.756 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:22:54.750+0000 1694f700 -1 osd.7 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.773161+0000 front 2019-12-09T20:21:31.865751+0000 (oldest deadline 2019-12-09T20:22:16.152881+0000) 2019-12-09T20:22:54.996 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:22:54.993+0000 1694f700 -1 osd.0 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.586644+0000 front 2019-12-09T20:21:29.589272+0000 (oldest deadline 2019-12-09T20:22:15.097038+0000) 2019-12-09T20:22:55.015 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:22:55.011+0000 1694f700 -1 osd.6 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:31.660497+0000 front 2019-12-09T20:21:31.586463+0000 (oldest deadline 2019-12-09T20:22:15.009603+0000) 2019-12-09T20:22:55.080 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:22:55.077+0000 1694f700 -1 osd.3 672 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:21:33.108776+0000 front 2019-12-09T20:21:33.466040+0000 (oldest deadline 2019-12-09T20:22:15.316128+0000) 2019-12-09T20:22:55.220 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:22:55.210+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 42sec e672 v672) 2019-12-09T20:23:01.647 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:23:01.641+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T20:23:25.630 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:44:23.657 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:23:25.637 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:44:23.664 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:23:25.651 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:44:23.678 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:23:25.659 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:44:23.623 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:23:25.660 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:44:23.687 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:23:25.667 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:44:23.630 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:23:25.920 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:44:23.948 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:23:25.944 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:44:23.971 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:23:26.015 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:44:23.978 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:24:15.745 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:45:13.772 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:24:15.761 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:45:13.788 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:24:15.796 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:45:13.760 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:24:15.799 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:45:13.826 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:24:15.804 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:45:13.831 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:24:15.811 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:45:13.773 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:24:15.832 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:45:13.859 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:24:15.879 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:45:13.842 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:24:15.900 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:45:13.927 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:24:45.779 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:24:45.774+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:24:46.071 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:24:46.068+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:24:46.746 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:24:46.742+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:24:47.061 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:24:47.058+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:24:47.724 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:24:47.720+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:24:48.045 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:24:48.041+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:24:48.714 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:24:48.709+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:24:48.988 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:24:48.984+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:24:49.030 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:24:49.026+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:24:49.325 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:24:49.320+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:24:49.766 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:24:49.762+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:24:49.934 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:24:49.930+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:24:50.013 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:24:50.008+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:24:50.070 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:24:50.067+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:24:50.348 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:24:50.340+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:24:50.464 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:24:50.460+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:24:50.786 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:24:50.782+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:24:50.950 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:24:50.945+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:24:51.052 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:24:51.048+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:24:51.104 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:24:51.100+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:24:51.376 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:24:51.370+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:24:51.480 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:24:51.476+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:24:51.829 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:24:51.824+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:24:51.975 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:24:51.970+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:24:52.010 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:24:52.005+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:24:52.155 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:24:52.151+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:24:52.425 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:24:52.420+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:24:52.477 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:24:52.472+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:24:52.846 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:24:52.841+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:24:52.956 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:24:52.951+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:24:52.970 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:24:52.965+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:24:53.135 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:24:53.130+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:24:53.432 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:24:53.428+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:24:53.468 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:24:53.465+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:24:53.854 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:24:53.849+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:24:53.937 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:24:53.931+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:24:53.997 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:24:53.992+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:24:54.155 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:24:54.151+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:24:54.409 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:24:54.404+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:24:54.488 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:24:54.484+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:24:54.820 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:24:54.816+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:24:54.965 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:24:54.960+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:24:54.982 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:24:54.978+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:24:55.184 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:24:55.179+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:24:55.379 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:24:55.374+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:24:55.515 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:24:55.511+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:24:55.818 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:24:55.814+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:24:55.981 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:24:55.976+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:24:56.004 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:24:55.998+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:24:56.173 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:24:56.168+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:24:56.356 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:24:56.351+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:24:56.472 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:24:56.468+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:24:56.811 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:24:56.807+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:24:56.955 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:24:56.950+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:24:57.050 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:24:57.045+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:24:57.176 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:24:57.172+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:24:57.384 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:24:57.380+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:24:57.475 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:24:57.471+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:24:57.852 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:24:57.848+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:24:57.937 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:24:57.931+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:24:58.064 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:24:58.058+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:24:58.207 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:24:58.203+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:24:58.383 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:24:58.377+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:24:58.473 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:24:58.468+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:24:58.903 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:24:58.898+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:24:58.912 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:24:58.905+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:24:59.036 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:24:59.030+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:24:59.232 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:24:59.228+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:24:59.429 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:24:59.423+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:24:59.444 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:24:59.441+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:24:59.937 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:24:59.931+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:24:59.957 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:24:59.946+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:00.049 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:00.044+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:00.293 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:00.279+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:00.434 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:00.430+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:00.460 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:00.454+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:00.918 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:00.912+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:00.939 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:00.935+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:01.075 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:01.069+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:01.317 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:01.312+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:01.433 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:01.428+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:01.488 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:01.481+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:01.901 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:01.897+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:01.902 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:01.896+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:02.113 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:02.107+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:02.272 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:02.268+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:02.417 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:02.412+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:02.510 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:02.503+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:02.873 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:02.867+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:02.941 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:02.937+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:03.094 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:03.088+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:03.267 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:03.263+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:03.446 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:03.442+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:03.471 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:03.464+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:03.893 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:03.888+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:03.991 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:03.987+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:04.148 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:04.142+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:04.243 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:04.238+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:04.432 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:04.428+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:04.453 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:04.447+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:04.876 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:04.870+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:05.028 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:05.024+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:05.139 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:05.133+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:05.238 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:05.233+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:05.405 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:05.401+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:05.456 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:05.450+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:05.845 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:05.839+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:06.055 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:06.051+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:06.173 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:06.167+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:06.206 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:06.201+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:06.408 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:06.404+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:06.432 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:06.426+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:06.890 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:06.881+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:07.031 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:07.026+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:07.161 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:07.153+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:07.176 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:07.171+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:07.419 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:07.415+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:07.448 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:07.442+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:07.848 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:07.843+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:08.021 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:08.016+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:08.135 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:08.131+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:08.147 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:08.142+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:08.446 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:08.441+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:08.468 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:08.463+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:08.886 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:08.880+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:09.011 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:09.007+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:09.090 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:09.086+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:09.108 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:09.103+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:09.417 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:09.413+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:09.471 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:09.466+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:09.869 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:09.863+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:10.045 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:10.040+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:10.071 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:10.067+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:10.109 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:10.103+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:10.465 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:10.461+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:10.507 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:10.501+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:10.859 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:10.852+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:11.073 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:11.069+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:11.090 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:11.086+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:11.128 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:11.122+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:11.494 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:11.487+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:11.505 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:11.501+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:11.893 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:11.888+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:12.086 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:12.080+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:12.092 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:12.089+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:12.113 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:12.108+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:12.485 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:12.481+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:12.494 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:12.489+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:12.918 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:12.912+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:13.044 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:13.035+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:13.126 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:13.122+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:13.139 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:13.135+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:13.518 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:13.514+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:13.526 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:13.520+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:13.904 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:13.898+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:14.085 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:14.079+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:14.127 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:14.122+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:14.170 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:14.165+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:14.512 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:14.505+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:14.549 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:14.544+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:14.945 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:14.940+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:15.041 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:15.035+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:15.158 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:15.153+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:15.183 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:15.179+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:15.518 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:15.514+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:15.565 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:15.559+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:15.916 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:15.910+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:16.088 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:16.081+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:16.142 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:16.138+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:16.237 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:16.232+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:16.516 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:16.512+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:16.561 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:16.556+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:16.953 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:16.946+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:17.094 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:17.089+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:17.162 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:17.158+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:17.232 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:17.227+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:17.488 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:17.484+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:17.535 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:17.529+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:17.956 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:17.951+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:18.129 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:18.123+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:18.187 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:18.183+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:18.200 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:18.195+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:18.479 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:18.469+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:18.494 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:18.488+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:18.984 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:18.978+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:19.094 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:19.086+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:19.178 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:19.173+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:19.214 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:19.209+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:19.480 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:19.475+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:19.504 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:19.499+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:19.960 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:19.956+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:20.094 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:20.085+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:20.134 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:20.129+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:20.250 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:20.246+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:20.500 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:20.496+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:20.511 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:20.506+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:20.918 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:25:20.914+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 42sec e681 v681) 2019-12-09T20:25:21.007 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:21.003+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:21.088 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:21.084+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:21.174 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:21.169+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:21.301 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:21.297+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:21.457 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:21.452+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:21.555 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:21.552+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:22.050 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:22.045+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:22.091 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:22.086+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:22.184 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:22.179+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:22.350 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:22.346+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:22.466 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:22.459+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:22.605 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:22.601+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:23.068 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:23.063+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:23.084 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:23.079+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:23.211 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:23.206+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:23.316 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:23.312+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:23.515 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:23.508+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:23.597 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:23.593+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:24.075 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:24.071+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:24.088 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:24.083+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:24.196 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:24.191+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:24.362 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:24.357+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:24.474 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:24.470+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:24.561 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:24.557+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:25.125 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:25.120+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:25.132 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:25.128+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:25.155 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:25.150+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:25.404 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:25.400+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:25.505 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:25.501+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:25.527 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:25.522+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:26.009 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:25:26.007+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 42sec e681 v681) 2019-12-09T20:25:26.115 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:26.112+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:26.138 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:26.133+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:26.167 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:26.162+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:26.361 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:26.357+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:26.526 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:26.518+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:26.569 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:26.564+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:27.119 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:27.114+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:27.121 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:27.112+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:27.190 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:27.186+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:27.368 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:27.363+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:27.489 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:27.483+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:27.554 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:27.549+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:28.114 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:28.110+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:28.150 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:28.146+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:28.189 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:28.184+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:28.403 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:28.398+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:28.524 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:28.519+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:28.554 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:28.550+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:29.114 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:29.109+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:29.160 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:29.155+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:29.180 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:29.175+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:29.367 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:29.362+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:29.489 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:29.484+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:29.548 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:29.544+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:30.091 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:30.087+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:30.188 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:25:30.183+0000 1694f700 -1 osd.3 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.291119+0000 front 2019-12-09T20:24:03.292722+0000 (oldest deadline 2019-12-09T20:24:45.655409+0000) 2019-12-09T20:25:30.215 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:25:30.210+0000 1694f700 -1 osd.7 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.166243+0000 front 2019-12-09T20:24:03.169082+0000 (oldest deadline 2019-12-09T20:24:48.758533+0000) 2019-12-09T20:25:30.395 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:30.387+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:30.505 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:25:30.501+0000 1694f700 -1 osd.6 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.360796+0000 front 2019-12-09T20:24:03.292672+0000 (oldest deadline 2019-12-09T20:24:49.169103+0000) 2019-12-09T20:25:30.531 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:25:30.526+0000 1694f700 -1 osd.1 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.544658+0000 front 2019-12-09T20:24:04.558455+0000 (oldest deadline 2019-12-09T20:24:50.026056+0000) 2019-12-09T20:25:31.085 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:25:31.079+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 42sec e681 v681) 2019-12-09T20:25:31.087 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:25:31.082+0000 1694f700 -1 osd.4 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:04.605564+0000 front 2019-12-09T20:24:04.294695+0000 (oldest deadline 2019-12-09T20:24:49.368067+0000) 2019-12-09T20:25:31.349 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:25:31.345+0000 1694f700 -1 osd.0 681 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:24:03.460380+0000 front 2019-12-09T20:24:05.811020+0000 (oldest deadline 2019-12-09T20:24:45.729393+0000) 2019-12-09T20:25:37.770 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:25:37.762+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T20:27:20.389 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:20.386+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:20.520 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:20.514+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:21.369 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:21.358+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:21.542 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:21.538+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:21.793 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:21.786+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:22.187 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:22.183+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:22.358 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:22.354+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:22.546 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:22.542+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:22.576 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:22.572+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:22.698 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:22.693+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:22.813 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:22.808+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:23.227 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:23.220+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:23.393 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:23.389+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:23.575 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:23.570+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:23.602 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:23.598+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:23.730 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:23.726+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:23.780 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:23.775+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:24.200 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:24.196+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:24.419 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:24.414+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:24.625 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:24.620+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:24.634 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:24.628+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:24.724 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:24.720+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:24.737 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:24.733+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:25.251 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:25.246+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:25.392 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:25.387+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:25.634 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:25.630+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:25.644 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:25.639+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:25.710 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:25.705+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:25.792 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:25.786+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:26.243 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:26.239+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:26.388 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:26.384+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:26.617 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:26.613+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:26.648 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:26.644+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:26.745 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:26.741+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:26.748 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:26.744+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:27.236 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:27.232+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:27.375 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:27.370+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:27.626 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:27.620+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:27.661 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:27.657+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:27.714 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:27.709+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:27.717 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:27.712+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:27.976 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:48:26.003 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:27.991 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:48:26.018 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:27.998 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:48:25.961 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:27.999 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:48:26.027 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:28.003 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:48:25.966 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:28.004 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:48:26.031 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:28.202 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:48:26.230 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:28.203 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:28.199+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:28.203 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:48:26.231 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:28.270 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:48:26.233 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:27:28.338 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:28.335+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:28.674 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:28.669+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:28.677 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:28.674+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:28.687 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:28.683+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:28.755 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:28.752+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:29.229 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:29.225+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:29.380 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:29.374+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:29.641 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:29.637+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:29.644 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:29.640+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:29.649 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:29.645+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:29.735 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:29.730+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:30.229 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:30.225+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:30.421 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:30.417+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:30.641 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:30.638+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:30.660 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:30.655+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:30.676 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:30.671+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:30.764 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:30.759+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:31.192 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:31.187+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:31.449 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:31.445+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:31.630 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:31.625+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:31.650 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:31.647+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:31.668 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:31.662+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:31.789 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:31.783+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:32.227 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:32.223+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:32.423 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:32.418+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:32.647 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:32.643+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:32.671 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:32.667+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:32.689 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:32.685+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:32.787 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:32.782+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:33.248 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:33.243+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:33.444 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:33.440+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:33.666 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:33.661+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:33.679 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:33.674+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:33.691 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:33.686+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:33.812 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:33.807+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:34.216 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:34.211+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:34.482 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:34.477+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:34.661 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:34.655+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:34.696 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:34.692+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:34.712 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:34.705+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:34.796 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:34.790+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:35.173 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:35.168+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:35.504 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:35.500+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:35.664 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:35.656+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:35.699 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:35.694+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:35.739 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:35.733+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:35.787 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:35.777+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:36.185 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:36.182+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:36.498 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:36.494+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:36.695 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:36.689+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:36.706 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:36.702+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:36.731 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:36.726+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:36.769 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:36.764+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:37.172 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:37.168+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:37.531 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:37.527+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:37.675 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:37.671+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:37.680 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:37.675+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:37.715 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:37.709+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:37.800 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:37.795+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:38.221 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:38.217+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:38.526 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:38.522+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:38.674 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:38.668+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:38.686 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:38.682+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:38.701 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:38.696+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:38.820 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:38.814+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:39.273 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:39.268+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:39.498 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:39.494+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:39.669 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:39.664+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:39.690 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:39.686+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:39.721 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:39.715+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:39.813 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:39.807+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:40.263 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:40.258+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:40.509 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:40.505+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:40.627 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:40.621+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:40.742 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:40.738+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:40.756 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:40.749+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:40.768 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:40.762+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:41.253 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:41.249+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:41.507 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:41.503+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:41.606 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:41.601+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:41.764 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:41.758+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:41.774 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:41.769+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:41.816 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:41.811+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:42.221 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:42.217+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:42.466 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:42.461+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:42.620 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:42.615+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:42.786 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:42.780+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:42.804 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:42.799+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:42.806 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:42.800+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:43.180 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:43.176+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:43.433 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:43.428+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:43.643 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:43.637+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:43.754 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:43.748+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:43.806 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:43.800+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:43.827 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:43.823+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:44.160 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:44.156+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:44.416 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:44.412+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:44.660 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:44.654+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:44.724 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:44.719+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:44.777 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:44.770+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:44.838 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:44.828+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:45.158 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:45.154+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:45.395 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:45.391+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:45.682 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:45.676+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:45.691 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:45.686+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:45.788 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:45.783+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:45.825 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:45.820+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:46.207 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:46.203+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:46.430 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:46.426+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:46.676 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:46.671+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:46.696 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:46.691+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:46.777 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:46.773+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:46.852 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:46.846+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:47.245 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:47.240+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:47.445 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:47.441+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:47.661 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:47.656+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:47.680 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:47.674+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:47.743 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:47.739+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:47.884 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:47.878+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:48.297 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:48.292+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:48.450 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:48.446+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:48.638 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:48.632+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:48.700 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:48.694+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:48.735 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:48.731+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:48.895 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:48.889+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:49.341 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:49.337+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:49.443 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:49.432+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:49.613 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:49.607+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:49.735 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:49.730+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:49.750 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:49.744+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:49.933 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:49.927+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:50.308 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:50.303+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:50.469 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:50.465+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:50.583 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:50.578+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:50.750 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:50.746+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:50.771 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:50.765+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:50.911 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:50.906+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:51.337 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:51.333+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:51.450 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:51.446+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:51.591 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:51.586+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:51.763 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:51.760+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:51.803 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:51.797+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:51.939 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:51.933+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:52.366 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:52.362+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:52.452 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:52.449+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:52.560 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:52.554+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:52.730 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:52.726+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:52.813 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:52.807+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:52.974 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:52.968+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:53.390 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:53.386+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:53.446 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:53.442+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:53.557 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:53.552+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:53.687 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:53.683+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:53.778 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:53.772+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:53.954 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:53.948+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:54.376 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:54.372+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:54.475 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:54.470+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:54.588 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:54.582+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:54.639 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:54.635+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:54.753 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:54.748+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:54.913 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:54.908+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:55.352 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:55.348+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:55.444 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:55.441+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:55.591 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:55.586+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:55.603 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:55.599+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:55.735 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:55.731+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:55.890 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:55.886+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:56.390 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:56.386+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:56.442 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:56.437+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:56.555 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:27:56.552+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 47sec e689 v689) 2019-12-09T20:27:56.608 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:56.604+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:56.637 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:56.632+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:56.788 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:56.784+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:56.893 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:56.889+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:57.378 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:57.374+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:57.433 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:57.428+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:57.645 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:57.641+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:57.646 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:57.641+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:57.814 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:57.809+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:57.849 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:57.845+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:58.397 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:58.393+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:58.421 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:58.415+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:58.668 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:58.664+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:58.682 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:58.677+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:58.837 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:58.828+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:58.860 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:58.855+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:27:59.406 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:27:59.401+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:27:59.447 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:27:59.442+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:27:59.642 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:27:59.637+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:27:59.695 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:27:59.690+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:27:59.803 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:27:59.798+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:27:59.864 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:27:59.858+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:28:00.360 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:28:00.356+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:28:00.427 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:28:00.422+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:28:00.639 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:28:00.633+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:28:00.692 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:28:00.686+0000 1694f700 -1 osd.1 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.556357+0000 front 2019-12-09T20:26:35.293891+0000 (oldest deadline 2019-12-09T20:27:19.675463+0000) 2019-12-09T20:28:00.784 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:28:00.779+0000 1694f700 -1 osd.7 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.909066+0000 front 2019-12-09T20:26:37.992942+0000 (oldest deadline 2019-12-09T20:27:21.942188+0000) 2019-12-09T20:28:00.874 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:28:00.869+0000 1694f700 -1 osd.4 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.933276+0000 front 2019-12-09T20:26:37.717567+0000 (oldest deadline 2019-12-09T20:27:20.843054+0000) 2019-12-09T20:28:01.400 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:28:01.396+0000 1694f700 -1 osd.3 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:36.493859+0000 front 2019-12-09T20:26:37.679264+0000 (oldest deadline 2019-12-09T20:27:19.719832+0000) 2019-12-09T20:28:01.448 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:28:01.443+0000 1694f700 -1 osd.0 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:35.962776+0000 front 2019-12-09T20:26:35.998962+0000 (oldest deadline 2019-12-09T20:27:21.828784+0000) 2019-12-09T20:28:01.613 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:28:01.608+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 47sec e689 v689) 2019-12-09T20:28:01.669 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:28:01.665+0000 1694f700 -1 osd.6 689 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:26:37.679053+0000 front 2019-12-09T20:26:37.926220+0000 (oldest deadline 2019-12-09T20:27:21.958862+0000) 2019-12-09T20:28:07.793 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:28:07.785+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T20:28:57.300 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:49:55.325 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:28:57.308 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:49:55.334 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:28:57.381 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:49:55.408 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:28:57.403 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:49:55.430 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:28:57.407 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:49:55.369 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:28:57.408 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:49:55.431 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:28:57.420 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:49:55.384 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:28:57.495 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:49:55.523 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:28:57.546 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:49:55.510 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:29:49.074 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:29:49.069+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:29:50.058 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:29:50.054+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:29:50.386 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:29:50.381+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:29:51.026 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:29:51.022+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:29:51.138 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:29:51.132+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:29:51.341 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:29:51.337+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:29:51.767 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:29:51.762+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:29:52.065 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:29:52.060+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:29:52.142 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:29:52.138+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:29:52.303 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:29:52.298+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:29:52.747 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:29:52.743+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:29:53.049 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:29:53.046+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:29:53.156 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:29:53.151+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:29:53.286 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:29:53.282+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:29:53.541 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:29:53.536+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:29:53.711 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:29:53.707+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:29:53.967 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:29:53.963+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:29:54.091 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:29:54.086+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:29:54.207 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:29:54.203+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:29:54.290 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:29:54.286+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:29:54.587 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:29:54.582+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:29:54.752 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:29:54.748+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:29:54.957 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:29:54.953+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:29:55.124 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:29:55.119+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:29:55.169 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:29:55.164+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:29:55.297 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:29:55.292+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:29:55.571 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:29:55.567+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:29:55.717 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:29:55.713+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:29:55.935 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:29:55.930+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:29:56.081 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:29:56.076+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:29:56.195 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:29:56.191+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:29:56.268 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:29:56.263+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:29:56.557 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:29:56.551+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:29:56.767 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:29:56.762+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:29:56.953 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:29:56.948+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:29:57.064 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:29:57.060+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:29:57.194 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:29:57.190+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:29:57.273 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:29:57.266+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:29:57.600 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:29:57.595+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:29:57.802 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:29:57.797+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:29:57.928 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:29:57.923+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:29:58.027 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:29:58.022+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:29:58.205 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:29:58.202+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:29:58.293 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:29:58.289+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:29:58.585 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:29:58.580+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:29:58.790 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:29:58.786+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:29:58.964 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:29:58.960+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:29:59.008 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:29:59.004+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:29:59.175 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:29:59.170+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:29:59.329 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:29:59.320+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:29:59.545 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:29:59.540+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:29:59.817 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:29:59.813+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:00.000 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:29:59.996+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:00.011 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:00.006+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:00.166 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:00.161+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:00.339 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:00.334+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:00.589 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:00.584+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:00.799 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:00.795+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:01.025 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:01.021+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:01.064 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:01.060+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:01.148 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:01.143+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:01.313 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:01.308+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:01.553 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:01.548+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:01.811 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:01.807+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:02.068 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:02.065+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:02.104 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:02.100+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:02.112 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:02.107+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:02.329 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:02.324+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:02.613 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:02.599+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:02.777 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:02.771+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:03.099 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:03.095+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:03.121 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:03.116+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:03.155 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:03.151+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:03.355 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:03.350+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:03.608 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:03.604+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:03.744 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:03.740+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:04.082 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:04.079+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:04.115 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:04.111+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:04.203 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:04.198+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:04.343 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:04.338+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:04.648 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:04.642+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:04.723 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:04.719+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:05.095 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:05.091+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:05.127 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:05.122+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:05.240 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:05.235+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:05.367 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:05.362+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:05.682 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:05.670+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:05.745 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:05.741+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:06.068 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:06.063+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:06.087 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:06.082+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:06.246 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:06.241+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:06.368 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:06.363+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:06.721 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:06.716+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:06.738 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:06.734+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:07.086 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:07.082+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:07.118 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:07.113+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:07.262 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:07.258+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:07.330 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:07.326+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:07.711 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:07.706+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:07.765 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:07.761+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:08.129 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:08.125+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:08.149 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:08.144+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:08.229 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:08.225+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:08.367 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:08.363+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:08.698 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:08.692+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:08.791 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:08.786+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:09.105 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:09.099+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:09.145 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:09.140+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:09.215 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:09.211+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:09.372 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:09.362+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:09.715 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:09.708+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:09.753 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:09.749+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:10.151 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:10.145+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:10.153 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:10.149+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:10.196 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:10.192+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:10.349 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:10.344+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:10.751 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:10.746+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:10.789 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:10.785+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:11.120 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:11.113+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:11.124 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:11.120+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:11.213 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:11.207+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:11.319 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:11.313+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:11.757 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:11.751+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:11.791 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:11.786+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:12.094 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:12.090+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:12.113 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:12.107+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:12.206 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:12.202+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:12.310 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:12.305+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:12.781 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:12.775+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:12.799 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:12.794+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:13.117 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:13.113+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:13.124 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:13.118+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:13.179 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:13.174+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:13.340 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:13.334+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:13.746 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:13.740+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:13.794 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:13.791+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:14.120 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:14.116+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:14.125 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:14.120+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:14.206 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:14.201+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:14.371 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:14.365+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:14.781 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:14.775+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:14.840 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:14.835+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:15.140 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:15.135+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:15.149 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:15.145+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:15.220 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:15.216+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:15.391 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:15.385+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:15.832 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:15.826+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:15.876 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:15.872+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:16.166 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:16.162+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:16.170 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:16.164+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:16.239 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:16.235+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:16.437 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:16.431+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:16.884 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:16.876+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:16.893 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:16.890+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:17.127 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:17.122+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:17.162 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:17.157+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:17.217 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:17.213+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:17.435 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:17.429+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:17.853 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:17.848+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:17.900 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:17.896+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:18.089 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:18.085+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:18.186 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:18.179+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:18.210 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:18.205+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:18.395 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:18.388+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:18.829 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:18.822+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:18.871 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:18.868+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:19.126 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:19.121+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:19.151 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:19.147+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:19.261 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:19.256+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:19.409 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:19.404+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:19.861 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:19.852+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:19.918 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:19.914+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:20.118 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:20.114+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:20.194 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:20.190+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:20.265 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:20.260+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:20.441 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:20.435+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:20.897 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:20.892+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:20.967 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:20.963+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:21.126 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:21.121+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:21.225 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:21.221+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:21.229 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:21.222+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:21.453 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:21.447+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:21.919 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:21.914+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:21.963 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:21.959+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:22.179 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:22.175+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:22.216 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:22.210+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:22.240 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:22.235+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:22.430 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:22.424+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:22.487 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:30:22.484+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e697 v697) 2019-12-09T20:30:22.965 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:22.959+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:22.979 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:22.975+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:23.179 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:23.175+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:23.237 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:23.230+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:23.277 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:23.270+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:23.434 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:23.428+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:23.961 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:23.958+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:24.020 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:24.013+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:24.169 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:24.165+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:24.236 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:24.229+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:24.305 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:24.301+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:24.403 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:24.398+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:24.986 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:24.983+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:25.037 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:25.031+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:25.162 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:25.158+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:25.271 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:25.265+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:25.343 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:25.339+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:25.422 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:25.417+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:26.001 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:25.997+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:26.063 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:26.057+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:26.162 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:26.158+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:26.267 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:26.262+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:26.345 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:26.341+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:26.443 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:26.438+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:27.056 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:27.050+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:27.115 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:27.109+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:27.188 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:27.183+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:27.250 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:27.245+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:27.388 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:27.384+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:27.481 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:27.476+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:27.501 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:30:27.498+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e697 v697) 2019-12-09T20:30:28.035 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:28.031+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:28.147 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:28.139+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:28.160 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:28.154+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:28.229 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:28.223+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:28.389 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:28.385+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:28.436 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:28.429+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:29.083 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:29.079+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:29.162 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:29.157+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:29.169 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:29.163+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:29.240 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:29.229+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:29.442 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:29.438+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:29.464 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:29.459+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:30.043 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:30.039+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:30.137 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:30.132+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:30.195 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:30.191+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:30.248 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:30.243+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:30.456 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:30.451+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:30.459 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:30.455+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:31.068 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:31.063+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:31.162 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:31.152+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:31.173 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:31.168+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:31.289 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:31.284+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:31.426 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:31.421+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:31.510 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:31.505+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:32.080 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:30:32.077+0000 1694f700 -1 osd.3 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.997837+0000 front 2019-12-09T20:29:08.038397+0000 (oldest deadline 2019-12-09T20:29:51.374353+0000) 2019-12-09T20:30:32.164 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:30:32.158+0000 1694f700 -1 osd.1 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:08.502272+0000 front 2019-12-09T20:29:08.487088+0000 (oldest deadline 2019-12-09T20:29:52.975639+0000) 2019-12-09T20:30:32.192 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:30:32.188+0000 1694f700 -1 osd.4 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:07.961918+0000 front 2019-12-09T20:29:07.704612+0000 (oldest deadline 2019-12-09T20:29:52.867191+0000) 2019-12-09T20:30:32.336 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:30:32.331+0000 1694f700 -1 osd.6 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.292442+0000 front 2019-12-09T20:29:06.337862+0000 (oldest deadline 2019-12-09T20:29:50.363206+0000) 2019-12-09T20:30:32.380 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:30:32.376+0000 1694f700 -1 osd.0 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:06.028874+0000 front 2019-12-09T20:29:08.989468+0000 (oldest deadline 2019-12-09T20:29:48.892615+0000) 2019-12-09T20:30:32.478 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:30:32.473+0000 1694f700 -1 osd.7 697 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:29:05.768744+0000 front 2019-12-09T20:29:06.060726+0000 (oldest deadline 2019-12-09T20:29:50.379112+0000) 2019-12-09T20:30:32.564 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:30:32.560+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e697 v697) 2019-12-09T20:30:39.984 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:30:39.977+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T20:31:03.416 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:31:03.411+0000 1694f700 -1 osd.4 699 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:140766 7.9 7:9dc32cef:lc::lc.19:head [call lock.lock in=50b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e698) 2019-12-09T20:31:04.417 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:31:04.412+0000 1694f700 -1 osd.4 699 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:140766 7.9 7:9dc32cef:lc::lc.19:head [call lock.lock in=50b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e698) 2019-12-09T20:31:14.274 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:31:14.220+0000 1694f700 -1 osd.5 697 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:140766 7.9 7:9dc32cef:lc::lc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e694) 2019-12-09T20:31:20.868 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:31:20.629+0000 35a77700 -1 osd.5 702 build_incremental_map_msg missing incremental map 702 2019-12-09T20:31:21.935 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:31:21.817+0000 39a7f700 -1 osd.5 703 build_incremental_map_msg missing incremental map 702 2019-12-09T20:31:30.212 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:52:28.240 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:31:30.220 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:52:28.247 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:31:30.239 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:52:28.266 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:31:30.245 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:52:28.208 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:31:30.248 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:52:28.275 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:31:30.254 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:52:28.217 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:31:30.431 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:52:28.458 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:31:30.440 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:52:28.467 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:31:30.503 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:52:28.466 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:32:21.365 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:21.358+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:21.958 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:21.953+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:22.320 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:22.314+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:22.988 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:22.983+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:23.123 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:23.119+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:23.322 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:23.315+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:23.969 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:23.964+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:24.132 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:24.128+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:24.154 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:24.149+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:24.217 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:24.213+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:24.342 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:24.337+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:24.935 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:24.929+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:25.150 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:25.146+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:25.172 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:25.168+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:25.209 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:25.198+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:25.299 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:25.294+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:25.955 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:25.949+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:25.980 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:25.975+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:26.146 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:26.142+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:26.186 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:26.181+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:26.196 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:26.191+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:26.325 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:26.320+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:26.929 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:26.924+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:27.031 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:27.026+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:27.145 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:27.141+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:27.165 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:27.160+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:27.176 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:27.171+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:27.285 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:27.279+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:27.889 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:27.884+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:27.992 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:27.987+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:28.127 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:28.124+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:28.136 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:28.132+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:28.164 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:28.160+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:28.324 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:28.320+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:28.922 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:28.917+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:29.023 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:29.019+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:29.139 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:29.135+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:29.169 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:29.160+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:29.205 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:29.200+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:29.335 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:29.331+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:29.921 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:29.916+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:30.071 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:30.066+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:30.154 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:30.151+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:30.183 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:30.180+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:30.245 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:30.242+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:30.375 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:30.371+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:30.901 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:30.897+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:31.025 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:31.020+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:31.118 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:31.113+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:31.215 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:31.212+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:31.224 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:31.220+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:31.329 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:31.324+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:31.909 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:31.905+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:32.057 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:32.053+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:32.127 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:32.124+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:32.182 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:32.178+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:32.196 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:32.192+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:32.316 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:32.312+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:32.895 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:32.891+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:33.030 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:33.025+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:33.157 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:33.153+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:33.161 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:33.158+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:33.220 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:33.217+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:33.300 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:33.295+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:33.924 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:33.919+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:34.009 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:34.002+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:34.138 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:34.133+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:34.186 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:34.182+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:34.201 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:34.198+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:34.264 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:34.260+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:34.928 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:34.923+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:35.001 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:34.996+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:35.098 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:35.094+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:35.219 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:35.215+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:35.229 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:35.224+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:35.231 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:35.228+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:35.891 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:35.887+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:36.004 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:35.999+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:36.126 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:36.123+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:36.208 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:36.204+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:36.233 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:36.227+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:36.263 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:36.259+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:36.917 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:36.912+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:36.966 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:36.962+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:37.181 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:37.177+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:37.228 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:37.225+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:37.259 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:37.255+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:37.260 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:37.254+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:37.913 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:37.908+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:37.971 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:37.967+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:38.152 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:38.148+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:38.189 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:38.184+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:38.230 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:53:36.257 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:32:38.234 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:38.231+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:38.279 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:53:36.306 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:32:38.300 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:53:36.264 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:32:38.301 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:53:36.265 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:32:38.306 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:53:36.333 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:32:38.311 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:53:36.339 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:32:38.312 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:38.307+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:38.345 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:53:36.372 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:32:38.379 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:53:36.342 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:32:38.404 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:53:36.431 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:32:38.949 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:38.944+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:38.980 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:38.975+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:39.154 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:39.150+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:39.215 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:39.211+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:39.264 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:39.260+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:39.323 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:39.319+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:39.936 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:39.931+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:39.967 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:39.963+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:40.132 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:40.129+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:40.244 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:40.241+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:40.248 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:40.245+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:40.302 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:40.298+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:40.962 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:40.957+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:40.980 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:40.975+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:41.153 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:41.148+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:41.206 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:41.201+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:41.288 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:41.282+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:41.324 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:41.320+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:41.936 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:41.932+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:41.965 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:41.961+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:42.138 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:42.135+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:42.232 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:42.229+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:42.259 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:42.256+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:42.318 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:42.313+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:42.946 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:42.942+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:42.952 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:42.947+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:43.192 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:43.189+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:43.227 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:43.223+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:43.300 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:43.296+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:43.348 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:43.336+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:43.978 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:43.971+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:43.997 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:43.992+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:44.186 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:44.183+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:44.207 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:44.203+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:44.345 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:44.342+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:44.357 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:44.352+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:45.007 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:45.001+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:45.010 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:45.005+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:45.155 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:45.151+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:45.206 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:45.202+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:45.338 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:45.333+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:45.389 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:45.384+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:45.986 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:45.980+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:46.052 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:46.046+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:46.197 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:46.192+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:46.211 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:46.206+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:46.353 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:46.349+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:46.359 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:46.353+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:46.989 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:46.984+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:47.059 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:47.054+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:47.165 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:47.161+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:47.251 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:47.246+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:47.342 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:47.336+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:47.389 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:47.384+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:48.006 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:48.000+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:48.061 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:48.056+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:48.181 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:48.177+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:48.301 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:48.295+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:48.374 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:48.370+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:48.389 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:48.380+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:49.014 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:49.009+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:49.036 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:49.030+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:49.154 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:49.150+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:49.289 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:49.285+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:49.356 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:49.351+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:49.416 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:49.411+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:50.004 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:49.999+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:50.022 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:50.016+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:50.109 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:50.104+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:50.272 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:50.268+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:50.328 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:50.323+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:50.452 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:50.448+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:50.998 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:50.993+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:51.015 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:51.010+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:51.133 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:51.127+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:51.281 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:51.277+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:51.311 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:51.306+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:51.436 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:51.431+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:51.953 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:51.948+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:52.053 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:52.047+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:52.148 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:52.145+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:52.241 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:52.237+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:52.302 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:52.295+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:52.465 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:52.457+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:52.951 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:52.946+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:53.034 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:53.028+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:53.180 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:53.175+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:53.235 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:32:53.231+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 39sec e707 v707) 2019-12-09T20:32:53.287 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:53.284+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:53.292 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:53.287+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:53.438 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:53.434+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:53.994 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:53.988+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:54.079 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:54.074+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:54.173 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:54.169+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:54.247 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:54.241+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:54.326 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:54.322+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:54.428 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:54.424+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:55.041 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:55.028+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:55.089 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:55.083+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:55.191 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:55.185+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:55.253 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:55.248+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:55.287 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:55.283+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:55.438 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:55.434+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:56.022 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:56.016+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:56.058 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:56.050+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:56.149 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:56.145+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:56.238 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:56.233+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:56.250 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:56.246+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:56.482 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:56.479+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:56.988 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:56.983+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:57.086 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:57.081+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:57.128 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:57.124+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:57.249 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:57.245+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:57.282 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:57.276+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:57.464 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:57.460+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:58.043 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:58.037+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:58.100 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:58.096+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:58.138 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:58.132+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:58.247 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:32:58.245+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 39sec e707 v707) 2019-12-09T20:32:58.256 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:58.252+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:58.267 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:58.262+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:58.506 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:58.502+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:32:59.071 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:32:59.065+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:32:59.101 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:32:59.097+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:32:59.186 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:32:59.180+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:32:59.235 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:32:59.230+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:32:59.261 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:32:59.255+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:32:59.484 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:32:59.481+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:33:00.083 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:33:00.078+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:33:00.084 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:33:00.077+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:33:00.157 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:33:00.152+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:33:00.228 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:33:00.224+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:33:00.298 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:33:00.293+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:33:00.468 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:33:00.464+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:33:01.041 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:33:01.036+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:33:01.065 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:33:01.060+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:33:01.115 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:33:01.110+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:33:01.206 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:33:01.202+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:33:01.344 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:33:01.338+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:33:01.453 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:33:01.450+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:33:02.053 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:33:02.048+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:33:02.119 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:33:02.115+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:33:02.149 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:33:02.144+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:33:02.247 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:33:02.243+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:33:02.389 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:33:02.384+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:33:02.475 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:33:02.471+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:33:03.067 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:33:03.062+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:33:03.152 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:33:03.146+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:33:03.152 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:33:03.148+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:33:03.233 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:33:03.229+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:33:03.267 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:33:03.264+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 39sec e707 v707) 2019-12-09T20:33:03.390 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:33:03.384+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:33:03.504 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:33:03.499+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:33:04.103 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:33:04.097+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:33:04.112 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:33:04.103+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:33:04.171 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:33:04.165+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:33:04.208 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:33:04.202+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:33:04.421 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:33:04.416+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:33:04.535 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:33:04.530+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:33:05.058 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:33:05.054+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:33:05.070 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:33:05.065+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:33:05.133 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:33:05.128+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:33:05.227 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:33:05.222+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:33:05.414 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:33:05.410+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:33:05.580 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:33:05.575+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:33:06.033 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:33:06.028+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:33:06.056 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:33:06.051+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:33:06.150 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:33:06.146+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:33:06.217 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:33:06.213+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:33:06.429 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:33:06.424+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:33:06.602 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:33:06.599+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:33:07.007 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:33:07.003+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:33:07.048 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:33:07.044+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:33:07.198 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:33:07.194+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:33:07.260 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:33:07.256+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:33:07.392 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:33:07.387+0000 1694f700 -1 osd.7 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:42.876105+0000 front 2019-12-09T20:31:41.679570+0000 (oldest deadline 2019-12-09T20:32:21.294827+0000) 2019-12-09T20:33:07.624 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:33:07.620+0000 1694f700 -1 osd.1 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.207087+0000 front 2019-12-09T20:31:42.877289+0000 (oldest deadline 2019-12-09T20:32:23.734590+0000) 2019-12-09T20:33:08.003 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:33:07.999+0000 1694f700 -1 osd.3 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.168725+0000 front 2019-12-09T20:31:39.079765+0000 (oldest deadline 2019-12-09T20:32:23.093815+0000) 2019-12-09T20:33:08.053 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:33:08.048+0000 1694f700 -1 osd.4 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:39.807688+0000 front 2019-12-09T20:31:39.809266+0000 (oldest deadline 2019-12-09T20:32:25.050164+0000) 2019-12-09T20:33:08.221 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:33:08.217+0000 1694f700 -1 osd.6 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.019028+0000 front 2019-12-09T20:31:41.947021+0000 (oldest deadline 2019-12-09T20:32:21.450571+0000) 2019-12-09T20:33:08.282 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:33:08.279+0000 1694f700 -1 osd.0 707 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:31:40.091868+0000 front 2019-12-09T20:31:42.855766+0000 (oldest deadline 2019-12-09T20:32:24.145573+0000) 2019-12-09T20:33:08.309 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:33:08.305+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 39sec e707 v707) 2019-12-09T20:33:16.098 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:33:16.090+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T20:34:57.074 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:34:57.070+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:34:57.680 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:34:57.675+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:34:58.075 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:34:58.071+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:34:58.487 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:34:58.481+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:34:58.676 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:34:58.671+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:34:58.702 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:34:58.699+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:34:59.098 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:34:59.095+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:34:59.474 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:34:59.469+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:34:59.477 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:34:59.472+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:34:59.637 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:34:59.632+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:34:59.665 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:34:59.662+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:00.105 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:00.101+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:00.503 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:00.497+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:00.518 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:00.512+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:00.600 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:00.595+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:00.654 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:00.650+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:01.157 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:01.153+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:01.477 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:01.473+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:01.538 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:01.533+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:01.561 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:01.557+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:01.697 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:01.693+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:02.201 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:02.197+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:02.525 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:02.520+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:02.529 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:02.525+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:02.609 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:02.604+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:02.680 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:02.676+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:03.217 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:03.213+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:03.525 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:03.520+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:03.530 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:03.525+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:03.569 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:03.564+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:03.709 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:03.706+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:04.239 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:04.235+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:04.486 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:04.481+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:04.532 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:04.527+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:04.574 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:04.570+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:04.698 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:04.694+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:05.227 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:05.223+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:05.497 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:05.493+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:05.502 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:05.498+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:05.603 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:05.598+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:05.745 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:05.742+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:06.194 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:06.190+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:06.526 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:06.520+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:06.535 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:06.531+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:06.611 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:06.606+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:06.717 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:06.711+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:07.169 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:07.165+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:07.522 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:07.518+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:07.566 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:07.561+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:07.639 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:07.634+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:07.738 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:07.734+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:08.186 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:08.181+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:08.542 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:08.537+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:08.583 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:08.578+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:08.616 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:08.611+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:08.757 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:08.754+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:09.168 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:09.165+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:09.549 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:09.545+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:09.554 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:09.549+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:09.620 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:09.615+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:09.740 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:09.735+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:10.223 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:10.219+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:10.584 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:10.580+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:10.585 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:10.581+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:10.619 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:10.614+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:10.710 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:10.706+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:11.205 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:11.200+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:11.589 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:11.585+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:11.594 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:11.589+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:11.617 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:11.613+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:11.753 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:11.749+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:12.203 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:12.200+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:12.570 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:12.565+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:12.606 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:12.602+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:12.627 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:12.623+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:12.725 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:12.721+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:13.199 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:13.196+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:13.566 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:13.562+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:13.589 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:13.586+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:13.597 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:13.593+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:13.687 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:13.683+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:14.237 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:14.234+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:14.607 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:14.602+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:14.609 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:14.605+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:14.649 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:14.645+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:14.688 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:14.680+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:15.239 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:15.235+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:15.604 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:15.601+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:15.630 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:15.625+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:15.638 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:15.632+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:15.659 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:15.655+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:16.250 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:16.246+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:16.591 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:16.587+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:16.624 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:16.621+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:16.627 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:16.623+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:16.648 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:16.644+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:17.296 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:17.291+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:17.566 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:17.561+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:17.587 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:17.584+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:17.645 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:17.640+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:17.662 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:17.658+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:18.254 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:18.251+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:18.601 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:18.596+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:18.609 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:18.604+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:18.629 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:18.625+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:18.702 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:18.697+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:19.263 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:19.259+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:19.585 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:19.581+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:19.593 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:19.587+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:19.644 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:19.638+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:19.733 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:19.728+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:20.255 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:20.250+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:20.607 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:20.603+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:20.617 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:20.611+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:20.639 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:20.633+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:20.712 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:20.706+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:21.279 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:21.275+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:21.583 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:21.577+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:21.641 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:21.636+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:21.655 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:21.650+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:21.752 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:21.747+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:22.272 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:22.268+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:22.591 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:22.587+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:22.639 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:22.634+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:22.680 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:22.675+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:22.738 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:22.734+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:23.258 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:23.254+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:23.554 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:23.548+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:23.611 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:23.606+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:23.658 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:23.655+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:23.728 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:23.723+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:23.964 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:23.960+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:24.244 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:24.240+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:24.528 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:24.523+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:24.610 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:24.605+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:24.659 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:24.655+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:24.697 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:24.691+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:25.003 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:24.998+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:25.268 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:25.264+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:25.490 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:25.484+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:25.608 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:25.603+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:25.688 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:25.684+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:25.739 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:25.734+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:26.045 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:26.042+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:26.274 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:26.272+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:26.483 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:26.477+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:26.596 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:26.590+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:26.709 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:26.705+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:26.771 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:26.766+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:27.095 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:27.091+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:27.321 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:27.317+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:27.473 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:27.467+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:27.632 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:27.626+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:27.758 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:27.754+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:27.770 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:27.766+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:28.132 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:28.128+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:28.320 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:28.317+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:28.476 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:28.470+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:28.625 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:28.614+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:28.774 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:28.766+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:28.783 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:28.780+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:28.814 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:35:28.808+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e717 v717) 2019-12-09T20:35:29.104 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:29.099+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:29.306 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:29.302+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:29.456 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:29.449+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:29.632 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:29.628+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:29.824 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:29.819+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:29.837 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:29.833+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:30.132 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:30.124+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:30.330 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:30.327+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:30.490 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:30.484+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:30.629 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:30.624+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:30.778 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:30.773+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:30.873 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:30.870+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:31.097 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:31.094+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:31.356 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:31.352+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:31.478 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:31.472+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:31.662 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:31.654+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:31.784 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:31.778+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:31.885 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:31.882+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:32.093 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:32.090+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:32.335 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:32.331+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:32.475 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:32.470+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:32.624 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:32.619+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:32.836 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:32.831+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:32.934 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:32.929+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:33.081 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:33.078+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:33.325 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:33.319+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:33.469 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:33.464+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:33.624 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:33.618+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:33.803 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:33.798+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:33.833 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:35:33.830+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e717 v717) 2019-12-09T20:35:33.920 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:33.916+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:34.103 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:34.095+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:34.327 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:34.322+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:34.461 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:34.455+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:34.631 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:34.625+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:34.824 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:34.819+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:34.888 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:34.878+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:35.149 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:35.146+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:35.376 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:35.371+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:35.480 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:35.474+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:35.591 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:35.585+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:35.817 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:35.811+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:35.850 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:35.846+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:36.167 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:36.163+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:36.358 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:36.354+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:36.509 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:36.503+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:36.638 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:36.628+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:36.841 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:36.836+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:36.870 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:36.867+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:37.146 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:37.143+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:37.339 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:37.335+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:37.539 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:37.534+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:37.619 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:37.613+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:37.803 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:37.798+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:37.909 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:37.904+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:38.150 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:38.146+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:38.328 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:38.324+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:38.531 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:38.524+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:38.619 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:38.614+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:38.779 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:38.774+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:38.852 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:35:38.848+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e717 v717) 2019-12-09T20:35:38.899 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:38.895+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:39.146 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:39.142+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:39.299 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:39.294+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:39.564 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:39.558+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:39.610 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:39.603+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:39.819 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:39.814+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:39.895 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:39.892+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:40.173 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:40.168+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:40.256 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:40.252+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:40.536 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:40.532+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:40.581 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:40.576+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:40.874 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:40.869+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:40.889 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:40.886+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:41.218 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:41.214+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:41.247 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:41.244+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:41.581 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:41.576+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:41.587 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:41.583+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:41.846 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:41.841+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:41.940 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:41.936+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:42.229 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:42.225+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:42.248 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:42.245+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:42.340 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:56:40.368 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.351 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:56:40.379 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.357 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:56:40.384 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.360 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:56:40.388 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.365 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:56:40.328 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.372 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:56:40.336 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.550 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:42.546+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:42.559 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:10:56:40.587 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.583 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:10:56:40.610 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.616 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:10:56:40.580 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:35:42.628 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:42.624+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:42.846 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:42.841+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:42.958 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:42.953+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:43.275 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:43.271+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:43.289 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:35:43.286+0000 1694f700 -1 osd.0 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.945149+0000 front 2019-12-09T20:34:17.733838+0000 (oldest deadline 2019-12-09T20:35:23.287822+0000) 2019-12-09T20:35:43.552 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:35:43.547+0000 1694f700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:15.068697+0000 front 2019-12-09T20:34:15.073232+0000 (oldest deadline 2019-12-09T20:34:57.171312+0000) 2019-12-09T20:35:43.641 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:35:43.636+0000 1694f700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:11.453037+0000 front 2019-12-09T20:34:15.256191+0000 (oldest deadline 2019-12-09T20:34:58.136238+0000) 2019-12-09T20:35:43.865 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:35:43.861+0000 1694f700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.962145+0000 front 2019-12-09T20:34:17.964474+0000 (oldest deadline 2019-12-09T20:34:59.036658+0000) 2019-12-09T20:35:43.986 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:35:43.982+0000 1694f700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.964427+0000 front 2019-12-09T20:34:17.883769+0000 (oldest deadline 2019-12-09T20:34:57.857200+0000) 2019-12-09T20:35:44.069 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:35:44.064+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 43sec e717 v717) 2019-12-09T20:35:44.285 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:35:44.282+0000 1694f700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:34:17.579958+0000 front 2019-12-09T20:34:11.790366+0000 (oldest deadline 2019-12-09T20:34:56.625057+0000) 2019-12-09T20:35:52.211 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:35:52.204+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T20:36:14.384 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:36:14.382+0000 1694f700 -1 osd.1 719 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:141063 7.8 7:162a24ce:lc::lc.8:head [call lock.unlock in=34b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e718) 2019-12-09T20:36:15.352 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:36:15.349+0000 1694f700 -1 osd.1 719 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:141063 7.8 7:162a24ce:lc::lc.8:head [call lock.unlock in=34b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e718) 2019-12-09T20:37:25.492 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:25.486+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:26.480 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:26.472+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:26.826 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:26.822+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:27.448 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:27.442+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:27.790 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:27.786+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:28.457 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:28.450+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:28.680 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:28.673+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:28.761 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:28.758+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:29.477 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:29.473+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:29.639 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:29.633+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:29.719 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:29.713+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:29.800 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:29.796+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:30.125 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:30.121+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:30.471 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:30.465+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:30.669 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:30.664+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:30.686 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:30.681+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:30.700 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:30.697+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:30.801 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:30.796+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:31.175 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:31.165+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:31.445 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:31.440+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:31.653 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:31.648+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:31.669 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:31.666+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:31.670 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:31.665+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:31.833 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:31.830+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:32.161 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:32.157+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:32.459 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:32.454+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:32.631 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:32.626+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:32.646 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:32.637+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:32.648 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:32.643+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:32.854 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:32.851+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:33.155 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:33.151+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:33.453 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:33.448+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:33.624 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:33.618+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:33.658 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:33.653+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:33.685 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:33.680+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:33.814 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:33.810+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:34.134 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:34.128+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:34.462 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:34.456+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:34.637 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:34.632+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:34.709 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:34.704+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:34.730 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:34.725+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:34.813 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:34.809+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:35.093 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:35.090+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:35.437 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:35.432+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:35.662 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:35.657+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:35.670 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:35.665+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:35.724 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:35.720+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:35.783 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:35.779+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:36.084 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:36.082+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:36.484 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:36.479+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:36.638 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:36.634+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:36.640 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:36.636+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:36.736 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:36.730+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:36.740 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:36.735+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:37.088 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:37.082+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:37.466 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:37.462+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:37.629 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:37.625+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:37.634 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:37.628+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:37.743 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:37.740+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:37.780 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:37.777+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:38.121 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:38.117+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:38.477 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:38.471+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:38.607 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:38.602+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:38.659 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:38.655+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:38.705 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:38.701+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:38.808 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:38.804+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:39.093 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:39.090+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:39.490 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:39.485+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:39.566 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:39.561+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:39.674 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:39.671+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:39.707 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:39.704+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:39.802 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:39.797+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:40.116 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:40.113+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:40.506 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:40.497+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:40.544 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:40.539+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:40.688 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:40.685+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:40.730 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:40.725+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:40.829 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:40.825+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:41.094 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:41.090+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:41.497 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:41.493+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:41.531 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:41.526+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:41.655 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:41.652+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:41.728 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:41.725+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:41.881 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:41.877+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:42.079 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:42.075+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:42.510 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:42.505+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:42.552 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:42.547+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:42.691 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:42.687+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:42.763 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:42.758+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:42.902 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:42.892+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:43.084 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:43.075+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:43.525 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:43.520+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:43.546 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:43.541+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:43.687 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:43.683+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:43.750 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:43.745+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:43.859 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:43.856+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:44.123 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:44.119+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:44.502 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:44.497+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:44.544 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:44.540+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:44.724 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:44.720+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:44.741 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:44.737+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:44.869 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:44.865+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:45.126 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:45.121+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:45.532 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:45.522+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:45.532 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:45.525+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:45.771 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:45.766+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:45.775 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:45.772+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:45.849 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:45.846+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:46.080 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:46.076+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:46.485 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:46.480+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:46.551 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:46.546+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:46.786 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:46.783+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:46.810 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:46.806+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:46.860 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:46.857+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:47.098 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:47.093+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:47.459 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:47.455+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:47.555 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:47.550+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:47.777 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:47.772+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:47.819 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:47.815+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:47.836 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:47.832+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:48.134 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:48.130+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:48.447 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:48.443+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:48.546 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:48.541+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:48.777 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:48.772+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:48.802 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:48.797+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:48.824 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:48.819+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:49.161 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:49.157+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:49.448 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:49.443+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:49.550 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:49.545+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:49.775 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:49.772+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:49.776 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:49.773+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:49.791 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:49.787+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:50.157 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:50.154+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:50.446 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:50.442+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:50.555 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:50.551+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:50.753 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:50.750+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:50.786 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:50.781+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:50.794 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:50.790+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:51.148 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:51.144+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:51.454 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:51.451+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:51.534 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:51.528+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:51.754 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:51.750+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:51.761 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:51.757+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:51.842 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:51.837+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:52.143 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:52.139+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:52.452 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:52.448+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:52.526 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:52.521+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:52.737 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:52.731+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:52.781 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:52.777+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:52.815 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:52.809+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:53.101 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:53.097+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:53.446 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:53.441+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:53.574 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:53.568+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:53.770 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:53.766+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:53.773 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:53.770+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:53.847 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:53.842+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:54.112 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:54.108+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:54.448 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:54.442+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:54.545 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:54.539+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:54.810 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:54.806+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:54.812 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:54.808+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:54.865 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:54.858+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:55.125 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:55.120+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:55.456 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:55.444+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:55.501 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:55.497+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:55.828 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:55.824+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:55.850 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:55.845+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:55.852 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:55.849+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:56.085 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:56.082+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:56.465 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:56.460+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:56.522 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:56.516+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:56.794 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:56.791+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:56.866 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:56.861+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:56.868 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:56.864+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:57.055 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:57.051+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:57.488 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:57.482+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:57.531 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:57.525+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:57.791 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:57.787+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:57.872 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:57.867+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:57.894 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:57.889+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:58.024 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:58.020+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:58.528 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:58.522+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:58.533 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:58.528+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:58.751 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:58.746+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:58.845 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:58.841+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:58.920 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:58.915+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:37:59.046 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:37:59.043+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:37:59.500 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:37:59.495+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:37:59.577 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:37:59.571+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:37:59.635 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:37:59.629+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e726 v726) 2019-12-09T20:37:59.771 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:37:59.768+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:37:59.813 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:37:59.810+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:37:59.931 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:37:59.925+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:38:00.089 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:38:00.085+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:38:00.532 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:38:00.526+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:38:00.541 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:38:00.536+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:38:00.818 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:38:00.813+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:38:00.836 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:38:00.832+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:38:00.937 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:38:00.931+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:38:01.113 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:38:01.109+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:38:01.496 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:38:01.491+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:38:01.547 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:38:01.541+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:38:01.832 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:38:01.828+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:38:01.852 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:38:01.849+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:38:01.950 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:38:01.944+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:38:02.137 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:38:02.134+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:38:02.457 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:38:02.452+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:38:02.599 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:38:02.593+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:38:02.835 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:38:02.832+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:38:02.859 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:38:02.855+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:38:02.915 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:38:02.909+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:38:03.093 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:38:03.090+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:38:03.488 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:38:03.483+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:38:03.656 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:38:03.648+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:38:03.838 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:38:03.834+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:38:03.845 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:38:03.841+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:38:03.899 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:38:03.894+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:38:04.147 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:38:04.143+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:38:04.505 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:38:04.500+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:38:04.657 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:38:04.653+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e726 v726) 2019-12-09T20:38:04.692 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:38:04.684+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:38:04.810 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:38:04.805+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:38:04.859 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:38:04.855+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:38:04.868 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:38:04.859+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:38:05.114 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:38:05.110+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:38:05.521 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:38:05.516+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:38:05.726 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:38:05.720+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:38:05.777 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:38:05.773+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:38:05.866 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:38:05.862+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:38:05.883 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:38:05.879+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:38:06.143 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:38:06.139+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:38:06.497 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:38:06.492+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:38:06.732 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:38:06.726+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:38:06.750 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:38:06.747+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:38:06.879 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:38:06.875+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:38:06.879 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:38:06.870+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:38:07.164 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:38:07.160+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:38:07.475 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:38:07.470+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:38:07.765 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:38:07.759+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:38:07.774 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:38:07.770+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:38:07.844 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:38:07.838+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:38:07.854 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:38:07.850+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:38:08.150 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:38:08.147+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:38:08.493 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:38:08.489+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:38:08.732 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:38:08.727+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:38:08.801 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:38:08.797+0000 1694f700 -1 osd.3 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.448941+0000 front 2019-12-09T20:36:47.447447+0000 (oldest deadline 2019-12-09T20:37:29.979177+0000) 2019-12-09T20:38:08.833 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:38:08.828+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:38:08.898 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:38:08.894+0000 1694f700 -1 osd.1 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.153660+0000 front 2019-12-09T20:36:46.146122+0000 (oldest deadline 2019-12-09T20:37:26.088903+0000) 2019-12-09T20:38:09.184 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:38:09.180+0000 1694f700 -1 osd.0 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.220714+0000 front 2019-12-09T20:36:47.345141+0000 (oldest deadline 2019-12-09T20:37:29.650184+0000) 2019-12-09T20:38:09.508 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:38:09.502+0000 1694f700 -1 osd.7 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:47.599536+0000 front 2019-12-09T20:36:43.368887+0000 (oldest deadline 2019-12-09T20:37:25.461894+0000) 2019-12-09T20:38:09.735 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:38:09.723+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 45sec e726 v726) 2019-12-09T20:38:09.741 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:38:09.735+0000 1694f700 -1 osd.4 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:48.062268+0000 front 2019-12-09T20:36:45.027187+0000 (oldest deadline 2019-12-09T20:37:27.675352+0000) 2019-12-09T20:38:09.837 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:38:09.829+0000 1694f700 -1 osd.6 726 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:36:43.367205+0000 front 2019-12-09T20:36:43.359067+0000 (oldest deadline 2019-12-09T20:37:29.214800+0000) 2019-12-09T20:38:18.329 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:38:18.323+0000 1a89c700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg recovery_unfound (PG_DAMAGED) 2019-12-09T20:39:45.222 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:00:43.250 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:39:45.233 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:00:43.261 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:39:45.243 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:00:43.271 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:39:45.248 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:00:43.275 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:39:45.253 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:00:43.217 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:39:45.275 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:00:43.238 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:39:45.510 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:00:43.538 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:39:45.526 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:00:43.553 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:39:45.588 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:00:43.552 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:40:21.952 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:21.950+0000 1694f700 -1 osd.3 736 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:141184 7.5 7:abd89f08:lc::lc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e736) 2019-12-09T20:40:22.912 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:22.908+0000 1694f700 -1 osd.3 736 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:141184 7.5 7:abd89f08:lc::lc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e736) 2019-12-09T20:40:23.890 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:23.887+0000 1694f700 -1 osd.3 736 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:141184 7.5 7:abd89f08:lc::lc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e736) 2019-12-09T20:40:24.874 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:24.872+0000 1694f700 -1 osd.3 736 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:141184 7.5 7:abd89f08:lc::lc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e736) 2019-12-09T20:40:25.906 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:25.903+0000 1694f700 -1 osd.3 736 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:141184 7.5 7:abd89f08:lc::lc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e736) 2019-12-09T20:40:26.923 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:26.920+0000 1694f700 -1 osd.3 736 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:141184 7.5 7:abd89f08:lc::lc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e736) 2019-12-09T20:40:27.888 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:27.885+0000 1694f700 -1 osd.3 736 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:141184 7.5 7:abd89f08:lc::lc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e736) 2019-12-09T20:40:28.879 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:28.876+0000 1694f700 -1 osd.3 736 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:141184 7.5 7:abd89f08:lc::lc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e736) 2019-12-09T20:40:29.862 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:29.859+0000 1694f700 -1 osd.3 736 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:141184 7.5 7:abd89f08:lc::lc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e736) 2019-12-09T20:40:30.830 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:30.828+0000 1694f700 -1 osd.3 736 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:141184 7.5 7:abd89f08:lc::lc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e736) 2019-12-09T20:40:31.877 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:31.875+0000 1694f700 -1 osd.3 736 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:141184 7.5 7:abd89f08:lc::lc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e736) 2019-12-09T20:40:32.921 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:32.918+0000 1694f700 -1 osd.3 736 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:141184 7.5 7:abd89f08:lc::lc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e736) 2019-12-09T20:40:33.889 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:33.886+0000 1694f700 -1 osd.3 736 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:141184 7.5 7:abd89f08:lc::lc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e736) 2019-12-09T20:40:34.889 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:34.886+0000 1694f700 -1 osd.3 736 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:141184 7.5 7:abd89f08:lc::lc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e736) 2019-12-09T20:40:41.906 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:41.901+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:42.152 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:42.149+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:42.377 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:42.372+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:42.701 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:42.698+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:42.926 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:42.923+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:43.187 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:43.181+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:43.339 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:43.332+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:43.400 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:43.395+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:43.721 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:43.718+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:43.965 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:43.961+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:44.209 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:44.206+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:44.356 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:44.351+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:44.406 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:44.400+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:44.748 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:44.745+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:44.994 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:44.991+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:45.196 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:45.193+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:45.344 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:45.339+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:45.354 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:40:45.350+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:40:45.424 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:45.418+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:45.769 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:45.766+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:46.028 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:46.026+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:46.199 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:46.189+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:46.341 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:40:46.336+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:40:46.379 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:46.374+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:46.383 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:46.378+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:46.746 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:46.744+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:47.024 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:47.021+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:47.205 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:47.203+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:47.334 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:40:47.329+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:40:47.374 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:47.369+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:47.375 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:47.369+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:47.726 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:47.724+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:48.054 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:48.051+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:48.163 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:48.159+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:48.309 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:40:48.300+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:40:48.352 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:48.346+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:48.397 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:48.391+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:48.737 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:48.734+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:49.070 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:49.067+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:49.118 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:49.116+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:49.269 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:40:49.265+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:40:49.333 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:49.328+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:49.361 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:49.356+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:49.786 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:49.783+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:50.039 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:50.036+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:50.099 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:50.095+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:50.246 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:40:50.241+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:40:50.379 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:50.374+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:50.380 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:50.376+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:50.772 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:50.769+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:50.995 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:50.991+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:51.151 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:51.147+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:51.256 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:40:51.252+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:40:51.343 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:51.339+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:51.383 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:51.377+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:51.738 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:51.735+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:52.021 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:52.017+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:52.152 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:52.149+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:52.286 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:40:52.281+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:40:52.374 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:52.369+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:52.429 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:52.424+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:52.751 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:52.747+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:53.044 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:53.040+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:53.187 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:53.182+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:53.255 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:40:53.251+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:40:53.355 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:53.351+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:53.406 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:53.401+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:53.780 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:53.777+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:54.038 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:54.034+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:54.144 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:54.140+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:54.300 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:40:54.296+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:40:54.399 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:54.393+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:54.414 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:54.409+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:54.780 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:54.776+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:55.069 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:55.065+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:55.112 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:55.106+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:55.267 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:40:55.263+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:40:55.449 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:55.445+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:55.489 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:55.479+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:55.833 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:55.829+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:56.069 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:56.065+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:56.161 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:56.158+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:56.290 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:40:56.285+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:40:56.436 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:56.432+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:56.468 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:56.463+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:56.883 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:56.880+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:57.121 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:57.117+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:57.169 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:57.166+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:57.282 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:40:57.278+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:40:57.434 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:57.429+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:57.471 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:57.467+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:57.846 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:57.842+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:58.135 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:58.131+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:58.201 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:58.197+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:58.298 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:40:58.293+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:40:58.430 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:58.426+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:58.514 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:58.509+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:58.819 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:58.815+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:40:59.185 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:40:59.181+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:40:59.206 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:40:59.202+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:40:59.317 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:40:59.313+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:40:59.421 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:40:59.417+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:40:59.528 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:40:59.525+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:40:59.851 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:40:59.847+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:00.172 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:00.168+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:00.233 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:00.229+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:00.361 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:00.358+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:00.388 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:00.384+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:00.493 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:00.488+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:00.620 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:01:58.648 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:00.668 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:01:58.696 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:00.715 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:01:58.742 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:00.721 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:01:58.684 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:00.721 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:01:58.749 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:00.726 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:01:58.690 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:00.807 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:01:58.835 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:00.850 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:00.847+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:00.860 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:01:58.888 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:00.883 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:01:58.847 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:41:01.161 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:01.157+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:01.205 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:01.200+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:01.360 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:01.355+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:01.379 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:01.374+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:01.468 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:01.464+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:01.897 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:01.893+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:02.148 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:02.143+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:02.172 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:02.169+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:02.405 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:02.396+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:02.411 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:02.407+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:02.513 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:02.509+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:02.873 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:02.869+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:03.105 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:03.101+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:03.181 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:03.176+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:03.362 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:03.358+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:03.407 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:03.403+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:03.566 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:03.561+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:03.869 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:03.865+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:04.130 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:04.125+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:04.232 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:04.228+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:04.352 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:04.348+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:04.397 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:04.392+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:04.561 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:04.556+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:04.874 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:04.869+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:05.133 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:05.125+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:05.207 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:05.204+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:05.383 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:05.379+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:05.444 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:05.441+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:05.542 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:05.537+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:05.831 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:05.828+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:06.113 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:06.109+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:06.194 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:06.190+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:06.414 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:06.410+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:06.477 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:06.473+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:06.589 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:06.584+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:06.853 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:06.850+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:07.114 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:07.112+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:07.163 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:07.158+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:07.398 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:07.394+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:07.437 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:07.433+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:07.557 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:07.552+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:07.820 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:07.817+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:08.104 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:08.100+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:08.189 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:08.185+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:08.382 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:08.376+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:08.428 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:08.422+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:08.612 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:08.606+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:08.815 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:08.811+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:09.120 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:09.116+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:09.191 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:09.187+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:09.368 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:09.355+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:09.430 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:09.425+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:09.603 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:09.590+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:09.794 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:09.790+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:10.100 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:10.096+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:10.240 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:10.236+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:10.369 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:10.364+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:10.455 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:10.450+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:10.645 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:10.636+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:10.813 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:10.808+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:11.125 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:11.121+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:11.256 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:11.247+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:11.378 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:11.372+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:11.451 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:11.445+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:11.602 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:11.596+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:11.807 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:11.803+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:12.161 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:12.157+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:12.234 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:12.231+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:12.351 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:12.346+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:12.466 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:12.461+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:12.625 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:12.608+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:12.794 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:12.790+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:13.166 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:13.162+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:13.232 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:13.223+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:13.320 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:13.312+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:13.487 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:13.481+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:13.597 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:13.591+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:13.791 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:13.787+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:14.220 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:14.216+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:14.229 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:14.226+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:14.278 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:14.273+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:14.452 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:14.445+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:14.617 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:14.611+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:14.810 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:14.807+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:15.213 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:15.209+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:15.251 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:15.247+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:15.260 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:15.255+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:15.489 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:15.485+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:15.639 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:15.633+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:15.677 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:41:15.674+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 37sec e736 v736) 2019-12-09T20:41:15.854 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:15.850+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:16.233 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:16.229+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:16.288 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:16.284+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:16.292 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:16.287+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:16.462 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:16.456+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:16.616 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:16.611+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:16.886 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:16.883+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:17.211 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:17.206+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:17.246 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:17.242+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:17.342 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:17.337+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:17.474 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:17.469+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:17.619 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:17.614+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:17.908 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:17.904+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:18.191 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:18.186+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:18.263 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:18.260+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:18.330 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:18.325+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:18.469 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:18.464+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:18.626 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:18.621+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:18.924 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:18.921+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:19.154 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:19.149+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:19.300 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:19.296+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:19.319 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:19.313+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:19.516 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:19.511+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:19.625 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:19.620+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:19.975 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:19.972+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:20.183 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:20.178+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:20.274 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:20.269+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:20.349 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:20.344+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:20.476 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:20.471+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:20.618 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:20.614+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:20.697 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:41:20.692+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 37sec e736 v736) 2019-12-09T20:41:20.949 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:20.945+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:21.203 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:21.200+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:21.307 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:21.302+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:21.318 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:21.314+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:21.517 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:21.512+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:21.578 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:21.574+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:21.997 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:21.994+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:22.194 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:22.190+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:22.321 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:22.317+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:22.345 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:22.338+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:22.496 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:22.491+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:22.628 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:22.624+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:22.980 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:22.977+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:23.237 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:23.233+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:23.275 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:23.271+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:23.339 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:23.334+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:23.547 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:23.541+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:23.668 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:23.663+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:24.020 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:24.017+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:24.228 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:24.223+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:24.244 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:24.240+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:24.359 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:24.354+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:24.501 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:24.496+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:24.659 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:24.654+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:24.985 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:24.981+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:25.234 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:25.231+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:25.264 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:25.260+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:25.374 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:25.370+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:25.531 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:25.525+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:25.634 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:25.629+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:25.770 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:41:25.762+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 37sec e736 v736) 2019-12-09T20:41:25.959 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:25.955+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:26.244 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:26.241+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:26.251 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:26.248+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:26.346 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:26.340+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:26.510 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:26.504+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:26.597 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:26.591+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:26.931 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:26.929+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:27.232 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:27.229+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.778798+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:27.244 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:27.241+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:27.312 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:27.307+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:27.550 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:27.545+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:27.603 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:41:27.598+0000 1694f700 -1 osd.4 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:06.965459+0000 front 2019-12-09T20:40:05.986126+0000 (oldest deadline 2019-12-09T20:40:42.307868+0000) 2019-12-09T20:41:27.970 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:27.965+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:40:06.985187+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:28.228 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:41:28.224+0000 1694f700 -1 osd.1 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:41:28.192815+0000 front 2019-12-09T20:40:05.623719+0000 (oldest deadline 2019-12-09T20:40:42.121511+0000) 2019-12-09T20:41:28.259 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:41:28.256+0000 1694f700 -1 osd.3 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.968213+0000 front 2019-12-09T20:40:05.971291+0000 (oldest deadline 2019-12-09T20:40:41.443168+0000) 2019-12-09T20:41:28.317 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:28.313+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:28.547 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:41:28.532+0000 35a77700 -1 osd.5 736 build_incremental_map_msg missing incremental map 702 2019-12-09T20:41:28.553 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:28.549+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:28.994 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:28.990+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:41:28.441463+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:29.310 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:41:29.306+0000 1694f700 -1 osd.7 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.562374+0000 front 2019-12-09T20:39:58.555198+0000 (oldest deadline 2019-12-09T20:40:42.521501+0000) 2019-12-09T20:41:29.545 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:29.541+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:29.992 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:41:29.988+0000 1694f700 -1 osd.0 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:40:05.294763+0000 front 2019-12-09T20:41:28.441463+0000 (oldest deadline 2019-12-09T20:40:42.578731+0000) 2019-12-09T20:41:30.517 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:30.512+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:41:30.785 INFO:tasks.ceph.mon.a.smithi121.stderr:2019-12-09T20:41:30.782+0000 1a89c700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.132:6818/10194,v1:172.21.15.132:6819/10194] for 51sec e736 v736) 2019-12-09T20:41:31.488 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:41:31.484+0000 1694f700 -1 osd.6 736 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:39:58.585921+0000 front 2019-12-09T20:39:58.740434+0000 (oldest deadline 2019-12-09T20:40:44.460120+0000) 2019-12-09T20:44:00.690 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:00.687+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:01.712 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:01.708+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:02.062 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:02.057+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:02.666 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:02.663+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:02.885 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:02.880+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:03.057 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:03.053+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:03.652 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:03.648+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:03.854 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:03.849+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:04.066 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:04.064+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:04.311 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:04.307+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:04.625 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:04.622+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:04.676 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:04.671+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:04.771 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:04.768+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:04.844 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:04.840+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:05.041 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:05.037+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:05.269 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:05.264+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:05.607 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:05.604+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:05.631 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:05.627+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:05.790 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:05.785+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:05.855 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:05.850+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:06.041 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:06.037+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:06.243 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:06.239+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:06.612 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:06.608+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:06.662 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:06.653+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:06.760 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:06.756+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:06.848 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:06.844+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:07.039 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:07.035+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:07.233 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:07.229+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:07.628 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:07.624+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:07.675 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:07.671+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:07.732 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:07.730+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:07.852 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:07.848+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:08.062 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:08.057+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:08.275 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:08.270+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:08.661 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:08.657+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:08.664 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:08.660+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:08.779 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:08.776+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:08.882 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:08.877+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:09.068 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:09.064+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:09.315 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:09.311+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:09.638 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:09.633+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:09.677 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:09.672+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:09.738 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:09.734+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:09.852 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:09.848+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:10.039 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:10.035+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:10.367 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:10.362+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:10.659 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:10.655+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:10.667 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:10.663+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:10.704 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:10.700+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:10.827 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:10.823+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:11.075 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:11.071+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:11.344 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:11.333+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:11.684 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:11.678+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:11.714 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:11.709+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:11.720 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:11.715+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:11.830 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:11.826+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:12.097 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:12.093+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:12.334 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:12.330+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:12.679 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:12.674+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:12.724 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:12.720+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:12.762 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:12.758+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:12.802 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:12.797+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:13.080 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:13.076+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:13.305 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:13.302+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:13.700 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:13.695+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:13.725 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:13.721+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:13.796 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:13.792+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:13.813 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:13.809+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:14.047 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:14.043+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:14.318 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:14.314+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:14.670 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:14.666+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:14.686 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:14.683+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:14.760 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:05:12.788 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:14.771 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:05:12.799 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:14.771 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:05:12.799 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:14.774 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:05:12.738 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:14.776 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:05:12.804 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:14.778 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:05:12.742 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:14.797 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:14.794+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:14.837 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:14.832+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:14.938 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:05:12.965 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:14.976 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:05:13.004 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:15.001 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:14.999+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:15.046 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:05:13.010 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:44:15.360 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:15.356+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:15.630 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:15.626+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:15.705 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:15.702+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:15.822 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:15.819+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:15.847 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:15.843+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:16.034 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:16.031+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:16.370 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:16.366+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:16.591 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:16.587+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:16.713 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:16.709+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:16.781 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:16.777+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:16.881 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:16.877+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:17.069 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:17.066+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:17.419 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:17.415+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:17.600 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:17.594+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:17.721 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:17.719+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:17.747 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:17.744+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:17.875 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:17.871+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:18.061 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:18.057+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:18.442 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:18.437+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:18.560 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:18.556+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:18.708 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:18.704+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:18.721 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:18.719+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:18.879 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:18.875+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:19.037 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:19.031+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:19.434 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:19.430+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:19.590 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:19.586+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:19.686 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:19.682+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:19.762 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:19.759+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:19.887 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:19.883+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:20.078 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:20.075+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:20.417 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:20.412+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:20.574 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:20.570+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:20.652 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:20.647+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:20.791 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:20.788+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:20.925 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:20.920+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:21.054 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:21.050+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:21.396 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:21.390+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:21.603 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:21.595+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:21.669 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:21.665+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:21.795 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:21.791+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:21.933 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:21.928+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:22.035 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:22.032+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:22.440 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:22.433+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:22.584 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:22.578+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:22.697 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:22.694+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:22.799 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:22.791+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:22.941 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:22.936+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:22.990 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:22.987+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:23.492 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:23.487+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:23.606 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:23.597+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:23.667 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:23.663+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:23.817 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:23.809+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:23.961 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:23.956+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:24.029 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:24.025+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:24.498 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:24.488+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:24.632 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:24.625+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:24.710 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:24.707+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:24.852 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:24.849+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:25.003 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:24.998+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:25.051 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:25.049+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:25.525 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:25.520+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:25.669 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:25.662+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:25.742 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:25.739+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:25.818 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:25.815+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:26.041 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:26.035+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:26.070 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:26.068+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:26.484 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:26.480+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:26.653 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:26.647+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:26.699 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:26.697+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:26.832 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:26.829+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:27.041 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:27.037+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:27.093 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:27.088+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:27.508 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:27.502+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:27.620 INFO:tasks.ceph.osd.4.smithi132.stderr:2019-12-09T20:44:27.615+0000 1694f700 -1 osd.4 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.980166+0000 front 2019-12-09T20:43:18.963616+0000 (oldest deadline 2019-12-09T20:44:04.441630+0000) 2019-12-09T20:44:27.667 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:27.664+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:27.793 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:27.791+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:43:25.237440+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:28.015 INFO:tasks.ceph.osd.0.smithi121.stderr:2019-12-09T20:44:28.012+0000 1694f700 -1 osd.0 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.467606+0000 front 2019-12-09T20:43:19.103376+0000 (oldest deadline 2019-12-09T20:44:01.343909+0000) 2019-12-09T20:44:28.076 INFO:tasks.ceph.osd.7.smithi132.stderr:2019-12-09T20:44:28.071+0000 1694f700 -1 osd.7 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:16.744248+0000 front 2019-12-09T20:43:16.749172+0000 (oldest deadline 2019-12-09T20:44:02.290409+0000) 2019-12-09T20:44:28.541 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:28.537+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:28.712 INFO:tasks.ceph.osd.3.smithi121.stderr:2019-12-09T20:44:28.710+0000 1694f700 -1 osd.3 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:19.234453+0000 front 2019-12-09T20:43:19.520361+0000 (oldest deadline 2019-12-09T20:44:00.267650+0000) 2019-12-09T20:44:28.832 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:28.830+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:44:28.138901+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:29.064 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:44:29.060+0000 1694f700 -1 osd.5 741 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:142175 7.c 7:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e741) 2019-12-09T20:44:29.560 INFO:tasks.ceph.osd.6.smithi132.stderr:2019-12-09T20:44:29.555+0000 1694f700 -1 osd.6 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:18.584515+0000 front 2019-12-09T20:43:18.582468+0000 (oldest deadline 2019-12-09T20:44:04.236913+0000) 2019-12-09T20:44:29.883 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:29.879+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:44:28.138901+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:30.071 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:44:30.066+0000 1694f700 -1 osd.5 741 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:142175 7.c 7:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e741) 2019-12-09T20:44:30.875 INFO:tasks.ceph.osd.1.smithi121.stderr:2019-12-09T20:44:30.873+0000 1694f700 -1 osd.1 741 heartbeat_check: no reply from 172.21.15.132:6822 osd.5 since back 2019-12-09T20:43:20.089388+0000 front 2019-12-09T20:44:28.138901+0000 (oldest deadline 2019-12-09T20:44:04.310642+0000) 2019-12-09T20:44:31.073 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:44:31.065+0000 1694f700 -1 osd.5 741 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:142175 7.c 7:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e741) 2019-12-09T20:44:32.060 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:44:32.055+0000 1694f700 -1 osd.5 741 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:142175 7.c 7:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e741) 2019-12-09T20:44:33.098 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:44:33.094+0000 1694f700 -1 osd.5 741 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:142175 7.c 7:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e741) 2019-12-09T20:44:34.142 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:44:34.137+0000 1694f700 -1 osd.5 741 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:142175 7.c 7:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e741) 2019-12-09T20:44:35.131 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:44:35.126+0000 1694f700 -1 osd.5 741 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:142175 7.c 7:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e741) 2019-12-09T20:44:36.177 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:44:36.173+0000 1694f700 -1 osd.5 741 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:142175 7.c 7:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e741) 2019-12-09T20:44:37.180 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:44:37.174+0000 1694f700 -1 osd.5 741 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:142175 7.c 7:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e741) 2019-12-09T20:44:38.136 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:44:38.132+0000 1694f700 -1 osd.5 741 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:142175 7.c 7:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e741) 2019-12-09T20:44:39.115 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:44:39.111+0000 1694f700 -1 osd.5 741 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:142175 7.c 7:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e741) 2019-12-09T20:44:40.096 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:44:40.089+0000 1694f700 -1 osd.5 741 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:142175 7.c 7:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e741) 2019-12-09T20:44:41.108 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:44:41.104+0000 1694f700 -1 osd.5 741 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:142175 7.c 7:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e741) 2019-12-09T20:44:42.136 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:44:42.132+0000 1694f700 -1 osd.5 741 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:142175 7.c 7:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e741) 2019-12-09T20:44:43.196 INFO:tasks.ceph.osd.5.smithi132.stderr:2019-12-09T20:44:43.193+0000 1694f700 -1 osd.5 741 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:142175 7.c 7:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected e741) 2019-12-09T20:44:56.685 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerListing (test.functional.tests.TestContainerPaths) ... ok 2019-12-09T20:45:09.041 INFO:teuthology.orchestra.run.smithi121.stderr:testStructure (test.functional.tests.TestContainerPaths) ... ok 2019-12-09T20:45:16.949 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:06:14.977 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:45:16.955 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:06:14.983 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:45:17.025 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:06:15.053 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:45:17.030 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:06:15.058 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:45:17.057 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:06:15.082 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:45:17.057 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:06:15.018 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:45:17.059 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:06:15.023 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:45:17.097 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:06:15.124 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:45:17.142 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:06:15.106 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:45:26.934 INFO:teuthology.orchestra.run.smithi121.stderr:testTraverseContainer (test.functional.tests.TestContainerPaths) ... ok 2019-12-09T20:47:15.377 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:47:20.195 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerFileList (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:47:23.711 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:47:27.812 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:47:28.259 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerInfo (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:47:28.751 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:47:42.236 INFO:teuthology.orchestra.run.smithi121.stderr:testContainerNameLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:47:48.135 INFO:teuthology.orchestra.run.smithi121.stderr:testCreate (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:48:01.828 INFO:teuthology.orchestra.run.smithi121.stderr:testDelete (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:48:02.341 INFO:teuthology.orchestra.run.smithi121.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:48:08.040 INFO:teuthology.orchestra.run.smithi121.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:48:08.574 INFO:teuthology.orchestra.run.smithi121.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:49:03.793 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:10:01.821 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:03.804 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:10:01.832 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:03.816 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:10:01.844 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:03.826 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:10:01.854 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:03.831 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:10:01.795 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:03.842 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:10:01.806 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:03.965 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:10:01.993 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:04.063 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:10:02.091 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:04.081 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:10:02.045 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:22.674 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:10:20.702 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:22.702 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:10:20.666 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:22.720 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:10:20.748 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:22.721 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:10:20.749 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:22.722 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:10:20.749 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:22.742 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:10:20.770 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:22.765 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:10:20.793 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:22.776 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:10:20.740 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:49:22.811 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:10:20.775 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:50:03.179 INFO:teuthology.orchestra.run.smithi121.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:50:07.072 INFO:teuthology.orchestra.run.smithi121.stderr:testFileOrder (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:50:25.860 INFO:teuthology.orchestra.run.smithi121.stderr:testFileThenContainerDelete (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:50:34.414 INFO:teuthology.orchestra.run.smithi121.stderr:testLastFileMarker (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:51:22.762 INFO:teuthology.orchestra.run.smithi121.stderr:testMarkerLimitFileList (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:52:45.705 INFO:teuthology.orchestra.run.smithi121.stderr:testPrefixAndLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:52:46.507 INFO:teuthology.orchestra.run.smithi121.stderr:testTooLongName (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:53:58.802 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:14:56.830 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:58.812 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:14:56.840 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:58.823 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:14:56.850 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:58.830 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:14:56.858 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:58.839 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:14:56.803 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:58.847 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:14:56.811 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:59.043 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:14:57.071 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:59.061 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:14:57.089 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:53:59.105 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:14:57.069 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:54:15.849 INFO:teuthology.orchestra.run.smithi121.stderr:testUnorderedList (test.functional.tests.TestContainerUTF8) ... ok 2019-12-09T20:57:44.578 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:18:42.606 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:44.606 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:18:42.633 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:44.654 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:18:42.681 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:44.655 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:18:42.683 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:44.678 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:18:42.642 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:44.687 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:18:42.652 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:44.758 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:18:42.786 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:44.791 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:18:42.819 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:57:44.801 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:18:42.766 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:59:09.540 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:20:07.568 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:59:09.552 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:20:07.580 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:59:09.567 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:20:07.595 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:59:09.577 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:20:07.605 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:59:09.577 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:20:07.541 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:59:09.586 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:20:07.551 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:59:09.636 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:20:07.664 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T20:59:09.670 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:20:07.698 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T20:59:09.801 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:20:07.766 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T20:59:17.154 INFO:teuthology.orchestra.run.smithi121.stderr:test_get_manifest (test.functional.tests.TestDlo) ... ok 2019-12-09T20:59:18.295 INFO:teuthology.orchestra.run.smithi121.stderr:test_get_manifest_document_itself (test.functional.tests.TestDlo) ... ok 2019-12-09T20:59:26.012 INFO:teuthology.orchestra.run.smithi121.stderr:test_get_range (test.functional.tests.TestDlo) ... ok 2019-12-09T20:59:27.079 INFO:teuthology.orchestra.run.smithi121.stderr:test_get_range_out_of_range (test.functional.tests.TestDlo) ... ok 2019-12-09T21:00:39.198 INFO:teuthology.orchestra.run.smithi121.stderr:test_get_manifest (test.functional.tests.TestDloUTF8) ... ok 2019-12-09T21:00:39.802 INFO:teuthology.orchestra.run.smithi121.stderr:test_get_manifest_document_itself (test.functional.tests.TestDloUTF8) ... ok 2019-12-09T21:00:45.748 INFO:teuthology.orchestra.run.smithi121.stderr:test_get_range (test.functional.tests.TestDloUTF8) ... ok 2019-12-09T21:00:47.253 INFO:teuthology.orchestra.run.smithi121.stderr:test_get_range_out_of_range (test.functional.tests.TestDloUTF8) ... ok 2019-12-09T21:01:25.959 INFO:teuthology.orchestra.run.smithi121.stderr:testBadHeaders (test.functional.tests.TestFile) ... ok 2019-12-09T21:01:26.769 INFO:teuthology.orchestra.run.smithi121.stderr:testBlankMetadataName (test.functional.tests.TestFile) ... ok 2019-12-09T21:04:21.106 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:25:19.134 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T21:04:21.119 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:25:19.147 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T21:04:21.128 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:25:19.156 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T21:04:21.132 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:25:19.160 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T21:04:21.140 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:25:19.105 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T21:04:21.156 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:25:19.121 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T21:04:21.323 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:25:19.351 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T21:04:21.323 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:25:19.352 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T21:04:21.435 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:25:19.399 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T21:06:06.451 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:27:04.479 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T21:06:06.457 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:27:04.485 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T21:06:06.479 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:27:04.506 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T21:06:06.481 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:27:04.509 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T21:06:06.504 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:27:04.469 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T21:06:06.512 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:27:04.477 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T21:06:06.525 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:27:04.553 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T21:06:06.542 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:27:04.570 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T21:06:06.663 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:27:04.628 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:31.959 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:30:29.987 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:31.967 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:30:29.996 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:31.976 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:30:30.005 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:31.979 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:30:30.008 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:31.980 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:30:29.945 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:31.995 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:30:29.960 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:32.088 INFO:tasks.ceph.mon.a.smithi121.stderr:==00:11:30:30.117 9026== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:32.133 INFO:tasks.ceph.mon.c.smithi121.stderr:==00:11:30:30.161 9027== Warning: unimplemented fcntl command: 1036 2019-12-09T21:09:32.149 INFO:tasks.ceph.mon.b.smithi132.stderr:==00:11:30:30.114 8842== Warning: unimplemented fcntl command: 1036 2019-12-09T21:11:14.998 INFO:teuthology.orchestra.run.smithi121.stderr:testChunkedPut (test.functional.tests.TestFile) ... ok 2019-12-09T21:11:23.898 INFO:teuthology.orchestra.run.smithi121.stderr:testContentTypeGuessing (test.functional.tests.TestFile) ... ok 2019-12-09T21:11:53.888 INFO:teuthology.orchestra.run.smithi121.stderr:testCopy (test.functional.tests.TestFile) ... ok 2019-12-09T21:12:06.889 INFO:teuthology.orchestra.run.smithi121.stderr:testCopy404s (test.functional.tests.TestFile) ... ok 2019-12-09T21:12:09.990 INFO:teuthology.orchestra.run.smithi121.stderr:testCopyDestinationSlashProblems (test.functional.tests.TestFile) ... ok 2019-12-09T21:12:36.337 INFO:teuthology.orchestra.run.smithi121.stderr:testCopyFromHeader (test.functional.tests.TestFile) ... ok 2019-12-09T21:12:44.896 INFO:teuthology.orchestra.run.smithi121.stderr:testCopyFromHeader404s (test.functional.tests.TestFile) ... ok 2019-12-09T21:12:46.578 INFO:teuthology.orchestra.run.smithi121.stderr:testCopyNoDestinationHeader (test.functional.tests.TestFile) ... ok 2019-12-09T21:12:52.644 INFO:teuthology.orchestra.run.smithi121.stderr:testDelete (test.functional.tests.TestFile) ... ok 2019-12-09T21:12:54.520 INFO:teuthology.orchestra.run.smithi121.stderr:testDeleteOfFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-12-09T21:13:00.120 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-12-09T21:13:00.120 DEBUG:teuthology.task.console_log:Killing console logger for smithi132 2019-12-09T21:13:00.121 DEBUG:teuthology.task.console_log:Killing console logger for smithi121 2019-12-09T21:13:00.121 DEBUG:teuthology.task.console_log:Killing console logger for smithi132 2019-12-09T21:13:00.121 DEBUG:teuthology.task.console_log:Killing console logger for smithi121 2019-12-09T21:13:00.122 DEBUG:teuthology.exit:Finished running handlers